Showing entries tagged [netcdf4]

Netcdf-4 Filter Support Changes

The netcdf-c library filters API in version 4.7.4 has been deprecated in favor of a modified version that unfortunately may cause incompatibilties for users.

The initial reason for the incompatible changes was to support the use of filters in the new NCZarr code. The changes were not completely thought out so it was decided to remove them and revert to previous behaviors. At some future point, the filter mechanism will be extended to support filters for NCZarr, but these will be proper extensions: the existing, reverted, filter API will continue to be supported with no user-visible modifications.

Unfortunately, some advanced users of netcdf filters may experience some compilation or execution problems for previously working code because of these reversions. In that case, please revise your code. Apologies are extended for any inconvenience. Note that it is possible to detect which mechanism is in place at build time.

In summary, the changes are of the following kinds:

  • Some functions were renamed for consistency.
  • Revert the way that the function nc_inq_var_filter was indicating no filters existed.
  • Some auxilliary functions for parsing textual filter specifications have been moved to netcdf_aux.h.
  • All of the "filterx" functions have been removed.
  • The undocumented function nc_filter_remove was deleted.

See the Github document https://github.com/Unidata/netcdf/blob/master/NUG/filters.md for details.

NetCDF4 use of dimension scales

Some thoughts on how shared dimensions could be done in a simpler way. [Read More]

NetCDF-4 Dimensions and HDF5 Dimension Scales

If you want to write HDF5 files directly without using the netCDF-4 library, or if you want to build a netCDF-4 compatible software layer on top of HDF5, read on.

[Read More]

HDF5 Dimension Scales - Part 3

The gritty details of what dimension scales look like at the file object level.

[Read More]

More Cache Size Benchmarks

Why does increasing cache size slow down time series access so much?

bash-3.2$ ./tst_ar4 -h pr_A1_256_128_128.nc
cs[0] cs[1] cs[2] cache(MB) deflate shuffle read_hor(us) read_time_ser(us)
256   128   128   0.5       0       0       217          2773
256   128   128   1.0       0       0       214          1935
256   128   128   4.0       0       0       214          1929
256   128   128   32.0      0       0       160          84440
256   128   128   128.0     0       0       129          82407
Unidata Developer's Blog
A weblog about software development by Unidata developers*
Unidata Developer's Blog
A weblog about software development by Unidata developers*

Welcome

FAQs

News@Unidata blog

Take a poll!

What if we had an ongoing user poll in here?

Browse By Topic
Browse by Topic
« March 2024
SunMonTueWedThuFriSat
     
1
2
3
5
6
7
8
9
10
11
12
13
14
15
16
17
19
20
21
22
23
24
25
26
27
28
29
30
31
      
Today