Previous: Future Directions for CF Next: What is Chunking? Table of contents Frames 2012 Unidata NetCDF Workshop

19 Chunking and Deflating Data with NetCDF-4
NetCDF-4/HDF5 data may be written in chunks for increased performance, and may use on-the-fly compression.

19.0  What is Chunking?
Chunked data are written in chunks of user-defined size.
19.1  Choosing Chunksizes
How do you pick chunksizes?
19.2  Setting the Chunksizes in NetCDF-4
Set the chunksizes for variables in netCDF-4 file with nc_def_var_chunking().
19.3  The Cache in NetCDF-4
The chunk cache is used when reading or writing data. Set the cache size correctly for each variable to improve performance.
19.4  Setting the Cache in NetCDF-4
Set the cache for a variable with the nc_var_set_cache function.
19.5  Per-Variable Compression in NetCDF-4
Chunked variables in netCDF-4 files may use on-the-fly compression with zlib.
19.6  Per-Variable Compression in NetCDF-4, Results
File sizes of compressed and uncompressed 2D radar data. Note that deflation levels don't necessarily work as advertized, YMMV.
19.7  How to Use Per-Variable Compression in NetCDF-4
Some advice about using compression.
19.8  Contiguous Variables
A contiguous variable is stored as one long array in the file.

 


Previous: Future Directions for CF Next: What is Chunking? Table of contents Frames 2012 Unidata NetCDF Workshop