Previous: IDV Next: What is Chunking? Table of contents Frames 2011 Unidata NetCDF Workshop

14 Chunking and Deflating Data with NetCDF-4
NetCDF-4/HDF5 data may be written in chunks for increased performance, and may use on-the-fly compression.

14.0  What is Chunking?
Chunked data are written in chunks of user-defined size.
14.1  Choosing Chunksizes
How do you pick chunksizes?
14.2  Setting the Chunksizes in NetCDF-4
Set the chunksizes for variables in netCDF-4 file with nc_def_var_chunking().
14.3  Example of Setting Chunksizes in Fortran 90
In this example code (from nf_test/f90tst_varss.f90) the chunksize is set for several 2-dimensional variables in Fortran 90.
14.4  The Cache in NetCDF-4
The cache is used when reading or writing data. Set the cache size correctly for each variable to improve performance.
14.5  Setting the Cache in NetCDF-4
Set the cache for a variable with the nc_var_set_cache function.
14.6  Per-Variable Compression in NetCDF-4
Chunked variables in netCDF-4 files may use on-the-fly compression with zlib.
14.7  Per-Variable Compression in NetCDF-4
This example shows how to set the compression level for variables.
14.8  Per-Variable Compression in NetCDF-4, Results
File sizes of compressed and uncompressed 2D radar data.
14.9  How to Use Per-Variable Compression in NetCDF-4
Some advice about using compression.
14.10  Contiguous Variables
A contiguous variable is stored as one long array in the file.
14.11  Using Contiguous Variables
Use the nc_def_var_chunking function to make a variable contiguous.
14.12  Example of Contiguous Variable
A contiguous storage variable is created in this example.

 


Previous: IDV Next: What is Chunking? Table of contents Frames 2011 Unidata NetCDF Workshop