Previous: NetCDF-4 Status Next: What is Chunking? Table of contents Frames User guide
2008 Unidata NetCDF Workshop for Developers and Data Providers

12 Chunking Data with NetCDF-4
NetCDF-4/HDF5 data may be written in chunks for increased performance, on-the-fly compression, parallel I/O, and multiple unlimited dimensions.

12.0  What is Chunking?
Chunked data are written in chunks of user-defined size.
12.1  Choosing Chunksizes
How do you pick chunksizes?
12.2  Setting the Chunksizes in NetCDF-4
Set the chunksizes for variables in netCDF-4 file with nc_def_var_chunking().
12.3  Example of Setting Chunksizes in Fortran 90
In this example code (from nf_test/f90tst_vars.f90) the chunksize is set for a 2-dimensional variable in Fortran 90.
12.4  The Cache in NetCDF-4
The cache is used when reading or writing data. Set the cache size correctly for each variable to improve performance.
12.5  Setting the Cache in NetCDF-4
Set the cache for a variable with the nc_var_set_cache function.
12.6  Per-Variable Compression in NetCDF-4
Variables in netCDF-4 files may use on-the-fly compression with zlib.
12.7  Per-Variable Compression in NetCDF-4
This example shows how to set the compression level for variables.
12.8  Per-Variable Compression in NetCDF-4, Results
File sizes of compressed and uncompressed 2D radar data.
12.9  How to Use Per-Variable Compression in NetCDF-4
Some advice about using compression.
12.10  Contiguous Variables
A contiguous variable is stored as one long array in the file.
12.11  Using Contiguous Variables
Use the nc_def_var_chunking function to make a variable contiguous.
12.12  Example of Contiguous Variable
A contiguous storage variable is created in this example.

 


Previous: NetCDF-4 Status Next: What is Chunking? Table of contents Frames User guide
2008 Unidata NetCDF Workshop for Developers and Data Providers