Previous: Example of the Importance of the Chunk Cache Next: Solution, reorganize data with chunking Table of contents Frames 2011 Unidata NetCDF Workshop > Example of the Importance of the Chunk Cache

25.0 The Problem
Chunks good for writing data can be bad for reading it. This example illustrates how bad.

A user has a large 3D variable, about 17.5 GB, stored with time varying most slowly:

netcdf cvx3 {
dimensions:
	latitude = 1617 ;
	longitude = 1596 ;
	time = 1698 ;
variables:
 ...
	float var(time, latitude, longitude) ;
 ...
}

 


Previous: Example of the Importance of the Chunk Cache Next: Solution, reorganize data with chunking Table of contents Frames 2011 Unidata NetCDF Workshop > Example of the Importance of the Chunk Cache