Environments are a useful tool for your Python based life, but managing them can be tricky. Learn the ins and outs on this week's MetPy Monday!
MetPy Mondays #81 - Managing Environments
27 May 2019
Environments are a useful tool for your Python based life, but managing them can be tricky. Learn the ins and outs on this week's MetPy Monday!
Chunking Algorithms for NetCDF-C
22 May 2019
Unidata is in the process of developing a Zarr [] based variant of netcdf. As part of this effort, it was necessary to implement some support for chunking. Specifically, the problem to be solved was that of extracting a hyperslab of data from an n-dimensional variable (array in Zarr parlance) that has been divided into chunks (in the HDF5 sense). Each chunk is stored independently in the data storage -- Amazon S3, for example.
The algorithm takes a series of R slices of the form (first,stop,stride), where R is the rank of the variable. Note that a slice of the form (first, count, stride), as used by netcdf, is equivalent because stop = first + count*stride. These slices form a hyperslab.
The goal is to compute the set of chunks that intersect the hyperslab and to then extract the relevant data from that set of chunks to produce the hyperslab.
[Read More]MetPy Mondays #79 - Function Documentation
14 May 2019
Documenting isn't always fun, but it's the best way to be nice to your future self! Find out how in this week's MetPy Monday!
