NetCDF operators (NCO) version 5.0.1
Version 5.0.1 of the netCDF Operators (NCO) has been released. NCO is an Open Source package that consists of a dozen standalone, command-line programs that take netCDF files as input, then operate (e.g., derive new data, average, print, hyperslab, manipulate metadata) and output the results to screen or files in text, binary, or netCDF formats.
The NCO project is coordinated by Professor Charlie Zender of the Department of Earth System Science, University of California, Irvine. More information about the project, along with binary and source downloads, are available on the SourceForge project page.
From the release message:
Version 5.0.1 contains the necessary options for ncremap to exploit MPI-enabled weight generators such as ESMF_RegridWeightGen. You can probably skip this release unless you use ncremap.
New Features
ncremapaccepts two new and related options,mpi_pfxandmpi_nbr. The--mpi_pfx=mpi_pfxoption specifies an appropriate job scheduler prefix for MPI-enabled weight-generation executables such as ESMF's ESMF_RegridWeightGen and MoabTempest'smbtempest. Other weight generators (ncks,GenerateOfflineMap) are unaffected by this option since they are not MPI-enabled.mpi_pfxdefaults tompirun -n $mpi_nbron all machines except those whose $HOSTNAME matches an internal database of DOE-operated supercomputers wherempi_pfxdefaults tosrun -n $mpi_nbr. When invoking--mpi_pfx, be sure to explicitly define the number of MPI tasks-per-node, e.g.,ncremap --mpi_pfx='srun -n 16' ... ncremap --mpi_pfx='srun --mpi=pmi2 -n 4' ...
The separate
--mpi_nbr=mpi_nbroption specifies the number of tasks-per-node that MPI-enabled weight generators will request. It preserves the default job scheduler prefix (srunormpirun):ncremap --mpi_nbr=4 ... # 16 MPI tasks-per-node for ERWG/mbtempest ncremap --mpi_nbr=16 ... # 4 MPI tasks-per-node for ERWG/mbtempest
Thus
--mpi_nbr=mpi_nbrcan be used to create host-independentncremapcommands to facilitate benchmarking the scaling of weight-generators across hosts that work with the default value ofmpi_pfx. The--mpi_pfxoption will prevail and--mpi_nbrwill be ignored if both are used in the same ncremap invocation. Note thatmpi_pfxis only used internally byncremapto exploit the MPI capabilities of select weight-generators. It is not used to control and does not affect the distribution of multiplencremapcommands among a cluster of nodes.
https://nco.sf.net/nco.html#mpi_pfx
https://nco.sf.net/nco.html#mpi_nbr
Additional details are available in the ChangeLog.
Add new comment