[thredds] Writing GRIB Indicies "offline"


Greetings!

I have a relatively large static dataset of grib files that I'm trying to get set up in my TDS. I currently have my tomcat running with 8Gb of heap, but run into heap space problems when trying to create the .ncx files

I think part of my problem is that I'm not partitioning my collection (I'm trying this next).

I have been trying to create the indices "offline" with the following:

java -Xmx512m -classpath netcdfAll-4.3.jar ucar.nc2.grib.grib1.Grib1Index $gribfile

then

java -Xmx12288m -verbose -classpath netcdfAll-4.3.jar ucar.nc2.grib.grib1.Grib1Collection -make collection_name.ncx "/path/to/files/*.grib"

But even with 12 Gb of heap allocated, I am still getting heap dumps.

Even if I am successful at creating the collection index file (collection_name.ncx), will it require massive amounts of heap space to read in the collection by THREDDS?

Is partitioning my best bet?

Thanks!

-kevin.

--
Kevin Manross
NCAR/CISL/Data Support Section
Phone: (303)-497-1218
Email:manross@xxxxxxxx <mailto:manross@xxxxxxxx>
Web:http://rda.ucar.edu
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: