Re: [thredds] cache options for large aggregated datasets

• To: thredds@xxxxxxxxxxxxxxxx
• Subject: Re: [thredds] cache options for large aggregated datasets
• From: John Caron <caron@xxxxxxxxxxxxxxxx>
• Date: Fri, 22 Apr 2011 13:30:31 -0600

On 4/22/2011 11:21 AM, tnb@xxxxxxxxxxxxxxxx wrote:

Hi everybody!

I have installed Tomcat6 and Thredds 4.2, and everything is working fine, i just have some questions about performance on the access of large aggregated dataset.

I am serving some aggregated data (about 38 Gb) and when i try to acess the Dataset Access Form from the catalog, thredds spend too much time to show me the page.

can you send the aggregation element?

I try enable all the cache options (netcdffile cache, aggregation cache and netcdfdataset cache), but it still take a lot of time (about 3 minutes) to open the Data Acess Form and consequentily to acess the data.

does that happen only the first time? what about the second time ?

Is this behavior normal with this size of aggregate dataset?

This is my cache options in threddsConfig.xml

...
<AggregationCache>
<scour>-1 hours</scour>

why -1 ?

<maxAge>30 days</maxAge>
</AggregationCache>

<NetcdfFileCache>
<minFiles>200</minFiles>
<maxFiles>400</maxFiles>
<scour>30 min</scour>
</NetcdfFileCache>

<NetcdfDatasetCache>
<minFiles>100</minFiles>
<maxFiles>200</maxFiles>
<scour>30 min</scour>
</NetcdfDatasetCache>
...

Did i forgeted some aditional setup option?

Also i have noted that in the directory $TOMCAT/content/thredds/cache/agg, the filename of the caches is ending with #null, (e.g. reanalise-ncep1.nc#null) is there something wrong during the creation of the cache?

Thanks for attention!


Tiago Bomventi


_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx

For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/

• References:
  • [thredds] cache options for large aggregated datasets
    • From: tnb