Re: [thredds] Feature Collections and Aggregation

Hi Tom:

Thanks.  Where I am confused, and am confused in the documentation, is I would 
think that for just standard gridded data, say one time period per file, that 
this would not be an FMRC feature collection, which is to my best understanding 
for forecasts, but would instead be a collection of featureType=Grid, or is 
FMRC now subsuming grids?    (see 
http://www.unidata.ucar.edu/software/netcdf-java/reference/FeatureDatasets/Overview.html
  which would imply that grid is the proper featureType for this type of 
featureCollection, but it is not clear that this is supported in TDS).

So I guess my question is can the featureType=grid in a featureCollection, and 
if so can someone point me to a working example and also the catalog.xml code 
that implements it?  To say that it is an FMRC when it is actually a grid 
strikes me as misleading, even if it works.

-Roy


On Aug 7, 2011, at 6:41 PM, tom cook wrote:

> HI I'm doing this in a test mode, and things seem to working well so
> I'll be eventually transitioning all my ncml aggregations soon. For
> the HF radar national network thredds server at
> http://hfrnet.ucsd.edu:8080/thredds, you'll see the ncml aggregations
> towards the top, and a "USWC_6km" link which is using the FMRC
> collection. We are overwriting our netCDF files, and there were some
> unresolvable errors with the ncml aggregations which were only fixable
> by disabling netcdf caching. This slowed the requests down
> considerably. After help from Rich Signell and John Caron, I was able
> to use the FMRC "best" dataset to resolve this problem. It has been
> working pretty well once I got around some of the initial setup.
> 
> Here's the portion of my catalog.xml that handles this:
> <featureCollection name="USWC_6km" featureType="FMRC"
> path="HFRNET/USWC_6km/FMRC">
> <metadata inherited="true">
> <serviceName>allServices</serviceName>
> <documentation type="Summary"> 6km HF Radar Data </documentation>
> </metadata>
> <collection 
> spec="/data1/HFRadar/RTV/USWC/**/#yyyyMMddHHmm#_HFRadar_USWC_6km_rtv_SIO.nc$"
> recheckAfter="15 min" name="USWC_6km_RTV_fmrc"
> olderThan="5 min"/>
> <!--   Re-scan the directory each hour at 5 minutes and 0 seconds
> past the hour -->
> <update startup="true" rescan="0 5 * * * ? *" trigger="allow"/>
> <fmrcConfig regularize="false" datasetTypes="Best"/>
> </featureCollection>
> 
> Good luck,
> Tom
> 
> On Sun, Aug 7, 2011 at 10:09 AM, Roy Mendelssohn
> <Roy.Mendelssohn@xxxxxxxx> wrote:
>> With TDS 4.2.x,  "Feature Collections" appear to be the preferred way to 
>> perform aggregation of datasets.  Questions are:
>> 
>> 1. Can you point me to a TDS server that is actually using this to perform 
>> aggregation as opposed to FMRC aggregation, and which datasets are being 
>> aggregated using this?
>> 
>> 2. Can I get the actual catalog.xml  (or portion of it) for that dataset?
>> 
>> I find seeing actual working examples more informative than what is often in 
>> the tutorials.  This may be because of old age and denseness,   but it is 
>> what works for me.
>> 
>> Thanks,
>> 
>> -Roy
>> 
>> 
>> **********************
>> "The contents of this message do not reflect any position of the U.S. 
>> Government or NOAA."
>> **********************
>> Roy Mendelssohn
>> Supervisory Operations Research Analyst
>> NOAA/NMFS
>> Environmental Research Division
>> Southwest Fisheries Science Center
>> 1352 Lighthouse Avenue
>> Pacific Grove, CA 93950-2097
>> 
>> e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
>> voice: (831)-648-9029
>> fax: (831)-648-8440
>> www: http://www.pfeg.noaa.gov/
>> 
>> "Old age and treachery will overcome youth and skill."
>> "From those who have been given much, much will be expected"
>> 
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit: 
>> http://www.unidata.ucar.edu/mailing_lists/
>> 

**********************
"The contents of this message do not reflect any position of the U.S. 
Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected" 
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.