[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: quickie before the weekend



John,
Okay, I'm looking forward to 4.3.   And I like the idea of deprecating
FMRC to just yield the best time series.  I've never known folks to
use anything except the best time series, and this would be very
useful now that we are starting to use search services that have
harvested data from THREDDS catalogs.   It's a pain to try to avoid
harvesting all those other datasets that the FMRC currently produces.

-Rich

On Fri, Jun 10, 2011 at 6:30 PM, John Caron <address@hidden> wrote:
> On 6/10/2011 3:08 PM, Rich Signell wrote:
>>
>> Quickie before the weekend!
>>
>> How would I convert this to featureCollection FMRC?
>>
>> Files in subdirs look like this:
>> rsignell@gam:~$ ls -lR /usgs/data0/rsignell/models/rtofs
>> /usgs/data0/rsignell/models/rtofs:
>> total 0
>> drwxrwxr-x 2 rsignell usgs 108 2011-06-10 17:05 ofs.20091122
>> drwxrwxr-x 2 rsignell usgs  74 2011-06-10 17:06 ofs.20091123
>>
>> /usgs/data0/rsignell/models/rtofs/ofs.20091122:
>> total 599900
>> -rw-rw-r-- 1 rsignell usgs 204516013 2009-11-23 00:49
>> ofs_atl.t00z.F024.grb.grib2
>> -rw-rw-r-- 1 rsignell usgs 204624673 2009-11-23 00:56
>> ofs_atl.t00z.F048.grb.grib2
>> -rw-rw-r-- 1 rsignell usgs 205152212 2009-11-23 00:41
>> ofs_atl.t00z.N000.grb.grib2
>>
>> /usgs/data0/rsignell/models/rtofs/ofs.20091123:
>> total 399712
>> -rw-rw-r-- 1 rsignell usgs 204466798 2009-11-24 01:09
>> ofs_atl.t00z.F024.grb.grib2
>> -rw-rw-r-- 1 rsignell usgs 204834585 2009-11-24 01:01
>> ofs_atl.t00z.N000.grb.grib2
>>
>>
>> and my old FMRC looks like this:
>>   <datasetFmrc name="RTOFS Forecast Model Run Collection"
>> path="fmrc/rtofs">
>>       <netcdf
>> xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
>>          <aggregation dimName="runtime"
>> type="forecastModelRunSingleCollection" timeUnitsChange="true"
>> recheckEvery="10min">
>>             <scanFmrc location="/usgs/data0/rsignell/models/rtofs"
>> regExp=".*ofs_atl.*\.grib2$"
>>              runDateMatcher="#ofs.#yyyyMMdd"
>> forecastOffsetMatcher="HHH#.grb.grib2#" subdirs="true"
>>              olderThan="10 min"/>
>>
>>
>
> In 4.2, FMRC wont work because the runtime is not in the filename
>
> In 4.3 you can say:
>
> <featureCollection name="RTOFS Forecast Model Run Collection"
> path="fmrc/rtofs" featureType="GRIB">
>
> <collection spec="/usgs/data0/rsignell/models/rtofs/**/.*grib2$"
> name="RTOFS"
>                  dateFormatMark="#rtofs/ofs.#yyyyMMdd"recheckAfter="10 min"
> olderThan="10 min"/>
>
> <update startup="true" rescan="0 0/5 * * * ? *" trigger="allow"/>
> <protoDataset choice="Penultimate" change="0 2 3 * * ? *"/>
>
> </featureCollection>
>
> (I would need to double check that - i cant write these things of the top of
> my head either)
>
> this doesnt give an FMRC, just a "best" dataset and the component files. I
> may eventually deprecate FMRC.
>
>  It should be much faster. still in pre-alpha, only can be used on grib2.
>
>



-- 
Dr. Richard P. Signell   (508) 457-2229
USGS, 384 Woods Hole Rd.
Woods Hole, MA 02543-1598