[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: NOAAPORT feed vs DDS/PPS


Greg,
What you have below wont work. The [] set is for the single position
character, so you can't say [SD].

An example to exclude the grids, SD..5x and SD..97 products could look like:

FSL5    "^([^GHIOSYZ]|S[^D]|SD..[^5]|SD..[^9]|SD..9[^7])"

You can also have multiple request lines to the same host, so you don't have to
worry about trying to squeeze it into a single request. 

Steve Chiswell

On Fri, 7 Apr 2000, Gregory Grosshans wrote:

> Is there a simple way to exclude SDUS5x, or does it have to be done brute 
> force in the
> request
> line:
> Would the following work?
> 
> (^[A-FK-NP-RT-X]|^[SA-SC]|^[SD-SZ])
> 
> Thanks,
> Gregg
> 
> Steve Chiswell wrote:
> 
> > Gregg,
> >
> > Yes, the GINI products all begin with T, and grib products with
> > H, Y, Z and now O for the new windwave gribs. The ECMWF grid (not grib)
> > ascii products begin with G. So, you pattern below does filter out most
> > of the gribs...but not the ^O..... KWBJ and GINI if they are in your FSL5.
> >
> > Some of the big data sets on NWSTG are the SDUS5x NIDS products. You might 
> > start
> > there to reduce some data flow.
> >
> > Steve Chiswell
> > Unidata User Support
> >
> > On Fri, 7 Apr 2000, Gregory Grosshans wrote:
> >
> > > Until yesterday I didn't realize how much data flows in from NOAAPORT.  I 
> > > knew it was
> > > in the MB/hour but not GB/day range.
> > > At the SPC a HP K server ingests the NOAAPORT NWSTG and GOES-WEST 
> > > channels into LDM.  A
> > > few days ago the 24 hour total for NOAAPORT data (FSL5) was 325216 
> > > products and 5.685
> > > GB.
> > >
> > > Another machine feeds from the above LDM with  the following request line:
> > >         request FSL5   (^[A-FK-X])     data.spc.noaa.gov
> > > resulting in FSL5 receiving 252001 products and 4.676 GB per day
> > >
> > > And a third machine ingesting the feed
> > >         # SFC/UA data and AVN MOS
> > >         request FSL5    (^U[EGHKLPQSZ]|^FE|^S[AP])              
> > > data.spc.noaa.gov
> > > resulting in FSL5 receiving 44536 products and 14 MB per day
> > >
> > > I believe the GINI (satellite data) WMO headers begin with ^T.  With the 
> > > request line
> > > A-FK-X, does this include grib data?
> > > Right now I'm interested in reducing the volume of data to something 
> > > similar in size to
> > > DDS/PPS.
> > >
> > > Thanks in advance.
> > >
> > > Gregg
> > >
> > >
>