[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [Support #HKV-830940]: question about LDM IP address

Hi Laura,

We can begin feeding you the satellite data once your LDM is up and
running. I was trying to help Jared determine what satellite data was
desired, and what application (hence format) was desired. We can open
up the full hose and let you sort it out or, more wisely, pare it down to
what is needed :)

Regarding the RAWS data, it is not part of the "standard" FOS NOAAPort and
therefore not in our IDS|DDPLUS datastream. I am contacting NOAA GSD,
where our MADIS feed originates, and determine if the RAWS data is in
their meso-net collection that is distributed via the LDM/IDD

Also, it may be good to investigate our IDV software that has real time
access to satellite data and surface obs and accomodates other types of
data as "layers" to accomodate fire weather, etc.

Please visit:

http://www.unidata.ucar.edu/software/idv

..it's is certainly worth looking into, I think it may work well for your
needs.

I am expecting a new child any second now, so please, to insure a timely
response, direct support questions to:

address@hidden

Cheers,

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Fri, 30 Jan 2009, Brattain, Laura wrote:

> Jeff,
> We're still very interested in getting the Raws data feeds and satellite data 
> feeds through LDM. Please let us know what our next step should be.
> Thanks,
> Laura
>
> -----Original Message-----
> From: Brattain, Laura
> Sent: Wednesday, January 21, 2009 10:50 PM
> To: 'address@hidden'
> Subject: RE: [Support #HKV-830940]: question about LDM IP address
>
> Jeff:
> I'm working with Jared Pullen on the Disaster Management Program at MIT 
> Lincoln Laboratory. I'd like to follow up with you on some of the data feeds 
> that we're interested in getting from Unidata. We're developing a web based 
> situational awareness application in collaboration with Cal Fire. The aim of 
> the application is to demonstrate its potential for wild land fire 
> protection. Weather information (in particular RAWS) and satellite imageries 
> are among the number of data sources we identified as useful for this 
> application. We would like to be able to visualize them at real-time onto a 
> map such as Google Map. The preferred format is RSS feed, which is relatively 
> easy for us to parse.
>
> The link below shows a few example of the hourly RAWS data feeds for San 
> Diego area:
>
> http://www.wrh.noaa.gov/sgx/data/rss/SD_Valleys.xml
>
> This link shows the content of a feed:
> http://www.wrh.noaa.gov/sgx/display_product_versions.php?sid=SGX&pil=FWO&version=0&pvnum=20
>
> We could subscribe to it, but the feed does not contain lat and long
> information of each RAWS station. We're hoping that the data feeds from
> Unidata would provide more detailed information, including the location
> of each RAWS station.
>
> Here is a list of the RAWS stations that we're interested in as the
> first cut:  Alpine (ANEC1), Potrero (POTC1), Cameron Fire Station
> (CMNC1), Case Springs (CSPC1), Pine Hills (PIHC1), Ranchita(RCHC1),
> Valley Center (VLCC1)
>
> In case of a major fire event, satellite imageries will be helpful too.
> At this point, we're thinking about overlaying satellite image with some
> transparency on top of the map with some geo reference.
>
> I hope this provides you with some background information on our
> motivation in getting the data feeds from Unidata. We look forward to
> your advice on the best way to pursue it.
>
> Thanks,
> Laura
>
> ----------------------------------------
> Laura Brattain
> Biodefense Systems
> MIT Lincoln Laboratory
> 244 Wood Street
> Lexington, MA 02420
> 781-981-3461
> address@hidden
> -----------------------------------------
>
> ________________________________________
> From: Unidata IDD Support [address@hidden]
> Sent: Thursday, January 15, 2009 13:07
> To: Pullen, Jared
> Cc: address@hidden; Pullen, Jared
> Subject: [Support #HKV-830940]: question about LDM IP address
>
> > Hi,
> >
> > We've come up with a few more questions, as this is the first time we've 
> > ever worked with LDM.
> >
> > First, some background:  To start, we'd like to get a stream of RAWS data, 
> > specifically from stations located in Southern California.  We'd also like 
> > some satellite imagery of Southern California, if possible.  I haven't been 
> > able to find documentation regarding setting up the regular expression to 
> > filter on specific things such as RAWS in Southern California.  Or even a 
> > list of what stations are available.
>
> Yes, when first discussed this w/Trina it was mentioned that we (Unidata) did 
> not know specifically what data was desired, we suggested the IDS|DDPLUS 
> feedtype as it is the one that carries surface observations for operational 
> use. THE RAWS data you desire ~may not be included in that feed. It ~may be 
> in the feed that originates at GSD (FSL) delivers MADIS and Meso-West surface 
> observational data.
>
> http://www-sdd.fsl.noaa.gov/MADIS/
>
> It would be helpful if we knew the station IDS of the desired RAWS, and I see 
> above that you are asking us for a list of the stations :)
>
> Does it need to be RAWS data or would METAR's work?
>
>
>
> >
> > I also have no idea what format these streams are in when they're written 
> > to file.  On our side we'd like to be able to process the RAWS data from 
> > each individual station, and do our own transform on it into whatever 
> > format we want to display it in.  So what would be the recommended way to 
> > store the data stream?  Just to file?  Then I'm assuming we can just 
> > inspect the file and parse out what we want?
>
> The METAR's or in the WMO standard BUFR, not knowing what RAWS we are dealing 
> with cannot answer, but would suspect BUFR.
>
> >
> > Then in the case of satellite imagery, do those just each get written as 
> > separate images to the disk?  Is there any kind of metadata we can work 
> > with?
>
> Yes, we carry all bands of the GOES E and W platforms.
>
> VIS 1km every 15 minutes for W-CONUS
>
> ..and so on.
>
> To see a nice list please visit:
>
> http://motherlode.ucar.edu:8080/thredds/idd/satellite.html
>
> this catalog also provides useful metadata:
>
> i.e.:
>
> http://motherlode.ucar.edu:8080/thredds/catalog/satellite/VIS/WEST-CONUS_1km/20090115/catalog.html?dataset=SSEC/IDD-Satellite/VIS/WEST-CONUS_1km/20090115/WEST-CONUS_1km_VIS_20090115_1715.gini
>
>
>
>   For instance, can we get at the lat/long extent and resolution of the 
> satellite imagery for mapping it later on our end?  (Which is what we would 
> ideally be able to do).  You also mentioned decoders, and I'm not familiar 
> with what those can do, so I've meant to start looking into those.
> >
>
> Depending upon how you plan to use the data the deocoders may or may not be 
> applicable to you, most of our decoders are designed for use in our 
> applications McIDAS/GEMPAK/IDV..and also would be used to convert to netCDF, 
> our format of choice for many of our applications.
>
> > So this is all new to us, and we'd appreciate some guidance as to what path 
> > would suit us best.
> >
>
> What exactly are you wanting to do, we may be able to lend some insights 
> based on our knowledge of the data.
>
> It sounds like you are wanting to compare surface obs with satellite imagery 
> in some manner, this should be quite workable in many ways, can you provide 
> any more details?
>
> > I'd also like to at least run LDM on this side to see if we're even getting 
> > anything yet.  But right now nothing at all is uncommented in the 
> > pqact.conf...so I need to at least enable one of the FILE options.  And in 
> > my ldmd.conf I have this request line:  request IDS|DDPLUS ".*" 
> > idd.cise-nsf.gov .  So is that request line and regex sufficient to get at 
> > least a connection test going once I enable a FILE in pqact.conf?
>
> Yes, and you can also verify your connection by using the LDM utilty 
> "notifyme":
>
> http://www.unidata.ucar.edu/software/ldm/ldm-6.6.5/basics/monitoring.html#upstream%20availability
>
> i.e
>
> notifyme -vl - -h idd.cise-nsf.gov -f IDS|DDPLUS
>
> This will allow you to view the products in the IDS|DDPLUS feed as they 
> become available across the network.
>
> >
> > Thanks for your help,
> >
> >
> > Jared
> >
> >
> Hopefully this will help get things started.
>
>
> Cheers,
>
> Jeff
> Jeff Weber
> Unidata User Support
> http://www.unidata.ucar.edu
>
> Ticket Details
> ===================
> Ticket ID: HKV-830940
> Department: Support IDD
> Priority: Normal
> Status: Open
>