[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Configuration problems

Hi Gerry, 

I am not quite sure what FSL puts out on their FSL3 "feed".

But if not Level II radar data, then you are not requesting it.

I see WMO from tamu and FSL2-3 from FSL..

Please see:

http://my.unidata.ucar.edu/content/software/ldm/feedtypes/index.html

I do not see CRAFT data from tamu:

/local/ldm/bin% notifyme -vl - -h coriolis.met.tamu.edu -f NEXRD2 -o 15000
Oct 21 20:01:59 notifyme[29121]: Starting Up: coriolis.met.tamu.edu:
20021021155159.643 TS_ENDT {{NEXRD2,  ".*"}}
Oct 21 20:02:02 notifyme[29121]: NOTIFYME(coriolis.met.tamu.edu): OK
^COct 21 20:03:29 notifyme[29121]: Interrupt
Oct 21 20:03:29 notifyme[29121]: exiting


So we would need to set that feed up with a host ingesting that feed...

The WMO feed should contain all the obs you desire, but I do not see any
way currently that you could be getting the Level II radar data, unless
FSL sneeks it into their FSL3 "feed"..


Let me know how you would like to proceed,

-Jeff
____________________________                  _____________________
Jeff Weber                                    address@hidden
Unidata Support                               PH:303-497-8676 
COMET Case Study Library                      FX:303-497-8690
University Corp for Atmospheric Research      3300 Mitchell Ln
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000
________________________________________      ______________________

On Mon, 21 Oct 2002, Unidata Support wrote:

> 
> ------- Forwarded Message
> 
> >To: address@hidden
> >From: Gerry Creager N5JXS <address@hidden>
> >Subject: Configuration problems: Request for hand-holding
> >Organization: Da House
> >Keywords: 200210191833.g9JIXM111036
> 
> This is a multi-part message in MIME format.
> --------------070603080303060703010000
> Content-Type: text/plain; charset=us-ascii; format=flowed
> Content-Transfer-Encoding: 7bit
> 
> I'm trying to get LDM configured for some Texas-specific Mesonet 
> activities.  I'm having trouble with some of the FSL-provided data. 
> Could I get a little help getting this on-track?
> 
> I'm attaching the ldmd.conf and pqact.conf files I'm using.  Currently, 
> I get the FSL surface data, except bouys, pretty well.  I'm using the 
> MADIS tools to generate a text file, and then ingesting the data into a 
> database.
> 
> I guess, what I'm in need of, is to make sure I'm getting surface obs, 
> both AWIPS and FSL, upper air, CRAFT/Level II/II data, and Maritime.
> 
> Any help you might offer would be appreciated.
> 
> Thanks!
> gerry
> -- 
> Gerry Creager -- address@hidden
> Texas Mesonet, Academy for Advanced Telecommunications
> Texas A&M University, College Station, TX
> Office: 979.458.4020 FAX: 979.847.8578 Cell: 979.229.5301 Page: 979.228.0173
> 
> --------------070603080303060703010000
> Content-Type: text/plain;
>  name="ldmd.conf"
> Content-Transfer-Encoding: 7bit
> Content-Disposition: inline;
>  filename="ldmd.conf"
> 
> #####
> # $Id: ldmd.conf,v 1.16 2002/06/17 21:12:43 anne Exp $
> # Sample ldmd.conf for ldm5
> ####
> #
> # This is the main configuration file for the LDM server. All lines that start
> # with a "#" sign are comments.
> #
> # To debug an LDM that hangs on start up, run the following from LDM home:
> # % bin/rpc.ldmd -vl - -q data/ldm.pq etc/ldmd.conf
> #
> # If the LDM still hangs, comment out all lines in this file except noted
> # allow line entry below, try again.
> #
> ###############################################################################
> # Exec Entries
> ###############################################################################
> #
> # Programs that can share a queue with rpc.ldmd server, these programs
> # are started by the "exec" command and are in the same process group.
> #
> # Regarding pqbinstats, while pqbinstats will generate .stats files in
> # your logs directory, it is necessary to also run 'ldmadmin dostats'
> # once per hour via cron in order to email the stats to the UPC and
> # remove the .stats files that are no longer needed.  See
> # http://www.unidata.ucar.edu/packages/ldm/ldmConfigInstallList.html#s7
> # for more information.
> exec  "pqbinstats"
> exec  "pqact"
> #
> # rtstats uses the LDM to send product latency statistics to the UPC.
> # We are currently evolving from pqbinstats to rtstats, but in the
> # mean time we hope sites will run both.  For more info on rtstats
> # please see the man page.
> exec  "rtstats -h rtstats.unidata.ucar.edu"
> #exec "pqsurf"
> #
> ###############################################################################
> # Request Entries
> ###############################################################################
> #
> # LDM5 servers request data from Data Sources
> #
> #     request <feedset> <pattern> <hostname pattern>
> #
> request WMO ".*" coriolis.met.tamu.edu
> #
> #request GPS ".*"     <hostname>
> #
> #     FSL Mesonet data
> #request      FSL2    "^FSL\.NetCDF\.MADIS\.metar\..*"        
> eldm.fsl.noaa.gov
> #request      FSL2    "^FSL\.NetCDF\.MADIS\.profiler\..*"     
> eldm.fsl.noaa.gov
> #request      FSL3    "^FSL\.NetCDF\.MADIS\.mesonet1\..*"     
> eldm.fsl.noaa.gov
> #request      FSL3    "^FSL\.NetCDF\.MADIS\.hydro1\..*"       
> eldm.fsl.noaa.gov
> #request      FSL2    "^FSL\.NetCDF\.MADIS\.raob\..*"         
> eldm.fsl.noaa.gov
> request FSL2    "^FSL\.NetCDF\.MADIS\..*"               eldm.fsl.noaa.gov
> request FSL3    "^FSL\.NetCDF\.MADIS\.mesonet1..*"      eldm.fsl.noaa.gov
> request FSL3    "^FSL\.NetCDF\.MADIS\.hydro1..*"        eldm.fsl.noaa.gov
> 
> ###############################################################################
> # Allow Entries
> ###############################################################################
> #
> # Giving permission for a Data Sink to perform a request to your LDM
> #
> # allow       <feedset> <hostname pattern>
> #
> # Giving permission to your own machine and Unidata
> #
> # Under no circumstances comment out the next allow entry to localhost
> # The LDM will NOT start if the lines are commented out.
> allow ANY
>     
> ^((localhost|loopback)|(127\.0\.0\.1\.?$)|([a-z].*\.unidata\.ucar\.edu\.?$))
> #
> ###############################################################################
> # Accept Entries
> ###############################################################################
> # ACCEPT: Who can feed us, currently this action is ONLY needed for WSI data
> #
> # accept <feedset> <pattern> <hostname pattern>
> #
> # accept anything from yourself
> #
> #accept ANY ".*" ^((localhost|loopback)|(127\.0\.0\.1\.?$))
> #
> # accept from your upstream site
> #
> # WSI is using ldm4 protocol so the accept is still required
> #accept       WSI
> #    .*
> #    ^[a-z].*\.uni\.wsicorp\.com$
> #
> ###############################################################################
> # End 
> ###############################################################################
> 
> --------------070603080303060703010000
> Content-Type: text/plain;
>  name="pqact.conf"
> Content-Transfer-Encoding: 7bit
> Content-Disposition: inline;
>  filename="pqact.conf"
> 
> ####
> # $Id: pqact.conf,v 1.10 1999/07/28 15:34:54 rkambic Exp $
> #
> # This is an example pqact.conf file,
> # with some example entries commented out.
> #
> # The entries in this file control the local disposition
> # of data. There is a whole chapter in the LDM Site Manager's
> # Guide devoted to this file. We suggest you read and understand that 
> material.
> # http://www.unidata.ucar.edu/packages/ldm/ldm5/LDM5-44.html#HEADING44-0
> #
> # The various display and analysis packages have various
> # conventions on how they want data handled. When you
> # install a package such as GEMPAK, you should find with that package
> # collection of entries to add to this file.
> #
> # Example entries for GEMPAK can be found at
> #  http://www.unidata.ucar.edu/packages/gempak/GEMPAK5.4/configuration.html
> # Example entries for LDM-McIDAS may be found at
> #  http://www.unidata.ucar.edu/packages/mcidas/mcidd/ldm-mcidas-pqact.conf
> # and annotated entries for McIDAS-XCD are found at
> #  http://www.unidata.ucar.edu/packages/mcidas/mcx/xcd_start.html
> #
> ##
> # Format is
> # feedtype tab pattern tab action [tab action_args]
> # where tab is \t or \n\t.
> #
> # Actions are
> #
> #     NOOP
> #             Do nothing
> #
> #     FILE    [-overwrite|-flush|-close|-strip] filename
> #             write(2) to unix file (flush calls fsync(2))
> #
> #     STDIOFILE       [-overwrite|-flush|-close|-strip] filename
> #             fwrite(3) (buffered io) to file (flush calls fflush(3))
> #
> #     DBFILE  dbfilename [dbkey]
> #             Put to gdbmfile.
> #
> #     PIPE    [-close|-strip] commandname [args]
> #             Put data on stdin of a subprocess specified by
> #                     commandname [args].
> #             Uses the execvp library call, so if commandname is not fully
> #             qualified, the PATH environment variable will be used.
> #
> #     EXEC    [-wait] commandname [args ...]
> #             Run a program. No io channel between this process and it.
> #             Like PIPE above, uses execvp.
> #
> # The '-strip' option to FILE, STDIOFILE, & PIPE removes control characters
> # (other than the '\n') from the data before output. This is useful for
> # cleaning up WMO format text bulletins (like the ldm3  STRIP psuedo action).
> #
> # To check the syntax of the pqact.conf file, execute pqact with the product
> # queue specified as /dev/null:
> #
> #     pqact -vxl- -q /dev/null pqact.conf
> #
> #                     or
> #     ldmadmim pqactcheck
> #
> # To send an HUP signal to pqact
> #
> #     ldmadmin pqactHUP
> #     ldmadmin tail     (used to check if HUP took, looking for ReRead msg)
> ###
> ####
> # Bin all the (Non-GRIB) WMO format data, using elements from the
> # identifier as path components. The minutes portion of the timestamp,
> # and the retransmit code is ignored. The day of the month portion
> # of the timestamp is not used as a path component, so it would be
> # a good idea to run 'scour' on a less than 24 hour basis.
> #
> #  "ASUS42 KRDU 012259" gets filed as
> #  data/US/KRDU/22/AS42.wmo
> #
> WMO   ^([^H][A-Z])(TX|OK|LA|AR|NM)([0-9][0-9]) (....) ([0-3][0-9])([0-2][0-9])
>       FILE    data/\2/\4/\6/\1\3.wmo
> ##
> WMO   ^([S][A])([U][S])([0-9][0-9]) (....) ([0-3][0-9])([0-2][0-9])
>       FILE     data/\2/\4/\6/\1\3.wmo
> #
> # Surface analyses 
> WMO   ^ASUS.. .... ([0-3][0-9])([0-2][0-9])
>       STDIOFILE       data/surface/(\1:yy)(\1:mm)\1\2.SAA
> #
> #
> #     GPS data for SuomiNet in binex format   
> GPS   ^GPS .... ([0-3][0-9])([0-2][0-9])      
>       FILE    data/GPS/(\1:yy)(\1:mm)\1\2.GPS
> #
> #  METAR Surface data for WEATHER
> #
> WMO   ^S[AP]US.. .... ([0-3][0-9])([0-2][0-9])
>       FILE    data/metar/(\1:yy)(\1:mm)\1\2.METAR
> #
> WMO   ^SAUS35 .... ([0-3][0-9])([0-2][0-9])
>       FILE    data/metar/(\1:yy)(\1:mm)\1\2.metar
> #
> 
> WMO   ^ABUS21 .... ([0-3][0-9])([0-2][0-9])
>       FILE    data/precip/(\1:yy)(\1:mm)\1\2.tmppcp
> #
> WMO   ^FS.... .... ([0-3][0-9])([0-2][0-9])
>       FILE    data/precip/(\1:yy)(\1:mm)\1\2.qps
> #
> WMO   ^TBUS10 .... [([0-3][0-9])([0-2][0-9])
>       FILE    data/precip/(\1:yy)(\1:mm)\1\2.satest
> #
> #WMO  ^SDUS.[0-9] .... ([0-3])[0-9])([0-2][0-9])[0-9]
> #     FILE    data/rcm/(\1:yy)(\1:mm)\1\230_rcm.rcm
> #
> #WMO  ^WXUS7[0-9] .... ([0-3][0-9])([0-2][0-9])
> #     FILE    data/fcst/(\1:yy)(\1:mm)\1\2.FCST
> #
> #WMO  ^FPUS01 .... ([0-3][0-9])([0-2][0-9])
> #     FILE    data/fcst/(\1:yy)(\1:mm)\1\2.STATE
> #
> #WMO  ^FPUS64 .... ([0-3][0-9])([0-2][0-9])
> #     FILE    data/fcst/(\1:yy)(\1:mm)\1\2.STATE
> #
> #WMO  ^FK.* ....([0-3][0-9])([0-2][0-9])
> #     STDIOFILE       data/ddplus/forecasts/(\1:yy)(\1:mm)\1\2.STAG
> #
> # US and Canadian sfc obs and specials in hourly files yymmddhh_sao.wmo
> DDS|IDS       ^S[AP][U][S].. .... ([0-3][0-9])([0-2][0-9])
>       STDIOFILE       data/ddplus/surface/(\1:yy)(\1:mm)\1\2.SAA
> #
> # Earthquake data
> WMO   ^SE.* .... ([0-3][0-9])([0-2][0-9])
>       STDIOFILE       data/ddplus/other/(\1:yy)(\1:mm)\1\2.QUAKE
> #
> FSL2  ^FSL\.NetCDF\.MADIS\.metar\.(.*)
>       FILE    -overwrite      -close  data/point/metar/netcdf/\1      
> #
> FSL2  ^FSL\.NetCDF\.MADIS\.profiler\.(.*)
>       FILE    -overwrite      -close  data/point/profiler/netcdf/\1   
> #
> FSL3  ^FSL\.NetCDF\.MADIS\.mesonet1\.(.*)
>       FILE    -overwrite      -close  data/LDAD/mesonet/netCDF/\1
> #
> FSL3  ^FSL\.NetCDF\.MADIS\.hydro1\.(.*)
>       FILE    -overwrite      -close  data/LDAD/hydro/netCDF/\1
> #
> FSL2  ^FSL\.NetCDF\.MADIS.\.raob\.(.*)
>       FILE    -overwrite      -close  data/point/raob/netcdf/\1
> #FSL3 ^FSL\.NetCDF\.MADIS.\.raob\.(.*)
> #     FILE    -overwrite      -close  data/point/raob/netcdf/\1
> 
> --------------070603080303060703010000--
> 
> 
> ------- End of Forwarded Message
> 
>