[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: 20050509:UH IDD Connect



Hi Jay,

Not sure if you just want to file or if you want to decode as well...?

here are some examples of file actions for the CONDUIT feed:

CONDUIT ^/afs/.nwstg.nws.noaa.gov/ftp/(.*DF.gr1/.*) 
!(.*)/(.*)/(.*)/(#.*)/(.*)/(.*)/(.*)/(.*)!
        FILE    -close  data/pub/raw/conduit/\1/\2_\3_\4_\5_\6_\7_\8_\9

and

CONDUIT ^/afs/.nwstg.nws.noaa.gov/ftp/(.*DF.gr2/.*) 
!(.*)/(.*)/(.*)/(#.*)/(.*)/(.*)/(.*)/(.*)!
        FILE    data/pub/raw/conduit/\1


For UNIWISC feed:

Here is some  header info:

# Unidata-Wisconsin PNG compressed Products
#
# Header Format:
#              \1  \2   \3          \4      \5    \6     \7
#           Qx pd anum SAT         BAND    RES CCYYMMDD HHMM
# pnga2area Q0 CF 0015 GOES-10_SND UNKBAND 1km 20000525 2000
#
# McIDAS Product Codes and System Key Table entries used for Menu System
#-------+--------+------------------------------------+---------------------
# Code     Type    Description                         SYSKEY.TAB words
used
#-------+--------+------------------------------------+---------------------
#  CA      AREA    CIMSS Cloud Top Pressure                2173 2174 2175
#  CB      AREA    CIMSS Precipitable Water                2176 2177 2178
#  CC      AREA    CIMSS Sea Surface Temperature           2179 2180 2181
#  CD      AREA    CIMSS Lifted Index                      2182 2183 2184
#  CE      AREA    CIMSS CAPE                              2185 2186 2187
#  CF      AREA    CIMSS Ozone                             2188 2189 2190
#  CI      AREA    GOES-8/9 Infrared Composite             2161 2162 2163
#  CV      AREA    GOES-8/9 Visible Composite              2164 2165 2166
#  CW      AREA    GOES-8/9 Water Vapor Composite          2167 2168 2169
#  N1      AREA    GOES-8 IR/Topography Composite          2125 2126 2127
#  N2      AREA    GOES-8 VIS/Topography Composite         2128 2129 2130
#  N3      AREA    GOES-9 IR/Topography Composite          2131 2132 2133
#  N4      AREA    GOES-9 VIS/Topography Composite         2134 2135 2136
#  N5      AREA    MDR/Topography Composite                2137 2138 2139
#  N6      AREA    Mollweide/Topography Composite          2140 2141 2142
#  N7      AREA    GOES-8/9 IR/Topography Composite        2155 2156 2157
#  N8      AREA    GOES-8/9 VIS/Topography Composite       2158 2159 2160
#  UA      AREA    Educational floater I                   2101 2102 2103
#  UB      AREA    GOES-9 Western US Water Vapor           2104 2105 2106
#  UC      AREA    Educational floater II                  2170 2171 2172
#  UI      AREA    GOES-8 North America Infrared           2143 2144 2145
#  UR      AREA    Research floater                        2107 2108 2109
#  UV      AREA    GOES-8 North America Visible            2146 2147 2148
#  UW      AREA    GOES-8 North America Water Vapor        2149 2150 2151
#  UX      AREA    Global Mollweide Infrared Composite     2122 2123 2124
#  UY      AREA    Global Mollweide Water Vapor Composite  2152 2153 2154
#  U1      AREA    Antarctic composite                     2119 2120 2121
#  U3      AREA    Manually Digitized Radar                2110 2111 2112
#  U5      AREA    GOES-9 Western US Infrared              2113 2114 2115
#  U9      AREA    GOES-9 Western US Visible               2116 2117 2118
--

...and a sample pqact.conf entry:


# RTIMAGES GW-12
MCIDAS  ^pnga2area Q. (U8) (.*) (.*) (.*) (.*) (........) (....)
        PIPE    -close
        util/pnga2area -vl /usr/local/ldm/logs/ldm-mcidas.log
        -d /data/ldm/pub/decoded/mcidas/RTIMAGES/GW-12 -r \1,\2

Note, UNIWISC and MCIDAS are the same feed, this command "pipes" the data
to a decoder to generate "AREA" files, you may wish to not "act" on the
file so you could use the "FILE" command instead of the pipe, and thereby
obviating the need for:

util/pnga2area -vl /usr/local/ldm/logs/ldm-mcidas.log


Let us know if you want to decode or file only and we can be more
specific.


Cheers,

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Wed, 18 May 2005, Jay Krishnan wrote:

> Hi Jeff:
>
> Thanks for you help, I was able to successfully setup LDM on one of the
> two systems (namely usa-aqm.geosc.uh.edu). Now the product queue is
> active, however could you please let me know how I can get the data from
> the product queue into files on disk, the data we are getting from
> bigbird.tamu.edu are
>
> UNIWISC and
> CONDUIT
>
> I changed my pqact.conf to show
>
> NMC2  ^_ELSE_$        FILE    Conduit
> UNIWISC ^_ELSE_$        FILE    Uniwisc
>
> But I don't get any data, I am having some trouble understanding the ERE,
> is there any example for the Conduit and Uniwisc data types ?
>
> Ideally we would like to dump the data on disk and then have a clean up of
> 7 days (I will look in scour.conf to determine how to do this onnce I can
> get the data to disk)
>
> thanks for any help you can provide
> -Jay
>
> =============================================
> Jay Krishnan          PH #: 713.743.1697
> IT Manager            Fax #: 713.748.7906
> Geosciences           University of Houston
> =============================================
>
> On Wed, 11 May 2005, Jeff Weber wrote:
>
> > Hi all,
> >
> > I suspect you are referencing the hi-resolution model output...that ftp
> > path sure looks like CONDUIT grids...they are the preferred output for MM5
> > initialization.
> >
> > That would be feedtype 12 (NMC2, NCEPH, or CONDUIT work as name aliases)
> >
> > HDS is the standard output from NCEP (GFS|AVN, NAM|ETA, RUC, NGM, RUC2,
> > etc...)
> >
> > ..but again I suspect you desire the hi-res CONDUIT data.
> >
> > Yes, UNIWISC is the satellite imagery feed.
> >
> >
> > An allow ~should be in place for your machines:
> >
> > 1. texas-aqm.geosc.uh.edu
> > 2. usa-aqm.geosc.uh.edu
> >
> > on
> >
> > bigbird.tamu.edu
> >
> >
> > for UNIWISC and CONDUIT feeds.
> >
> > If you have questions regarding configuring your request to only get the
> > "eta" output, please send them to:
> >
> > address@hidden  (with CONDUIT) in subject line.
> >
> >
> > I am on travel and my responses from my personal account may be slow, but
> > support always has eyes on the inbox...
> >
> >
> > Cheers,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber                                    address@hidden        :
> > Unidata Program Center                        PH:303-497-8676        :
> > University Corp for Atmospheric Research      3300 Mitchell Ln       :
> > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> > ---------------------------------------------------------------------
> >
> > On Wed, 11 May 2005, Chang-Keun Song wrote:
> >
> > > Dear Jeff Weber:
> > >
> > > After I got the mail from you and Jay, I have reviewed the site,
> > > http://my.unidata.ucar.edu/content/software/ldm/ldm-current/basics/feedtypes/index.html
> > >
> > > However I cannot understand the meaning of the content of their table
> > > exactly.
> > > Is the primary name of 'HDS' related with ETA forecasting output ?
> > > Actually what data we want to ingest are 'NCEP ETA model outputs' as 
> > > inputs
> > > of MM5 simulations.
> > > Those outputs could be found in WEB as following.
> > > [For example of yesterday,]
> > > the address is
> > > ftp://tgftp.nws.noaa.gov/SL.us008001/ST.opnl/MT.fnl_CY.18/RD.20050510/PT.grid_DF.gr1/
> > > and the files are named as
> > > "fh.00HH_tl.press_gr.awip3d" [where HH:00,03,......,81,84].
> > >
> > > Also we want to get the realtime satellite image whose primary name might 
> > > be
> > > 'UNIWISC', I guess.
> > >
> > > I so appreciate if you would handle LDM access with above informations.
> > >
> > > Thank you in advance.
> > >
> > > Sincerely,
> > >
> > > Chang-Keun Song
> > > ----------------------------------------------------------------------------------------
> > > Chang-Keun Song, Ph.D, address@hidden
> > > Postdoctoral Fellow, IMAQS (Institute for Multidimensional Air Quality
> > > Studies)
> > > 223 Old Science Building, Dept. of Geosciences, University of Houston
> > > Houston, Texas 77204-5007
> > > Phone) 713-743-0742, Fax) 713-748-7906
> > >
> > > ----- Original Message -----
> > > From: "Jay Krishnan" <address@hidden>
> > > To: <address@hidden>; <address@hidden>
> > > Sent: Monday, May 09, 2005 4:56 PM
> > > Subject: Re: 20050509:UH IDD Connect
> > >
> > >
> > > > Dr. Song, Meongdo:
> > > >
> > > > Please review jeff's email below and let me know the data that we should
> > > > request access for
> > > >
> > > > thanks
> > > > -Jay
> > > >
> > > > =============================================
> > > > Jay Krishnan PH #: 713.743.1697
> > > > IT Manager Fax #: 713.748.7906
> > > > Geosciences University of Houston
> > > > =============================================
> > > >
> > > > On Mon, 9 May 2005, Jeff Weber wrote:
> > > >
> > > >> Hi Jay,
> > > >>
> > > >> Do you know what data you wish to ingest?
> > > >>
> > > >> Please see:
> > > >>
> > > >> http://my.unidata.ucar.edu/content/software/ldm/ldm-current/basics/feedtypes/index.html
> > > >>
> > > >> I suspect we will be feeding you from Texas A & M, but let's see what
> > > >> data
> > > >> you desire first..
> > > >>
> > > >> Cheers and welcome aboard!
> > > >>
> > > >> Jeff
> > > >> ---------------------------------------------------------------------
> > > >> Jeff Weber                                    address@hidden        :
> > > >> Unidata Program Center                        PH:303-497-8676        :
> > > >> University Corp for Atmospheric Research      3300 Mitchell Ln       :
> > > >> http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> > > >> ---------------------------------------------------------------------
> > > >>
> > > >> On Fri, 6 May 2005, Unidata Support wrote:
> > > >>
> > > >> >
> > > >> > ------- Forwarded Message
> > > >> >
> > > >> > >To: address@hidden
> > > >> > >cc: address@hidden,
> > > >> > >cc: address@hidden,
> > > >> > >cc: address@hidden
> > > >> > >From: Jay Krishnan <address@hidden>
> > > >> > >Organization: UCAR/Unidata
> > > >> > >Keywords: 200505061804.j46I4cP3005966
> > > >> >
> > > >> > Hi:
> > > >> >
> > > >> > I am writing to request LDM access for the following systems,
> > > >> >
> > > >> > 1. texas-aqm.geosc.uh.edu
> > > >> > 2. usa-aqm.geosc.uh.edu
> > > >> >
> > > >> > we are at the IMAQS (http://imaqs.uh.edu) Geosciences Department,
> > > >> > University of Houston. Could you please help us with what is required
> > > >> > from
> > > >> > our end to make the feed possible.
> > > >> >
> > > >> > thank you
> > > >> > -Jay
> > > >> >
> > > >> > =============================================
> > > >> > Jay Krishnan PH #: 713.743.1697
> > > >> > IT Manager Fax #: 713.748.7906
> > > >> > Geosciences University of Houston
> > > >> > =============================================
> > > >> >
> > > >> > --
> > > >> > ****************************************************************************
> > > >> > Unidata User Support                                    UCAR Unidata
> > > >> > (303)497-8643                                                  P.O. 
> > > >> > Box
> > > >> > address@hidden                                   Boulder, CO
> > > >> > ----------------------------------------------------------------------------
> > > >> > Unidata WWW Service
> > > >> > ----------------------------------------------------------------------------
> > > >> > NOTE: All email exchanges with Unidata User Support are recorded in 
> > > >> > the
> > > >> > Unidata inquiry tracking system and then made publicly available
> > > >> > through the web.  If you do not want to have your interactions made
> > > >> > available in this way, you must let us know in each email you send to
> > > >> > us.
> > > >> >
> > > >> > ------- End of Forwarded Message
> > > >> >
> > > >>
> > >
> >
>