[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

19990506: LDM - dcgrib errors with ETA data



Michael,
You can use pqing to ingest your MRF file into your LDM queue.
Use pqing -f HRS to tell the server that the data feed will be HRS
data.

The pqact.conf entry for mrf extended looks ok, and we are receiving it
here using the same pattern. As long as you did the "make clean" step
in the dcgrib directory before building the decoder, the table of
projections should be correct, which would be the only cause I could think
of for not decoding.

The MRF finished at ~3:30 AM this morning here so as long as you had the
recompiled decoder in place at that time, then that shouldn't be the problem.

Since you can manually decoder the data, it sounds like the decoder is working 
properly- but you can test the pqact pattern with pqing as mentioned
above. 

Let me know what you find out from reingesting...

Steve chiswell


>From: Michael Voss <address@hidden>
>Organization: .
>Keywords: 199905111749.LAA13340

>Steve,
>
>update on my problem:
>
>I installed the new dcgrib program and this has cured my Eta problem. However,
>  I am still not getting the MRF extended. I dowloaded a raw MRF file from Dev
> in at UCLA and was able to manually run dcgrib on it, so I know that works.
>
>Here is the error in pqact that corresponds to my missing MRF:
>--------------------
>May 11 08:25:31 vortex dcgrib[18842]: oversize GRIB product
>May 11 08:25:36 vortex last message repeated 2 times
>-------------------------
>Here is my pqact entry:
>----------------
>HDS     ^H.[EF][A-Z][0-9][0-9] KWB. ([0-3][0-9])([0-2][0-9])..
>        PIPE    /usr/local/gempak/bin/sol/dcgrib -v
>        -g /usr/local/gempak/gempak5.4/tables
>        PACK /usr/local/gempak/gempak5.4/data/grids/YYMMDDHH_mrf.gem
>----------------------------
>Do you have any idea what might be causing this error?
>
>Also, is there a way for me to have my LDM re-read the raw MRF file in such a 
> way as to check if pqact recognizes it properly?
>Thanks,
>
>Mike
>
>At 02:40 PM 5/10/99 -0600, you wrote:
>>
>>Michael,
>>
>>Devin's problems were for something else- in particular for
>>projections such as mrf grid #201 that had been defined in
>>patches that they did not download. 
>>
>>The grid #211 projection has always been supported, so if
>>you are having trouble with the ETA on grid Q, you should
>>send me a copy of your pqact.conf entries. From your
>>error messges before, the #207 alaskan grids were being 
>>sent to the decoder which signifies that the pattern was not
>>restricting the grids to only Q.
>>
>>You can always download gempak updates from the gbuddy account
>>using the password XXXXXX, host ftp.unidata.ucar.edu.
>>You will find the lastest dcgrib code in:
>>~gbuddy/nawips-5.4/patches/dcgrib*tar.Z.
>>
>>To install the dcgrib code:
>>
>>download the tarfile to your $NAWIPS directory and unpack with
>>zcat dcgrib.tar.Z | tar xvf -
>>
>>The build dcgrib with:
>>cd $NAWIPS/unidata/ldmbridge/dcgrib
>>make clean
>>make all
>>make install
>>make clean
>>
>>Steve CHiswell
>>Unidata User SUpport
>>
>>
>>>From: Michael Voss <address@hidden>
>>>Organization: .
>>>Keywords: 199905101938.NAA11925
>>
>>>I'm still unable to get any ETA or MRF. Devin at UCLA confirms he is sending
>  m
>>> e the data, he said he had this same problem I'm having. His solution was t
> o 
>>> get the latest dcgrib program. Could I get the gempak username and password
>  s
>>> o I can download the latest source files? I am the site contact for SJSU.
>>>Thanks!
>>>Mike
>>>
>>>At 09:28 AM 5/6/99 -0600, you wrote:
>>>>
>>>>Michale,
>>>>
>>>>ETA, NGM, MRF, AVN are available on several projections. The common
>>>>CONUS projection is called the #211 grid. When a gempak file is created,
>>>>the projection of the first grid is used to create the file. If another gri
> d
>>>>comes alon and doesn't match the projection, you get the message below.
>>>>
>>>>In this case, grid #207 is an alaskan sector. When we went to NOAAport
>>>>for our data, you started getting a lot more projections. You will see
>>>>that gdinfo will list the projection information of the file. 
>>>>You'll also notice in your logs below, the 3rd letter is the grid projectio
> n
>>>>and there are several different projections.
>>>>You can specify the projection you want by making your pqact.conf pattern a
>  
>>>>little tighter.
>>>>
>>>>For ETA and NGM, you probably want CONUS #211, which is grid Q and the patt
> er
>>> n
>>>>HDS ^[YZ].Q.*/mETA
>>>>HDS ^[YZ].Q.*/mNGM
>>>>
>>>>Attatched below  is a pqact.conf example which tells which projections for 
> ea
>>> ch model
>>>>are represented by that 3rd letter in the WMO identifier.
>>>>
>>>>Steve Chiswell
>>>>Unidata User Support
>>>>
>>>>
>>>># NMC GRIB products
>>>>#
>>>>#
>>>># NOAAport ETA grids
>>>># Grid #211 80km CONUS:    ^[YZ].Q.*/mETA
>>>># Grid #212 40km CONUS:    ^[YZ].R.*/mETA
>>>># Grid #215 20km CONUS:    ^[YZ].U.*/mETA
>>>># Grid #214 47.5km Alaska: ^[YZ].T.*/mETA
>>>># Select any/all grids desired from [QRUT]
>>>>HRS     ^[YZ].[Q].*/mETA
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -v -d data/gempak/logs/dcgri
> b.
>>> log
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_eta_grid@@@.gem
>>>>#
>>>># NOAAport MRF grids
>>>># Grid #201 N. Hemisphere 381km: ^Y.A... KWBH
>>>># Grid #202 CONUS         190km: ^Y.I... KWBH
>>>># Grid #203 Alaska        190km: ^Y.J... KWBH
>>>># Grid #204 Hawaii        160km: ^Y.K... KWBH
>>>># Grid #205 Puerto Rico   190km: ^Y.L... KWBH
>>>># Select any/all grids desired from [AIJKL]
>>>>HRS     ^Y.[AIJKL]... KWBH
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -d data/gempak/logs/dcgrib.l
> og
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_mrf_grid@@@.gem
>>>>#
>>>>#
>>>># RUC/MAPS model output
>>>># Grid #211 CONUS   80km: ^[YZ].Q.*/mRUC
>>>># Currently, only grid #211
>>>>HRS     ^[YZ].[Q].*/mRUC
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -v -d data/gempak/logs/dcgri
> b.
>>> log
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_ruc_grid@@@.gem
>>>>#
>>>># NGM model output
>>>># Grid #211 CONUS   80km: ^[YZ].Q.*/mNGM
>>>># Grid #207 Alaska  95km: ^[YZ].N.*/mNGM
>>>># Grid #202 CONUS  190km: ^[YZ].I.*/mNGM
>>>># Grid #213 CONUS 47.5km: ^[YZ].H.*/mNGM
>>>># Select any/all grids desired from [QNIH]
>>>>HRS     ^[YZ].[QNIH].*/mNGM
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -d data/gempak/logs/dcgrib.l
> og
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_ngm_grid@@@.gem
>>>>#
>>>># AVN model output
>>>># Grid #201 N. Hemisphere 381km: ^Y.A... KWBC.*(/mAVN|/mSSIAVN)
>>>># Grid #202 CONUS         190km: ^Y.I... KWBC.*(/mAVN|/mSSIAVN)
>>>># Grid #203 Alaska        190km: ^Y.J... KWBC.*(/mAVN|/mSSIAVN)
>>>># Grid #211 CONUS          80km: ^Y.Q... KWBC.*(/mAVN|/mSSIAVN)
>>>># Grid #213 CONUS          95km: ^Y.H... KWBC.*(/mAVN|/mSSIAVN)
>>>># Select any/all grids desired from [QAIJH]
>>>>HRS     ^[YZ].[QAIJH]... KWB. ([0-3][0-9])([0-2][0-9]).*(/mAVN|/mSSIAVN)
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -d data/gempak/logs/dcgrib.l
> og
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_avn_grid@@@.gem
>>>>#
>>>># Global AVN (Spectral) Thinned grids
>>>># Grid octets I-P will be stitched togethir as a single global grid
>>>>#
>>>>HRS     ^H.[I-P]... KWB. ([0-3][0-9])([0-2][0-9]).*
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -d data/gempak/logs/dcgrib.l
> og
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                -q"lin,dlat=2.5,dlon=2.5"
>>>>                PACK data/gempak/hds/YYYYMMDDHH_thin.gem
>>>>#
>>>>#  MRF grids - Extended range grids E and F
>>>>#
>>>>HRS     ^H.[EF][A-Z][0-9][0-9] KWB. ([0-3][0-9])([0-2][0-9])..
>>>>        PIPE    /usr/local/ldm/decoders/dcgrib -d data/gempak/logs/dcgrib.l
> og
>>>>                -g /home/gempak/NAWIPS-5.4/gempak5.4/tables
>>>>                PACK data/gempak/hds/YYYYMMDDHH_mrf.gem
>>>>#
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>>From: Michael Voss <address@hidden>
>>>>>Organization: .
>>>>>Keywords: 199905052241.QAA09196
>>>>
>>>>>Hello,
>>>>>I'm running LDM and generating Gempak files with 'dcgrib' out of the pqact
> .c
>>> on
>>>>> f file. This has worked fine for awhile, but recently I have had problems
>  w
>>> it
>>>>> h the gridded ETA model data (NGM, MRF, etc come in fine). I have made no
>  c
>>> ha
>>>>> nges to pqact.conf for months.
>>>>>
>>>>>The following shows a snippet from our ldmd.log:
>>>>>
>>>>>May 05 15:02:02 vortex dcgrib[2895]: YUQD45 KWBF 051200 OK
>>>>>May 05 15:02:03 vortex dcgrib[2895]:  Invalid center id/grid id combinatio
> n:
>>>   
>>>>> 7  207  0  28  23
>>>>>May 05 15:02:03 vortex dcgrib[2895]: YUND45 KWBF 051200 skipped
>>>>>May 05 15:02:03 vortex dcgrib[2895]:  Invalid center id/grid id combinatio
> n:
>>>   
>>>>> 7  202  0  28  23
>>>>>May 05 15:02:03 vortex dcgrib[2895]: YUID40 KWBF 051200 skipped
>>>>>May 05 15:02:03 vortex dcgrib[2895]: YUQD40 KWBF 051200 OK
>>>>>May 05 15:02:03 vortex dcgrib[2895]:  Invalid center id/grid id combinatio
> n:
>>>   
>>>>> 7  207  0  28  23
>>>>>May 05 15:02:03 vortex dcgrib[2895]: YUND40 KWBF 051200 skipped
>>>>>May 05 15:02:03 vortex dcgrib[2895]:  Invalid center id/grid id combinatio
> n:
>>>   
>>>>> 7  202  0  28  23
>>>>>May 05 15:02:03 vortex dcgrib[2895]: YUID35 KWBF 051200 skipped
>>>>>
>>>>>Here is my pqact.conf entry:
>>>>>
>>>>>        PIPE    /usr/local/gempak/bin/sol/dcgrib -v
>>>>>        -g /usr/local/gempak/gempak5.4/tables
>>>>>        PACK /usr/local/gempak/gempak5.4/data/grids/(\1:yy)(\1:mm)\1\2_eta
> .g
>>> em
>>>>>
>>>>>Might there be a simple explanation for this? 
>>>>>
>>>>>Thanks,
>>>>>Mike
>>>>>
>>>>>
>>>>>
>>>>>--------------------------------------------------------------
>>>>>Michael Voss                             address@hidden
>>>>>Department of Meteorology                   www.innetix.com/~voss
>>>>>San Jose State University                        (408)924-5204
>>>>>One Washington Square                          fax (408)924-5191        
>>>>>San Jose, CA 95192-0104                
>>>>>--------------------------------------------------------------
>>>>>
>>>>
>>>>***************************************************************************
> * 
>>>>Unidata User Support                                    UCAR Unidata Progra
> m 
>>>>(303)497-8644                                                  P.O. Box 300
> 0 
>>>>address@hidden                                   Boulder, CO 8030
> 7 
>>>>---------------------------------------------------------------------------
> - 
>>>>Unidata WWW Service                        http://www.unidata.ucar.edu/    
>   
>>>>***************************************************************************
> * 
>>>>
>>>>
>>>--------------------------------------------------------------
>>>Michael Voss                             address@hidden
>>>Department of Meteorology             www.innetix.com/~voss
>>>San Jose State University                        (408)924-5204
>>>One Washington Square                            fax (408)924-5191        
>>>San Jose, CA 95192-0104                
>>>--------------------------------------------------------------
>>>
>>
>>**************************************************************************** 
>>Unidata User Support                                    UCAR Unidata Program 
>>(303)497-8644                                                  P.O. Box 3000 
>>address@hidden                                   Boulder, CO 80307 
>>---------------------------------------------------------------------------- 
>>Unidata WWW Service                        http://www.unidata.ucar.edu/      
>>**************************************************************************** 
>>
>>
>--------------------------------------------------------------
>Michael Voss                             address@hidden
>Department of Meteorology               www.innetix.com/~voss
>San Jose State University                        (408)924-5204
>One Washington Square                              fax (408)924-5191        
>San Jose, CA 95192-0104                
>--------------------------------------------------------------
>