[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

20050303: 20050303: using dcgrib2 with eta 218 tiles



James,

I'm decoding the ETA218 right off the dvb-s NOAAPORT feed
as well as the other grib2 data (DGEX, and GFS .5 degree).
The problem could be the old version you are using since
NWS has changed the JPEG2000 DRT number since then, and
I've made many improvements to the compression since.

I'll be tarring up 5.8.1 soon, but can send you a current copy
of dcgrib2 witch uses the latest NWS g2clib-1.0.2 if needed.

Steve Chiswell
Unidata User Support



>From: "James Notchey" <address@hidden>
>Organization: DOC/NOAA/NWS - National Weather Service
>Keywords: 200503031815.j23IFFv2002356

>
>--------------4408E520FEB31FC451FDE20A
>Content-Type: text/plain; charset=us-ascii
>Content-Transfer-Encoding: 7bit
>
>   Steve
>
>   Ideally I would like to use the 12km eta that comes in grib2 format right
>off the  awips SBN, however dcgrib2 seems to have trouble with those files.
>here is the output  I get when I run the following command:
>
>dcgrib2 test.grd < /data/modeldata/tmpGrib2/MHBL65KWBE.20041102_185851.672
>
>where  MHBL65KWBE.20041102_185851.672 is a grib2 file that comes off the awips
>SBN.
>
>g2_info: '7777'  not found at end of GRIB message.
>warning: trailing garbage in marker segment (3 bytes)
>invalid tile number in SOT marker segment
> jpc_decode zero return
>
>The dcgrib2.log has the following:
>[25244] 050303/1805 [DC 3]  Starting up. Version 5.7.2p2
>[25244] 050303/1805 [DCGRIB -50] bulletin too long 57847 > 57630
>[25244] 050303/1805 [DC 5]  Normal termination.
>[25244] 050303/1805 [DC 2]  Number of bulletins read and processed: 1
>[25244] 050303/1805 [DC 6]  Shutting down.
>
>Dcgrib2 creates a file but it doesn't appear to be usable as
>gdinfo gives the following:
>
>gdinfo
> GDFILE    Grid file                         test.grd
> LSTALL    Full list flag                    yes
> OUTPUT    Output device/filename            T
> GDATTIM   Grid date/time                    all
> GLEVEL    Grid level                        all
> GVCORD    Grid vertical coordinate          all
> GFUNC     Scalar grid
> Parameters requested: GDFILE,LSTALL,OUTPUT,GDATTIM,GLEVEL,GVCORD,GFUNC.
> GEMPAK-GDINFO>r
>
> GRID FILE: test.grd
>
> GRID NAVIGATION:
>     PROJECTION:          LCC
>     ANGLES:                12.2     0.0     0.0
>     GRID SIZE:            0   0
>     LL CORNER:               0.00      0.00
>     UR CORNER:               0.00      0.00
>
> GRID ANALYSIS BLOCK:
>      UNKNOWN ANALYSIS TYPE
>
> Number of grids in file:     0
>
> Maximum number of grids in file:   5000
>
> [GDU 2]  Did not find any matching grids.
>
>I have view the eta grib2 file using khexedit and it looks like there is the 7
> 777
>at the end of the file
>so I am very confused.
>
>Any help would be appreciated.  I can attach the grib2 and test.grd file if yo
> u
>would like.
>
> Thanks a bunch
>   Jim
>
>
>Unidata Support wrote:
>
>> James,
>>
>> The ETA218 grids from NOAAPORT NWSTG2 in grib2 format are whole,
>> as are the grids on the NWS ftp server under the
>> SL.us008001/ST.opnt directory. These are handled with no
>> trouble. If you have to stich several tiles, would
>> it be better to utilize the grib2 compressed (JPEG2000) data?
>>
>> In general, grids can be stiched together as we do with WAFS thinned
>> grids, ECMWF tiles etc.using the $GEMTBL/grid/dcgrib.tbl file to define
>> offsets for the tiles- however all those grids in the broadcast stream
>> use different grid numbers to identify the tile location Eg, the WAFS grids
>> are grid id 37-44, where the decoder can lookup the location of
>> those tiles in the larger grid. I've looked at the 221 tiles, but not
>> 218 tiles, so would need a reference to explore that option.
>>
>> Steve Chiswell
>> Unidata User Support
>>
>> >From: "James Notchey" <address@hidden>
>> >Organization: DOC/NOAA/NWS - National Weather Service
>> >Keywords: 200503031458.j23EwUv2005475
>>
>> >
>> >    Can someone tell me if its possible, and if so, how to use the
>> >dcgrib2 decoder with
>> >the eta 218 tiles.  I would like to take several of the tiles and make 1
>> >grid file.
>> >
>> >   Any help would be appreciated.
>> >   Thanks
>> >   Jim Notchey
>> >
>> >
>> --
>> ****************************************************************************
>> Unidata User Support                                    UCAR Unidata Program
>> (303)497-8643                                                  P.O. Box 3000
>> address@hidden                                   Boulder, CO 80307
>> ----------------------------------------------------------------------------
>> Unidata WWW Service              http://my.unidata.ucar.edu/content/support 
>> ----------------------------------------------------------------------------
>> NOTE: All email exchanges with Unidata User Support are recorded in the
>> Unidata inquiry tracking system and then made publicly available
>> through the web.  If you do not want to have your interactions made
>> available in this way, you must let us know in each email you send to us.
>
>--------------4408E520FEB31FC451FDE20A
>Content-Type: text/html; charset=us-ascii
>Content-Transfer-Encoding: 7bit
>
><!doctype html public "-//w3c//dtd html 4.0 transitional//en">
><html>
>&nbsp;&nbsp; Steve
><p>&nbsp;&nbsp; Ideally I would like to use the 12km eta that comes in
>grib2 format right
><br>off the&nbsp; awips SBN, however dcgrib2 seems to have trouble with
>those files.
><br>here is the output&nbsp; I get when I run the following command:
><p>dcgrib2 test.grd &lt; /data/modeldata/tmpGrib2/MHBL65KWBE.20041102_185851.6
> 72
><p>where&nbsp; MHBL65KWBE.20041102_185851.672 is a grib2 file that comes
>off the awips SBN.
><p><font color="#FF0000">g2_info: '7777'&nbsp; not found at end of GRIB
>message.</font>
><br><font color="#FF0000">warning: trailing garbage in marker segment (3
>bytes)</font>
><br><font color="#FF0000">invalid tile number in SOT marker segment</font>
><br><font color="#FF0000">&nbsp;jpc_decode zero return</font>
><p>The dcgrib2.log has the following:
><br>[<font color="#FF0000">25244] 050303/1805 [DC 3]&nbsp; Starting up.
>Version 5.7.2p2</font>
><br><font color="#FF0000">[25244] 050303/1805 [DCGRIB -50] bulletin too
>long 57847 > 57630</font>
><br><font color="#FF0000">[25244] 050303/1805 [DC 5]&nbsp; Normal termination.
> </font>
><br><font color="#FF0000">[25244] 050303/1805 [DC 2]&nbsp; Number of bulletins
>read and processed: 1</font>
><br><font color="#FF0000">[25244] 050303/1805 [DC 6]&nbsp; Shutting down.</fon
> t><font color="#FF0000"></font>
><p><font color="#000000">Dcgrib2 creates a file but it doesn't appear to
>be usable as</font>
><br><font color="#000000">gdinfo gives the following:</font>
><p><font color="#FF0000">gdinfo</font>
><br><font color="#FF0000">&nbsp;GDFILE&nbsp;&nbsp;&nbsp; Grid file&nbsp;&nbsp;
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>test.grd</font>
><br><font color="#FF0000">&nbsp;LSTALL&nbsp;&nbsp;&nbsp; Full list flag&nbsp;&
> nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>yes</font>
><br><font color="#FF0000">&nbsp;OUTPUT&nbsp;&nbsp;&nbsp; Output device/filenam
> e&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>T</font>
><br><font color="#FF0000">&nbsp;GDATTIM&nbsp;&nbsp; Grid date/time&nbsp;&nbsp;
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;
>all</font>
><br><font color="#FF0000">&nbsp;GLEVEL&nbsp;&nbsp;&nbsp; Grid level&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs
> p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>all</font>
><br><font color="#FF0000">&nbsp;GVCORD&nbsp;&nbsp;&nbsp; Grid vertical
>coordinate&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; all</font>
><br><font color="#FF0000">&nbsp;GFUNC&nbsp;&nbsp;&nbsp;&nbsp; Scalar grid</fon
> t>
><br><font color="#FF0000">&nbsp;Parameters requested: GDFILE,LSTALL,OUTPUT,GDA
> TTIM,GLEVEL,GVCORD,GFUNC.</font>
><br><font color="#FF0000">&nbsp;GEMPAK-GDINFO>r</font><font color="#FF0000"></
> font>
><p><font color="#FF0000">&nbsp;GRID FILE: test.grd</font><font color="#FF0000"
> ></font>
><p><font color="#FF0000">&nbsp;GRID NAVIGATION:</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp; PROJECTION:&nbsp;&nbsp;&nbs
> p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>LCC</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp; ANGLES:&nbsp;&nbsp;&nbsp;&n
> bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>12.2&nbsp;&nbsp;&nbsp;&nbsp; 0.0&nbsp;&nbsp;&nbsp;&nbsp; 0.0</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp; GRID SIZE:&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>0&nbsp;&nbsp; 0</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp; LL CORNER:&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>0.00&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.00</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp; UR CORNER:&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>0.00&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.00</font><font color="#FF0000"></font>
><p><font color="#FF0000">&nbsp;GRID ANALYSIS BLOCK:</font>
><br><font color="#FF0000">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; UNKNOWN ANALYSIS
>TYPE</font><font color="#FF0000"></font>
><p><font color="#FF0000">&nbsp;Number of grids in file:&nbsp;&nbsp;&nbsp;&nbsp
> ;
>0</font><font color="#FF0000"></font>
><p><font color="#FF0000">&nbsp;Maximum number of grids in file:&nbsp;&nbsp;
>5000</font><font color="#FF0000"></font>
><p><font color="#FF0000">&nbsp;[GDU 2]&nbsp; Did not find any matching
>grids.</font>
><p>I have view the eta grib2 file using khexedit and it looks like there
>is the 7777 at the end of the file
><br>so I am very confused.
><p>Any help would be appreciated.&nbsp; I can attach the grib2 and test.grd
>file if you would like.
><p>&nbsp;Thanks a bunch
><br>&nbsp;&nbsp; Jim
><br>&nbsp;
><p>Unidata Support wrote:
><blockquote TYPE=CITE>James,
><p>The ETA218 grids from NOAAPORT NWSTG2 in grib2 format are whole,
><br>as are the grids on the NWS ftp server under the
><br>SL.us008001/ST.opnt directory. These are handled with no
><br>trouble. If you have to stich several tiles, would
><br>it be better to utilize the grib2 compressed (JPEG2000) data?
><p>In general, grids can be stiched together as we do with WAFS thinned
><br>grids, ECMWF tiles etc.using the $GEMTBL/grid/dcgrib.tbl file to define
><br>offsets for the tiles- however all those grids in the broadcast stream
><br>use different grid numbers to identify the tile location Eg, the WAFS
>grids
><br>are grid id 37-44, where the decoder can lookup the location of
><br>those tiles in the larger grid. I've looked at the 221 tiles, but not
><br>218 tiles, so would need a reference to explore that option.
><p>Steve Chiswell
><br>Unidata User Support
><p>>From: "James Notchey" &lt;address@hidden>
><br>>Organization: DOC/NOAA/NWS - National Weather Service
><br>>Keywords: 200503031458.j23EwUv2005475
><p>>
><br>>&nbsp;&nbsp;&nbsp; Can someone tell me if its possible, and if so,
>how to use the
><br>>dcgrib2 decoder with
><br>>the eta 218 tiles.&nbsp; I would like to take several of the tiles
>and make 1
><br>>grid file.
><br>>
><br>>&nbsp;&nbsp; Any help would be appreciated.
><br>>&nbsp;&nbsp; Thanks
><br>>&nbsp;&nbsp; Jim Notchey
><br>>
><br>>
><br>--
><br>**************************************************************************
> **
>&lt;
><br>Unidata User Support&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs
> p;
>UCAR Unidata Program &lt;
><br>(303)497-8643&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&
> nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
> ;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs
> p;
>P.O. Box 3000 &lt;
><br>address@hidden&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n
> bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&
> nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>Boulder, CO 80307 &lt;
><br>--------------------------------------------------------------------------
> --
>&lt;
><br>Unidata WWW Service&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&
> nbsp;&nbsp;&nbsp;&nbsp;
><a href="http://my.unidata.ucar.edu/content/support";>http://my.unidata.ucar.ed
> u/content/support</a>&nbsp;
>&lt;
><br>--------------------------------------------------------------------------
> --
>&lt;
><br>NOTE: All email exchanges with Unidata User Support are recorded in
>the
><br>Unidata inquiry tracking system and then made publicly available
><br>through the web.&nbsp; If you do not want to have your interactions
>made
><br>available in this way, you must let us know in each email you send
>to us.</blockquote>
></html>
>
>--------------4408E520FEB31FC451FDE20A--
>
--
NOTE: All email exchanges with Unidata User Support are recorded in the
Unidata inquiry tracking system and then made publicly available
through the web.  If you do not want to have your interactions made
available in this way, you must let us know in each email you send to us.