[awips2-users] ECMWF grib2 files from WMO Essential no longer being decoded properly by NAWIPS or AWIPS

  • To: "awips2-users@xxxxxxxxxxxxxxxx" <awips2-users@xxxxxxxxxxxxxxxx>
  • Subject: [awips2-users] ECMWF grib2 files from WMO Essential no longer being decoded properly by NAWIPS or AWIPS
  • From: "Manousos, Peter C" <pmanousos@xxxxxxxxxxxxxxxxxxx>
  • Date: Thu, 29 Jun 2023 17:29:03 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=firstenergycorp.com; dmarc=pass action=none header.from=firstenergycorp.com; dkim=pass header.d=firstenergycorp.com; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=kmS12s7J2E+KHIUpCNwEYB/W8O18aUhkoRehNEWBy50=; b=nfeWaBKm3uB6f24S7qhfgZ4A8t4g2cG44j8JYzIIa6rDimlxOplfmQHO94wVypI2a99gQAbdiy6iI8v7xDzuNzB7Mjli6FfsJCpJV/2/i+PSiDN+Nu2yzv63FbMfE1nLoVt1LTqK1sJXXOVK9pJ2kurn/ngRu4NkVQYW0hc9Xr0AyqdaNLIzY7G2JF0RLXeHk3dhwcWsi+mFvk4WtamegzHdf0+GxraQJgbqrUVotOAWnMB/q85CqNB0x2QEbbX9ehPC+YOfCXkd62WRmmOvuANGxrQg7jcVa7N2sU3v09eqyJum7Hzb8cpRi+OyTLLmrhO7ShpO+4j0cUNvxzHiIQ==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oSJMbaNG3VPa/z6AVb7rdI43ub62GXFqX/D0J5flPO8hcAtpoLY3YJq9kFSM2rAqeqOf8jO9LsAmfB2gInOcBvYkOE325kg3m/T95LbJieMkskezhi8MqglhlV1sIzT1wF51mWeGKrOZCe2QmrlW+QzTe5vV48+v+RC6hjaasKvePsWHt04IxOphPwdFlfGu7EtLRnPCew7Sb5LR9CfA/n0yAvdVTdk6GOr9h81Y0Kcvd3gqPlrn/tLjgYpxBjfYFjaXGGKBDjAvXoKNkXE2tRZMRMKlzXfqkUXkU3e/rpnM/kARnI/XJtJffvwVw3m9ldxIO8lMeIKINiyzNJ8xhw==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=firstenergycorp.com;
(apologies if you are both on the GEMBUD and AWIPS email lists as this will be 
a duplicate...)


Greetings.  As of 06 28 2023 12z it seems the ECMWF's freely available WMO 
Essential grib2 data has changed 
(here<https://data.ecmwf.int/forecasts/20230628/12z/0p4-beta/oper/>).   It is 
no longer fully processable by dcgrib2 or AWIPS EDEX

We did not see any change notice on ECMWF web site or Google and were wondering 
if anyone else is experiencing the following (attached is a one-field <500 mb 
HGT> grib2 file), and if you did would you happen to know the cause and any 
workarounds?

wgrib2 -v -V test.grb2  shows what looks like a viable grib2 file

1:0:vt=2023062803:500 mb:3 hour fcst:HGT Geopotential Height [gpm]:
    ndata=405900:undef=0:mean=5562.91:min=4689.51:max=5955.01
    grid_template=0:winds(N/S):
      lat-lon grid:(900 x 451) units 1e-06 input WE:NS output WE:SN res 48
      lat 90.000000 to -90.000000 by 0.400000
      lon 180.000000 to 179.600000 by 0.400000 #points=405900
      basic_ang=0 sub_angle=1000000 units=0.000001
      unscaled lat=90000000 to -90000000 lon=180000000 to 179600000

As additional info a wgrib2 -v -V on a grib2 file previous to June 28 shows the 
same thing as above.

Submitting to EDEX shows the following error (at the end in bold with preceding 
traceback messages)

ERROR 2023-06-28 19:02:42,848 4308 [Ingest.GribDecode-6] grib: EDEX - Error 
processing file [/awips2/data_store/manual/grib/20230628/19/test.grb2]:
Traceback (most recent call last):
  File 
"/awips2/edex/lib/plugins/com.raytheon.edex.plugin.grib.jar/GribDecoder.py", 
line 184, in decode
    gribDictList = grib2.decode(gribFile, self.startPosition, 
self.messageLength)
error: Failed to get grib field.


If you have NAWIPS...

NAWIPS 7.14.0.1   dcgrib2 -d temp.log -v 100 test.grd < test.grb2  gives the 
following error (in bold)

[27248] 230628/1520[DCINIT 3] Version 7.14.0.1
[27248] 230628/1520[DC 2]  read 102399/102399 bytes strt 0 newstrt 102399
[27248] 230628/1520[DC 2]  read 1/1 bytes strt 102399 newstrt 102400
[27248] 230628/1520[DC 2]  read 83204/102397 bytes strt 0 newstrt 83204
[27248] 230628/1520[CED_GNUM -1] No GID KXKY [900 451] LL [90.000000 
180.000000] UR [-90.000000 179.600006]
[27248] 230628/1520[CED_GNUM -1] No GID KXKY [900 451] LL [90.000000 
180.000000] UR [-90.000000 179.600006]
[27248] 230628/1520[DC 2]  read 0/19196 bytes strt 83204 newstrt 83204
[27248] 230628/1520[DCGRIB -9] End of Data
[27248] 230628/1520[DC 5]  Normal termination.
[27248] 230628/1520[DC 2]  Number of bulletins read and processed: 1
[27248] 230628/1520[DC 6]  Shutting down.

And nagrib2 also gives an error (in bold)

getdrstemplate: DRS Template 5.42 not defined.
[NAGRIB2 -25]  Error unpacking GRIB2 metadata
         0 GRIB messages were read or scanned from the GRIB file:
                                                                   test.grb2
         0 grids were written to the GEMPAK file:
                                                                    test.grd
Parameters requested: GBFILE,GDOUTF,PROJ,GRDAREA,KXKY,MAXGRD,CPYFIL,GAREA,
OUTPUT,G2TBLS,G2DIAG,OVERWR,PDSEXT.



------------------------------------------------------------------------------

The information contained in this message is intended only for the personal and 
confidential use of the recipient(s) named above. If the reader of this message 
is not the intended recipient or an agent responsible for delivering it to the 
intended recipient, you are hereby notified that you have received this 
document in error and that any review, dissemination, distribution, or copying 
of this message is strictly prohibited. If you have received this communication 
in error, please notify us immediately, and delete the original message.

Attachment: test.grb2
Description: test.grb2

  • 2023 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the awips2-users archives: