Re: gribdump modifications

• To: Clint Rowe <crowe@xxxxxxxxxxxxxx>
• Subject: Re: gribdump modifications
• From: Robb Kambic <rkambic@xxxxxxxxxxxxxxxx>
• Date: Tue, 22 Feb 2000 09:52:38 -0700 (MST)

Clint,

Thanks for the code mods/ideas.  At this time nobody has requested that

One comment, if you only want to capture headers of products not already
process in the pqact.conf, you can use  ^_ELSE_$ pattern    ie,

HRS     ^_ELSE_$    PIPE
        gribdump_new -b -o data/HDS_(\3:yyyy)(\3:mm)\3\4.log

After all your other HDS pqact entries.

Robb....


On Wed, 16 Feb 2000, Clint Rowe wrote:

Robb,

I don't know if anyone else would find it useful, but I had a need
to find out what GRIB products we were not saving/decoding.  I didn't

want to save the entire GRIB product, since that could consume quite a bit of disk space quickly. So I hit upon the idea of using gribdump.

It turned out to be easier than I expected, since gribdump already

read from stdin if no filename was given. All I had to do was put in an option for an output filename and change the printf's to fprintf's. Even though I'm not a C programmer, the structure you have in gribdump made both tasks easy. The only tricky thing I had to do was to keep it from writing the header before each message.

Here's the pqact.conf entry for capturing all GRIB headers into hourly
logs:

HRS     ^(......) (....) ([0-3][0-9])([0-2][0-9])(.*)
        PIPE    gribdump_new -b -o data/HDS_(\3:yyyy)(\3:mm)\3\4.log

It works okay, but there are two minor problems. First, I end up with a bunch of gribdump_new processes hanging around (i.e., they don't seem to time out properly). I haven't worried about this, as I'm running this as the only action on a separate machine than are normal ingester, so I only run it occasionally and for relatively short time periods. Second, I end up creating log files every hour, even though no GRIB products arrrive since any HRS product will kick off the process but non-GRIB products are

not processed by gribdump.  Again, this is a big problem since they're
zero-length files.

I've attached the modified file.  Feel free to use it any way you want.

Clint

===================================================================
Clinton M. Rowe

Associate Professor Meteorology/Climatology Program phone:(402)472-1946

Department of Geosciences                          fax:(402)472-4917
University of Nebraska-Lincoln                        crowe1@xxxxxxx

==============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
rkambic@xxxxxxxxxxxxxxxx                   WWW: http://www.unidata.ucar.edu/
==============================================================================