Re: [ldm-users] Problems with ldm and new Super Res sites

  • To: Patrick Finnegan <vax@xxxxxxxxxx>
  • Subject: Re: [ldm-users] Problems with ldm and new Super Res sites
  • From: Gerry Creager <gerry.creager@xxxxxxxx>
  • Date: Sat, 05 Jul 2008 00:00:24 -0500
Patrick Finnegan wrote:
Hi all,

I seem to be having some problems downloading data via ldm from the new Super Res sites. Unfortunately, a person who has moved on set up our LDM infrastructure, and I don't have a very thorough understanding of all of the bits of it.

All of the "Super Res" sites are downloading their data, and either the files are not completely downloading, or are not properly getting renamed after they download... For example, an ls -ga of KABR's directory looks like this:

-rw-------   1 ldm      1266789 Jul  4 17:08 .KABR_20080704_2059
-rw-------   1 ldm      1266485 Jul  4 17:18 .KABR_20080704_2108
-rw-------   1 ldm      1266864 Jul  4 17:27 .KABR_20080704_2118
-rw-------   1 ldm      1262873 Jul  4 17:36 .KABR_20080704_2127
-rw-------   1 ldm      1262526 Jul  4 17:46 .KABR_20080704_2136
-rw-------   1 ldm      1260206 Jul  4 17:55 .KABR_20080704_2146

I tried upgrading ldm to the newest version (6.6.5), keeping the same configuration files as before, but it didn't help any.

Does anyone here have any idea what could be wrong, or what else I could look at?

SuperRes ("Build 10") changed a number of things, including the filenames.

I'm glad to look at your ldmd.conf and the appropriate pqact.conf files, having recently fought this battle and won.

In general, the pqact incantation looks something like this:
CRAFT ^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-9])
        FILE    data/gempak/nexrad/craft/\1/\1_\2_\3

In older incantations, we stored the 100-radial scans in an intermediate hidden file 'til the whole volume scan was completed, as indicated by a "/E" as the last character of a radial scan filename. The End-Of-Scan "E" is now embedded in the middel of the name, making its capture a little more interesting. What we do here, then, is to ignore it, and just expose the incomplete volume scan as it's filled.

To trigger image-making sprees based on a completed volume scan (using Gempak 5.11.1) we have 2 pqactions: one for BUILD 9 filenames and one for BUILD 10 filenames:

CRAFT ^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E$
        EXEC    scripts/\ \3/\4
CRAFT ^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E/
        EXEC    scripts/\ \3/\4

The regex substitution identifies the appropriate site, AND includes the RADTIM file designation.

Gerry Creager -- gerry.creager@xxxxxxxx
Texas Mesonet -- AATLT, Texas A&M University        
Cell: 979.229.5301 Office: 979.458.4020 FAX: 979.862.3983
Office: 1700 Research Parkway Ste 160, TAMU, College Station, TX 77843

  • 2008 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: