[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #JXN-827520]: pact metar2nc failure



Hi Terri,

Before diving into the extensive info you provided below (very nice, by the 
way),
I have one question:

- what is the <datadir-path></datadir-path> setting for pqact in your 
~ldm/etc/registry.xml
  file?

  If it is _not_ /home/ldm, then your problem is being caused by the current
  working directory for 'pqact' not being /home/ldm, and when this is the
  case, the pattern-action file reference to the decoder, 'util/metar2nc'
  will not be correct.  This can be "fixed" in either of two ways:

  - change the <datadir-path></datadir-path> setting in ~ldm/etc/registry.xml
    to /home/ldm

    NB: this could well have some unexpected consequences depending on your
    LDM installation

  - change the relative reference to the decoders to absolute references

    For instance, change all occurrences of 'util/metar2nc' to 
'/home/ldm/util/metar2nc'
    in your pattern-action file(s) (actually, change all relative references
    to absolute ones in all pattern-action files)

If you opt for the 2nd way above, you should be able to simply send a
HUP signal to all 'pqact' instances telling them to reread their pattern-action
files:

-- make the changes from relative to absolute reference of decoders
ldmadmin pqactcheck
ldmadmin pqactHUP

Cheers,

Tom

> My environment is:
> 
> Linux energy02 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u6 
> (2015-11-09) x86_64 GNU/Linux
> debian_version 8.3 (jessie)
> 
> LDM version 6.12.14
> 
> *****
> I am getting the following errors constantly in my /var/log/syslog file.
> 
> Mar 16 20:23:55 energy02 pqact[119690] ERROR: Child 131879 exited with status 
> 1
> Mar 16 20:23:55 energy02 pqact[119690] ERROR: Deleting failed PIPE entry: 
> pid=131879, cmd="util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar 
> etc/metar.cdlâ
> 
> and
> 
> Mar 16 20:25:16 energy02 pqact[132356] ERROR: No such file or directory
> Mar 16 20:25:16 energy02 pqact[132356] ERROR: [filel.c:1552] Couldn't execute 
> decoder "util/metar2nc"
> Mar 16 20:25:16 energy02 pqact[132356] NOTE: Exiting
> 
> The process id must be a child process in the second batch of errors.
> 
> The pqact.conf entry is:
> 
> WMO     ^S[AP].* .... ([0-3][0-9])([0-2][0-9][0-5][0-9])        PIPE    
> util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar etc/metar.cdl
> 
> The raw files exist:
> 
> # ls -al /home/ldm/data/raw_data/obs/metar
> total 24
> drwxr-xr-x 6 ldm dicast 4096 Mar 16 00:15 .
> drwxr-xr-x 4 ldm dicast 4096 Feb  3 22:05 ..
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 00:15 20160313
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:15 20160314
> drwxr-xr-x 2 ldm dicast 4096 Mar 15 23:00 20160315
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:00 20160316
> 
> # ls -al /home/ldm/data/raw_data/obs/metar/20160316
> total 26444
> drwxr-xr-x 2 ldm dicast    4096 Mar 16 20:00 .
> drwxr-xr-x 6 ldm dicast    4096 Mar 16 00:15 ..
> -rw-r--r-- 1 ldm dicast 1265708 Mar 16 00:59 metar.20160316.0000.asc
> -rw-r--r-- 1 ldm dicast 1223156 Mar 16 01:59 metar.20160316.0100.asc
> -rw-r--r-- 1 ldm dicast 1244933 Mar 16 02:59 metar.20160316.0200.asc
> -rw-r--r-- 1 ldm dicast 1274306 Mar 16 03:59 metar.20160316.0300.asc
> -rw-r--r-- 1 ldm dicast 1295598 Mar 16 04:59 metar.20160316.0400.asc
> -rw-r--r-- 1 ldm dicast 1328534 Mar 16 05:59 metar.20160316.0500.asc
> -rw-r--r-- 1 ldm dicast 1361447 Mar 16 06:59 metar.20160316.0600.asc
> -rw-r--r-- 1 ldm dicast 1373147 Mar 16 07:59 metar.20160316.0700.asc
> -rw-r--r-- 1 ldm dicast 1355347 Mar 16 08:59 metar.20160316.0800.asc
> -rw-r--r-- 1 ldm dicast 1368429 Mar 16 09:59 metar.20160316.0900.asc
> -rw-r--r-- 1 ldm dicast 1342102 Mar 16 10:59 metar.20160316.1000.asc
> -rw-r--r-- 1 ldm dicast 1334404 Mar 16 11:59 metar.20160316.1100.asc
> -rw-r--r-- 1 ldm dicast 1362192 Mar 16 12:59 metar.20160316.1200.asc
> -rw-r--r-- 1 ldm dicast 1325419 Mar 16 13:59 metar.20160316.1300.asc
> -rw-r--r-- 1 ldm dicast 1339141 Mar 16 14:59 metar.20160316.1400.asc
> -rw-r--r-- 1 ldm dicast 1303124 Mar 16 15:59 metar.20160316.1500.asc
> -rw-r--r-- 1 ldm dicast 1259828 Mar 16 16:59 metar.20160316.1600.asc
> -rw-r--r-- 1 ldm dicast 1290720 Mar 16 17:59 metar.20160316.1700.asc
> -rw-r--r-- 1 ldm dicast 1289696 Mar 16 18:59 metar.20160316.1800.asc
> -rw-r--r-- 1 ldm dicast 1225412 Mar 16 19:59 metar.20160316.1900.asc
> -rw-r--r-- 1 ldm dicast  780683 Mar 16 20:31 metar.20160316.2000.asc
> 
> The target directory did not exist, but the error persisted after I created it
> 
> # ls -al /home/ldm/data/dec_data/obs/metar
> otal 8
> drwxr-xr-x 2 ldm dicast 4096 Mar 16 20:29 .
> drwxr-xr-x 5 ldm dicast 4096 Mar 16 20:29 ..
> 
> The cdl file exists:
> 
> # ls -al /home/ldm/etc/metar.cdl
> -rw-r--r-- 1 ldm ldm 27048 Jan 29  2014 /home/ldm/etc/metar.cdl
> 
> Running the command as user ldm manually on the command line by copy/pasting 
> the âcmd=â section of the pqact.conf
> file gave a few perl warnings but otherwise no output other than the file 
> /home/ldm/logs/metar2nc.20160316.asc.
> 
> ldm>date
> Wed Mar 16 20:40:23 UTC 2016
> ldm>util/metar2nc -t 300 -l logs -d data/dec_data/obs/metar etc/metar.cdl
> defined(@array) is deprecated at util/metar2nc line 1227.
> (Maybe you should just omit the defined()?)
> 
> â many more on different lines in the script
> 
> # cat /home/ldm/logs/metar2nc.20160316.asc
> 20:40:26 Starting metar2nc, process ID 135229
> 20:45:26 Caught SIGtimeout --shutting down
> 20:45:26 Ending process ID 135229
> 
> Same problem with the syn2nc util.
> *****
> 
> If there is a separate forum for the utils, please let me know. Maybe there 
> are
> new utils somewhere? File format problem?
> 
> Thanks a bunch for any advice,
> Terri
> 
> â
> Terri Eads | IT Manager | Global Weather Corporation
> 3005 Sterling Circle, Suite 201, Boulder, CO 80301 USA | m) 303.775.0080
> address@hidden <mailto:address@hidden>
> 
> 

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: JXN-827520
Department: Support LDM
Priority: Normal
Status: Closed


NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.