Re: [ldm-users] my data seems to be blackhole-ing

Sorry, I'm getting ahead of myself I think.

In your ldmd.conf add the "-v" to the pqact call.  That will cause pqact to
log to your ldmd.log files.  Of course you will need to do the "ldmadmin
restart" to reread the ldmd.conf file and then you should see something
like this in your logs:


Jul 15 21:48:01 nmqwd1 pqact[6733] INFO:                pipe: -close
/home/ldm/w2receive_multiple_files.sh /data/realtime/fetched/radar/KAMA/
Jul 15 21:48:08 nmqwd1 pqact[6733] INFO:  1075200 20130715214802.891
EXP 000
/tmp/w2mirror.23402.2/tar_of_data_and_record//data/realtime/mapping/mergerPartition04/MappedReflectivityQC/KCAE/20130715-214737.raw.tar

Jul 15 21:48:08 nmqwd1 pqact[6733] INFO:   122880 20130715214802.989
EXP 000
/tmp/w2mirror.23392.2/tar_of_data_and_record//data/realtime/mapping/mergerPartition03/MappedReflectivityQC/KAMA/20130715-214722.raw.tar

Jul 15 21:48:08 nmqwd1 pqact[6733] INFO:    10240 20130715214808.314
EXP 000
/tmp/w2mirror.11674.2/tar_of_data_and_record//data/realtime/radar/KBIS/ReflectivityQC/02.40/20130715-214745.netcdf.gz.tar

Jul 15 21:48:08 nmqwd1 pqact[6733] INFO:                pipe: -close
/home/ldm/w2receive_multiple_files.sh /data/realtime/fetched/radar/KBIS/

so you can see what pqact is acting on and any errors it might get.



On Mon, Jul 15, 2013 at 4:45 PM, Blair Trosper <
blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:

> My which I mean it only adds the contents of "ldmadmin watch" to the
> ldmd.log, which doesn't really help me.
>
> I used "ldmadmin restart -v", did you mean something else?  Perhaps I
> misunderstood.  :/
>
>
> On Mon, Jul 15, 2013 at 4:44 PM, Karen Cooper - NOAA Affiliate <
> karen.cooper@xxxxxxxx> wrote:
>
>> Try putting pqact into verbose mode.
>>
>> exec "pqact -v"
>>
>> and then restart ldm.  It should tell you everything pqact is doing.
>>
>>
>> On Mon, Jul 15, 2013 at 4:42 PM, Blair Trosper <
>> blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:
>>
>>> It's enabled and not commented.
>>>
>>> Putting ldm into verbose mode didn't seem to yield anything additional
>>> in the log files.  In fact, it's very UNdescriptive.
>>>
>>>
>>> On Mon, Jul 15, 2013 at 4:41 PM, Karen Cooper - NOAA Affiliate <
>>> karen.cooper@xxxxxxxx> wrote:
>>>
>>>> And of course what I really meant was the exec line in your ldmd.conf...
>>>>
>>>> exec    "pqact "
>>>>
>>>>
>>>> On Mon, Jul 15, 2013 at 4:40 PM, Karen Cooper - NOAA Affiliate <
>>>> karen.cooper@xxxxxxxx> wrote:
>>>>
>>>>> Blair,
>>>>>
>>>>> First a sanity check. -- Are you sure that pqact is uncommented in
>>>>> your ldmadmin.pl?
>>>>>
>>>>> You can set pqact to verbose mode and then you should see what it's
>>>>> trying to do, as it will log to your ldmd.log files.  I often use this 
>>>>> when
>>>>> I'm testing out new pqact entries that aren't working as I expect.
>>>>>
>>>>>
>>>>> On Mon, Jul 15, 2013 at 4:35 PM, Blair Trosper <
>>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:
>>>>>
>>>>>> I'm receiving several feeds as proven by ldmadmin watch...and the
>>>>>> logs all look fine.  However, my data isn't being saved to disk.
>>>>>>
>>>>>> From *registry.xml*:
>>>>>>
>>>>>>>   <pqact>
>>>>>>>     <config-path>/mnt/data/ldm/etc/pqact.conf</config-path>
>>>>>>>     <datadir-path>/mnt/data/ldm/var/data</datadir-path>
>>>>>>>   </pqact>
>>>>>>
>>>>>>
>>>>>> From */mnt/data/ldm/etc/pqact.conf*:
>>>>>>
>>>>>>> # L2 data
>>>>>>> NEXRAD2
>>>>>>> ^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/[SI]
>>>>>>>         FILE    nexrad2/\1/\1_\2-\3.part
>>>>>>> NEXRAD2
>>>>>>> ^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/E
>>>>>>>         FILE    -close nexrad2/\1/\1_\2-\3.part
>>>>>>> (snip)
>>>>>>
>>>>>>
>>>>>> However, following those two things, here's a directory listing of *
>>>>>> /mnt/data/ldm/var/data*:
>>>>>>
>>>>>>> ldm@chicago-il-1:~/data$ ls -lsha
>>>>>>> total 8.0K
>>>>>>> 4.0K drwxr-xr-x 2 ldm ldm 4.0K Jul 15 16:09 .
>>>>>>> 4.0K drwxr-xr-x 5 ldm ldm 4.0K Jul 13 23:19 ..
>>>>>>
>>>>>>
>>>>>> Nothing.  The same is true of other feeds which should be stashed in
>>>>>> other subdirectories.
>>>>>>
>>>>>> The bandwidth is certainly registering, which I have verified at the
>>>>>> router, so I'm definitely receiving the data...so...
>>>>>>
>>>>>> Where are my files going?  Any way to track this down?
>>>>>>
>>>>>> (I've also done "du -ksh" from the home directory of the ldm user
>>>>>> over the last few hours, and it's not increasing.  Definitely nothing 
>>>>>> being
>>>>>> written to hard disk.  And still no errors in the LDM or system logs.)
>>>>>>
>>>>>> --
>>>>>> Blair Trosper
>>>>>> Weather Data / Updraft Networks
>>>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
>>>>>> NOC:  512-666-0536
>>>>>>
>>>>>> _______________________________________________
>>>>>> ldm-users mailing list
>>>>>> ldm-users@xxxxxxxxxxxxxxxx
>>>>>> For list information or to unsubscribe,  visit:
>>>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> “Climate is what you expect, weather is what you get."
>>>>>  -- Robert A. Heinlein
>>>>>
>>>>> -------------------------------------------
>>>>> Karen.Cooper@xxxxxxxx
>>>>>
>>>>> Phone:  405-325-6982
>>>>> Cell:   405-834-8559
>>>>> INDUS Corporation
>>>>> National Severe Storms Laboratory
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> “Climate is what you expect, weather is what you get."
>>>>  -- Robert A. Heinlein
>>>>
>>>> -------------------------------------------
>>>> Karen.Cooper@xxxxxxxx
>>>>
>>>> Phone:  405-325-6982
>>>> Cell:   405-834-8559
>>>> INDUS Corporation
>>>> National Severe Storms Laboratory
>>>>
>>>>
>>>
>>>
>>> --
>>> Blair Trosper
>>> Weather Data / Updraft Networks
>>> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
>>> NOC:  512-666-0536
>>>
>>
>>
>>
>> --
>> “Climate is what you expect, weather is what you get."
>>  -- Robert A. Heinlein
>>
>> -------------------------------------------
>> Karen.Cooper@xxxxxxxx
>>
>> Phone:  405-325-6982
>> Cell:   405-834-8559
>> INDUS Corporation
>> National Severe Storms Laboratory
>>
>>
>
>
> --
> Blair Trosper
> Weather Data / Updraft Networks
> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
> NOC:  512-666-0536
>



-- 
“Climate is what you expect, weather is what you get."
 -- Robert A. Heinlein

-------------------------------------------
Karen.Cooper@xxxxxxxx

Phone:  405-325-6982
Cell:   405-834-8559
INDUS Corporation
National Severe Storms Laboratory
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: