Re: [ldm-users] my data seems to be blackhole-ing

As I said above this is 6.11.6, and here is the ldmd.conf file:

EXEC    "pqact -v"
EXEC    "rtstats -h rtstats.unidata.ucar.edu"
REQUEST NEXRD2  ".*"    idd.tamu.edu


On Mon, Jul 15, 2013 at 4:56 PM, Blair Trosper <
blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:

> The only thing I have in my pqact.conf is to request all NEXRAD2 from
> idd.tamu.edu
>
> I've left ldmadmin in verbose mode for the last 20 minutes, and it's put
> nothing besides the contents of "ldmadmin watch" into that file.
>
> What else should I be seeing?
>
>
> On Mon, Jul 15, 2013 at 4:54 PM, Gerry Creager - NOAA Affiliate <
> gerry.creager@xxxxxxxx> wrote:
>
>> It'a actually adding more than just the contents of ldmadmin watch to the
>> file. What you can do, after enabling verbose mode, is 'ldmadmin tail' to
>> see the logging live. I suspect you've got the requests coming in but
>> perhaps you have a bunch of lines commented out in ~/etc/pqact.conf, and
>> it's unable to to find anything it thinks it's supposed to write out.
>>
>> OR... another issue: What do your request lines look like? (parallel
>> question: What version of ldm are you running?) If your request line is
>> 'request ANY ".*" from foo.bar' you will get the feeling you should be
>> seeing something, but you won't on later versions of LDM.
>>
>> gerry
>>
>>
>> On Mon, Jul 15, 2013 at 4:45 PM, Blair Trosper <
>> blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:
>>
>>> My which I mean it only adds the contents of "ldmadmin watch" to the
>>> ldmd.log, which doesn't really help me.
>>>
>>> I used "ldmadmin restart -v", did you mean something else?  Perhaps I
>>> misunderstood.  :/
>>>
>>>
>>> On Mon, Jul 15, 2013 at 4:44 PM, Karen Cooper - NOAA Affiliate <
>>> karen.cooper@xxxxxxxx> wrote:
>>>
>>>> Try putting pqact into verbose mode.
>>>>
>>>> exec "pqact -v"
>>>>
>>>> and then restart ldm.  It should tell you everything pqact is doing.
>>>>
>>>>
>>>> On Mon, Jul 15, 2013 at 4:42 PM, Blair Trosper <
>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:
>>>>
>>>>> It's enabled and not commented.
>>>>>
>>>>> Putting ldm into verbose mode didn't seem to yield anything additional
>>>>> in the log files.  In fact, it's very UNdescriptive.
>>>>>
>>>>>
>>>>> On Mon, Jul 15, 2013 at 4:41 PM, Karen Cooper - NOAA Affiliate <
>>>>> karen.cooper@xxxxxxxx> wrote:
>>>>>
>>>>>> And of course what I really meant was the exec line in your
>>>>>> ldmd.conf...
>>>>>>
>>>>>> exec    "pqact "
>>>>>>
>>>>>>
>>>>>> On Mon, Jul 15, 2013 at 4:40 PM, Karen Cooper - NOAA Affiliate <
>>>>>> karen.cooper@xxxxxxxx> wrote:
>>>>>>
>>>>>>> Blair,
>>>>>>>
>>>>>>> First a sanity check. -- Are you sure that pqact is uncommented in
>>>>>>> your ldmadmin.pl?
>>>>>>>
>>>>>>> You can set pqact to verbose mode and then you should see what it's
>>>>>>> trying to do, as it will log to your ldmd.log files.  I often use this 
>>>>>>> when
>>>>>>> I'm testing out new pqact entries that aren't working as I expect.
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Jul 15, 2013 at 4:35 PM, Blair Trosper <
>>>>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> I'm receiving several feeds as proven by ldmadmin watch...and the
>>>>>>>> logs all look fine.  However, my data isn't being saved to disk.
>>>>>>>>
>>>>>>>> From *registry.xml*:
>>>>>>>>
>>>>>>>>>   <pqact>
>>>>>>>>>     <config-path>/mnt/data/ldm/etc/pqact.conf</config-path>
>>>>>>>>>     <datadir-path>/mnt/data/ldm/var/data</datadir-path>
>>>>>>>>>   </pqact>
>>>>>>>>
>>>>>>>>
>>>>>>>> From */mnt/data/ldm/etc/pqact.conf*:
>>>>>>>>
>>>>>>>>> # L2 data
>>>>>>>>> NEXRAD2
>>>>>>>>> ^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/[SI]
>>>>>>>>>         FILE    nexrad2/\1/\1_\2-\3.part
>>>>>>>>> NEXRAD2
>>>>>>>>> ^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/E
>>>>>>>>>         FILE    -close nexrad2/\1/\1_\2-\3.part
>>>>>>>>> (snip)
>>>>>>>>
>>>>>>>>
>>>>>>>> However, following those two things, here's a directory listing of
>>>>>>>> */mnt/data/ldm/var/data*:
>>>>>>>>
>>>>>>>>> ldm@chicago-il-1:~/data$ ls -lsha
>>>>>>>>> total 8.0K
>>>>>>>>> 4.0K drwxr-xr-x 2 ldm ldm 4.0K Jul 15 16:09 .
>>>>>>>>> 4.0K drwxr-xr-x 5 ldm ldm 4.0K Jul 13 23:19 ..
>>>>>>>>
>>>>>>>>
>>>>>>>> Nothing.  The same is true of other feeds which should be stashed
>>>>>>>> in other subdirectories.
>>>>>>>>
>>>>>>>> The bandwidth is certainly registering, which I have verified at
>>>>>>>> the router, so I'm definitely receiving the data...so...
>>>>>>>>
>>>>>>>> Where are my files going?  Any way to track this down?
>>>>>>>>
>>>>>>>> (I've also done "du -ksh" from the home directory of the ldm user
>>>>>>>> over the last few hours, and it's not increasing.  Definitely nothing 
>>>>>>>> being
>>>>>>>> written to hard disk.  And still no errors in the LDM or system logs.)
>>>>>>>>
>>>>>>>> --
>>>>>>>> Blair Trosper
>>>>>>>> Weather Data / Updraft Networks
>>>>>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
>>>>>>>> NOC:  512-666-0536
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> ldm-users mailing list
>>>>>>>> ldm-users@xxxxxxxxxxxxxxxx
>>>>>>>> For list information or to unsubscribe,  visit:
>>>>>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> “Climate is what you expect, weather is what you get."
>>>>>>>  -- Robert A. Heinlein
>>>>>>>
>>>>>>> -------------------------------------------
>>>>>>> Karen.Cooper@xxxxxxxx
>>>>>>>
>>>>>>> Phone:  405-325-6982
>>>>>>> Cell:   405-834-8559
>>>>>>> INDUS Corporation
>>>>>>> National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> “Climate is what you expect, weather is what you get."
>>>>>>  -- Robert A. Heinlein
>>>>>>
>>>>>> -------------------------------------------
>>>>>> Karen.Cooper@xxxxxxxx
>>>>>>
>>>>>> Phone:  405-325-6982
>>>>>> Cell:   405-834-8559
>>>>>> INDUS Corporation
>>>>>> National Severe Storms Laboratory
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Blair Trosper
>>>>> Weather Data / Updraft Networks
>>>>> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
>>>>> NOC:  512-666-0536
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> “Climate is what you expect, weather is what you get."
>>>>  -- Robert A. Heinlein
>>>>
>>>> -------------------------------------------
>>>> Karen.Cooper@xxxxxxxx
>>>>
>>>> Phone:  405-325-6982
>>>> Cell:   405-834-8559
>>>> INDUS Corporation
>>>> National Severe Storms Laboratory
>>>>
>>>>
>>>
>>>
>>> --
>>> Blair Trosper
>>> Weather Data / Updraft Networks
>>> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
>>> NOC:  512-666-0536
>>>
>>> _______________________________________________
>>> ldm-users mailing list
>>> ldm-users@xxxxxxxxxxxxxxxx
>>> For list information or to unsubscribe,  visit:
>>> http://www.unidata.ucar.edu/mailing_lists/
>>>
>>
>>
>>
>> --
>> Gerry Creager
>> NSSL/CIMMS
>> 405.325.6371
>> ++++++++++++++++++++++
>> “Big whorls have little whorls,
>> That feed on their velocity;
>> And little whorls have lesser whorls,
>> And so on to viscosity.”
>> Lewis Fry Richardson (1881-1953)
>>
>
>
>
> --
> Blair Trosper
> Weather Data / Updraft Networks
> blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
> NOC:  512-666-0536
>



-- 
Blair Trosper
Weather Data / Updraft Networks
blair.trosper@xxxxxxxxxxxxxxxxxxx <blair.trosper@xxxxxxxxxx>
NOC:  512-666-0536
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: