[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

20000925: 20000925: 20000925: files not the same size on two machines

Tom,

Your pqact.conf action below which creates the file name based
on the template: YYMMDD_sao.gem with -m 24 should only have
24 times in the file. This action looks correct.

Are you adding any other data to this file? At one time, I though
Maureen had mentioned trying to display agwx data, so am wondering
if there is some other process (script) maybe adding data to the file
with SFEDIT.

I'd also check your 00:17 cron entry to make sure that it isn't
writing to the same file as this pqact.conf entry is. That could
create lots of problems with 2 separate processes writing to the same file.

If this was working at one time, before you started to get the errors,
then it seems most likely that one of your scripts is not behaving correctly.

I can try logging in again and checking out the data processing
if you provide a temporary login.

Steve Chiswell 






>From: Tom Priddy <address@hidden>
>Organization: UCAR/Unidata
>Keywords: 200009251739.e8PHdDb13475

>From: Tom Priddy
>
>Here's the greps as you mentioned:
>
>[ldm@weather2 etc]$ grep "dchrly" pqact*
>pqact.conf:     PIPE    /usr/local/ldm/decoders/dchrly -v 1 -b 9 -m 24
>pqact.conf:     -d /d2-agwx/ldmdata/gempak/logs/dchrly.log
>
>here's pqact.conf
>DDS|IDS ^S[AP][ACHMNU][AEKMNSWX].* .... ([0-3][0-9])
>        PIPE    /usr/local/ldm/decoders/dchrly -v 1 -b 9 -m 24
>        -d /d2-agwx/ldmdata/gempak/logs/dchrly.log
>        -p /export/home/gempak/NAWIPS-5.4/gempak5.4/tables/pack/hrly.pack
>        -s /export/home/gempak/NAWIPS-5.4/gempak5.4/tables/stns/sfmetar_sa.tbl
>        /d2-agwx/ldmdata/gempak/surface/YYMMDD_sao.gem
>#
># End Addition ...Michael
>
>here's a grep on scripts/LDM
>cd export/home/gempak/scripts/LDM
>[gempak@weather2]# grep "dchrly" *
>grep: BACKUP: Is a directory
>grep: bak: Is a directory
>grep: bak1: Is a directory
>grep: bak2: Is a directory
>grep: tmp: Is a directory
>
>Unidata Support wrote:
>
>> Tom,
>> I think we better know how data is getting into the surface files.
>> Do you have a dchrly entry in your ~ldm/etc/pqact.conf file on the Linux box
> ?
>> from the time stamp on the file below:
>> > 000925_sao.gem          25-Sep-2000 09:00   7.7M
>> it may be that you have a script running at the top of the hour to decode th
> e data,
>> rather than pipe the data through the decoder as it arrives.
>>
>> If we can find out how you are running dchrly, that might shed some light
>> on what data is in the file. You might want to "grep" for dchrly
>> in your scripts directory to see if any of those are invoking the decoders.
>>
>> Steve CHiswell
>>
>> >From: Tom Priddy <address@hidden>
>> >Organization: UCAR/Unidata
>> >Keywords: 200009251648.e8PGmZb11719
>>
>> >From: Tom Priddy
>> >
>> >When I run sflist and set DATTIM to list....I get nothing returned.  We run
>  dc
>> > hrly
>> >daily at 00:17
>> >to do something.....but I notice list night's core dumped. Can we try
>> >re-downloading
>> >dchrly? Maybe that's the problem.  Otherwise maybe we should reload ldm and
>  ge
>> > mpak
>> >on the linux system?????
>> >
>> >Unidata Support wrote:
>> >
>> >> >From: Tom Priddy <address@hidden>
>> >> >Organization: UCAR/Unidata
>> >> >Keywords: 200009251308.e8PD8fb03985
>> >>
>> >> >From: Tom Priddy
>> >> >
>> >> >Steve...we continue to try to figure out why our linux system (weather2)
>> >> >is not
>> >> >creating maps but insteady is giving us a "Too many times in file"
>> >> >
>> >> >As you can see from below....these two files one on weather2  (linux)
>> >> >the other on
>> >> >Kelvin (unix) are not the same size. Could it be our oasurf.csh script?
>> >> >
>> >> >Weather2:
>> >> > 000925_sao.gem          25-Sep-2000 09:00   7.7M
>> >> >
>> >> >Kelvin:
>> >> >  000925_sao.gem         25-Sep-00 09:02     3M
>> >> >
>> >> >--
>> >> >========================================================================
> ===
>> >> >
>> > >Tom Priddy,  Extension Ag. Meteorologist.....email: address@hidden
>> >> >Ag. Weather Center.............................fax: 606-257-5671
>> >> >243 Ag. Engineering Bldg.....................phone: 606-257-8803 ext 245
>> >> >
>> >> >Dept. of Biosystems and Ag. Engr.
> >> >University of Kentucky
>> >> >Lexington, KY 40546-0276
>> >> >HOMEPAGE......................................http://wwwagwx.ca.uky.edu/
>> >> >
>> >> >========================================================================
> ===
>> >> >
>> >> >
>> >> >
>> >>
>> >> Tom,
>> >> These files would appear to be your metar files, and not the grid files
>> >> that your oa script would create. The size difference could be related to
>> >> exceeding the number of times in a file. Can you run sflist on both files
>> >> with DATTIM=list and see what times are in the 2 files? Are they the same
> ?
>> >> Are you running dchrly from the LDM to create these files, or do you deco
> de
>> >> surface data into these files by script?
>> >>
>> >> I would normally only expect your oasurf.csh script if it did some sort o
> f
>> >> SFDELT call to delete times out of the surface file. If you are doing tha
> t,
>> > and
>> >> that was failing, then it could be a cause of your problems.
>> >>
>> >> Steve Chiswell
>> >> *************************************************************************
> ***
>> >> Unidata User Support                                    UCAR Unidata Prog
> ram
>> >> (303)497-8644                                                  P.O. Box 3
> 000
>> >> address@hidden                                   Boulder, CO 80
> 307
>> >> -------------------------------------------------------------------------
> ---
>> >> Unidata WWW Service                      http://www.unidata.ucar.edu/
>> >> *************************************************************************
> ***
>> >
>> >--
>> >===========================================================================
>> >Tom Priddy,  Extension Ag. Meteorologist.....email: address@hidden
>> >Ag. Weather Center.............................fax: 606-257-5671
>> >243 Ag. Engineering Bldg.....................phone: 606-257-8803 ext 245
>> >Dept. of Biosystems and Ag. Engr.
>> >University of Kentucky
>> >Lexington, KY 40546-0276
>> >HOMEPAGE......................................http://wwwagwx.ca.uky.edu/
>> >===========================================================================
>> >
>> >
>>
>> ****************************************************************************
>> Unidata User Support                                    UCAR Unidata Program
>> (303)497-8644                                                  P.O. Box 3000
>> address@hidden                                   Boulder, CO 80307
>> ----------------------------------------------------------------------------
>> Unidata WWW Service                       http://www.unidata.ucar.edu/      
>> ****************************************************************************
>
>--
>===========================================================================
>Tom Priddy,  Extension Ag. Meteorologist.....email: address@hidden
>Ag. Weather Center.............................fax: 606-257-5671
>243 Ag. Engineering Bldg.....................phone: 606-257-8803 ext 245
>Dept. of Biosystems and Ag. Engr.
>University of Kentucky
>Lexington, KY 40546-0276
>HOMEPAGE......................................http://wwwagwx.ca.uky.edu/
>===========================================================================
>
>