[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

19990408: dcnldn problem



Art,

It sounds like the data is not getting flushed to the file on exit- which would
explain why its the end of the hour thats missing.

I'll look at this and see what we need to fix.

Steve Chiswell
Unidata User SUpport

>From: address@hidden
>Organization: .
>Keywords: 199904081806.MAA21397

>Hi,
>
>I'm following up on a problem that a student has reported and is still
>occuring regarding the gempak decoding of lightning data.  The decoder
>on our system seems to work okay a lot of the time, but at other times,
>it will not decode (store?) data toward the end of an hour.  I also save
>the nldn data in raw format from the IDD feed (by report and by hour)
>and I can see that the data come in during the latter part of each hour,
>but for some reason, the decoder is not handling it, sometimes.
>Thanks for any help you can give in trying to track down this problem.
>
>                                              Art.
>
>Here's an example of the problem from this AM:
>
>pqact.conf entries:
>
>NLDN   ^(.*)
>       FILE    -close data/ldm/nldn/\1.ingest
>
>NLDN   ^([0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9])
>       FILE    -close data/ldm/nldn/\1\2\3.ingest
>
>NLDN   ^([0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9])
>       PIPE    /opt1/gempak/NAWIPS/bin/sol/dcnldn -v -m20000 -sminute05
>       -ddata/gempak/logs/dcnldn.log
>       -p/opt1/gempak/NAWIPS/gempak5.4/tables/pack/nldn.pack
>       data/gempak/nldn/YYMMDDHH_nldn.gem
>
>Software:  gempak 5.4 pl6 with Jl2298 updated decode_nldn.f
>
>
>List of raw data collected:
>
>-rw-r--r--   1 ldm      user       48440 Apr  8 04:00 9909807.ingest
>-rw-r--r--   1 ldm      user        4928 Apr  8 03:07 99098070005.ingest
>-rw-r--r--   1 ldm      user        4368 Apr  8 03:13 99098070611.ingest
>-rw-r--r--   1 ldm      user        5180 Apr  8 03:19 99098071217.ingest
>-rw-r--r--   1 ldm      user        4872 Apr  8 03:24 99098071823.ingest
>-rw-r--r--   1 ldm      user        4956 Apr  8 03:31 99098072429.ingest
>-rw-r--r--   1 ldm      user        4984 Apr  8 03:36 99098073035.ingest
>-rw-r--r--   1 ldm      user        4816 Apr  8 03:42 99098073641.ingest
>-rw-r--r--   1 ldm      user        4844 Apr  8 03:48 99098074247.ingest
>-rw-r--r--   1 ldm      user        4564 Apr  8 03:54 99098074853.ingest
>-rw-r--r--   1 ldm      user        4928 Apr  8 04:00 99098075459.ingest
>-rw-r--r--   1 ldm      user       58352 Apr  8 05:00 9909808.ingest
>-rw-r--r--   1 ldm      user        5404 Apr  8 04:06 99098080005.ingest
>-rw-r--r--   1 ldm      user        6468 Apr  8 04:12 99098080611.ingest
>-rw-r--r--   1 ldm      user        5908 Apr  8 04:18 99098081217.ingest
>-rw-r--r--   1 ldm      user        6412 Apr  8 04:24 99098081823.ingest
>-rw-r--r--   1 ldm      user        5880 Apr  8 04:30 99098082429.ingest
>-rw-r--r--   1 ldm      user        5292 Apr  8 04:36 99098083035.ingest
>-rw-r--r--   1 ldm      user        5152 Apr  8 04:42 99098083641.ingest
>-rw-r--r--   1 ldm      user        5656 Apr  8 04:48 99098084247.ingest
>-rw-r--r--   1 ldm      user        6468 Apr  8 04:54 99098084853.ingest
>-rw-r--r--   1 ldm      user        5712 Apr  8 05:00 99098085459.ingest
>-rw-r--r--   1 ldm      user       57204 Apr  8 06:01 9909809.ingest
>-rw-r--r--   1 ldm      user        5152 Apr  8 05:06 99098090005.ingest
>-rw-r--r--   1 ldm      user        5264 Apr  8 05:13 99098090611.ingest
>-rw-r--r--   1 ldm      user        5124 Apr  8 05:19 99098091217.ingest
>-rw-r--r--   1 ldm      user        5936 Apr  8 05:25 99098091823.ingest
>-rw-r--r--   1 ldm      user        6328 Apr  8 05:31 99098092429.ingest
>-rw-r--r--   1 ldm      user        6020 Apr  8 05:37 99098093035.ingest
>-rw-r--r--   1 ldm      user        5600 Apr  8 05:43 99098093641.ingest
>-rw-r--r--   1 ldm      user        5936 Apr  8 05:49 99098094247.ingest
>-rw-r--r--   1 ldm      user        5908 Apr  8 05:55 99098094853.ingest
>-rw-r--r--   1 ldm      user        5936 Apr  8 06:01 99098095459.ingest
>-rw-r--r--   1 ldm      user       71120 Apr  8 07:00 9909810.ingest
>-rw-r--r--   1 ldm      user        6412 Apr  8 06:07 99098100005.ingest
>-rw-r--r--   1 ldm      user        5796 Apr  8 06:13 99098100611.ingest
>-rw-r--r--   1 ldm      user        6636 Apr  8 06:19 99098101217.ingest
>-rw-r--r--   1 ldm      user        6580 Apr  8 06:25 99098101823.ingest
>-rw-r--r--   1 ldm      user        7392 Apr  8 06:31 99098102429.ingest
>-rw-r--r--   1 ldm      user        7196 Apr  8 06:37 99098103035.ingest
>-rw-r--r--   1 ldm      user        7056 Apr  8 06:43 99098103641.ingest
>-rw-r--r--   1 ldm      user        7504 Apr  8 06:49 99098104247.ingest
>-rw-r--r--   1 ldm      user        7532 Apr  8 06:55 99098104853.ingest
>-rw-r--r--   1 ldm      user        9016 Apr  8 07:00 99098105459.ingest
>-rw-r--r--   1 ldm      user       67844 Apr  8 08:00 9909811.ingest
>-rw-r--r--   1 ldm      user        7896 Apr  8 07:07 99098110005.ingest
>-rw-r--r--   1 ldm      user        7112 Apr  8 07:13 99098110611.ingest
>-rw-r--r--   1 ldm      user        6972 Apr  8 07:19 99098111217.ingest
>-rw-r--r--   1 ldm      user        7336 Apr  8 07:25 99098111823.ingest
>-rw-r--r--   1 ldm      user        6524 Apr  8 07:30 99098112429.ingest
>-rw-r--r--   1 ldm      user        7028 Apr  8 07:36 99098113035.ingest
>-rw-r--r--   1 ldm      user        6580 Apr  8 07:43 99098113641.ingest
>-rw-r--r--   1 ldm      user        5600 Apr  8 07:48 99098114247.ingest
>-rw-r--r--   1 ldm      user        6300 Apr  8 07:55 99098114853.ingest
>-rw-r--r--   1 ldm      user        6496 Apr  8 08:00 99098115459.ingest
>-rw-r--r--   1 ldm      user       63980 Apr  8 09:00 9909812.ingest
>-rw-r--r--   1 ldm      user        6552 Apr  8 08:06 99098120005.ingest
>-rw-r--r--   1 ldm      user        7112 Apr  8 08:12 99098120611.ingest
>-rw-r--r--   1 ldm      user        8204 Apr  8 08:18 99098121217.ingest
>-rw-r--r--   1 ldm      user        7364 Apr  8 08:24 99098121823.ingest
>-rw-r--r--   1 ldm      user        6888 Apr  8 08:30 99098122429.ingest
>-rw-r--r--   1 ldm      user        5376 Apr  8 08:36 99098123035.ingest
>-rw-r--r--   1 ldm      user        5796 Apr  8 08:42 99098123641.ingest
>-rw-r--r--   1 ldm      user        5152 Apr  8 08:48 99098124247.ingest
>-rw-r--r--   1 ldm      user        5824 Apr  8 08:54 99098124853.ingest
>-rw-r--r--   1 ldm      user        5712 Apr  8 09:00 99098125459.ingest
>-rw-r--r--   1 ldm      user       74928 Apr  8 10:00 9909813.ingest
>-rw-r--r--   1 ldm      user        6636 Apr  8 09:07 99098130005.ingest
>-rw-r--r--   1 ldm      user        6692 Apr  8 09:12 99098130611.ingest
>-rw-r--r--   1 ldm      user        6832 Apr  8 09:18 99098131217.ingest
>-rw-r--r--   1 ldm      user        7756 Apr  8 09:24 99098131823.ingest
>-rw-r--r--   1 ldm      user        8456 Apr  8 09:30 99098132429.ingest
>-rw-r--r--   1 ldm      user        8288 Apr  8 09:36 99098133035.ingest
>-rw-r--r--   1 ldm      user        8288 Apr  8 09:42 99098133641.ingest
>-rw-r--r--   1 ldm      user        7840 Apr  8 09:48 99098134247.ingest
>-rw-r--r--   1 ldm      user        6888 Apr  8 09:54 99098134853.ingest
>-rw-r--r--   1 ldm      user        7252 Apr  8 10:00 99098135459.ingest
>-rw-r--r--   1 ldm      user       74172 Apr  8 11:02 9909814.ingest
>-rw-r--r--   1 ldm      user        7140 Apr  8 10:06 99098140005.ingest
>-rw-r--r--   1 ldm      user        7280 Apr  8 10:12 99098140611.ingest
>-rw-r--r--   1 ldm      user        6300 Apr  8 10:18 99098141217.ingest
>-rw-r--r--   1 ldm      user        6916 Apr  8 10:25 99098141823.ingest
>-rw-r--r--   1 ldm      user        6832 Apr  8 10:31 99098142429.ingest
>-rw-r--r--   1 ldm      user        7140 Apr  8 10:37 99098143035.ingest
>-rw-r--r--   1 ldm      user        6972 Apr  8 10:43 99098143641.ingest
>-rw-r--r--   1 ldm      user        8120 Apr  8 10:49 99098144247.ingest
>-rw-r--r--   1 ldm      user        8960 Apr  8 10:55 99098144853.ingest
>-rw-r--r--   1 ldm      user        8512 Apr  8 11:02 99098145459.ingest
>-rw-r--r--   1 ldm      user       73836 Apr  8 12:01 9909815.ingest
>-rw-r--r--   1 ldm      user        8736 Apr  8 11:07 99098150005.ingest
>-rw-r--r--   1 ldm      user        9268 Apr  8 11:14 99098150611.ingest
>-rw-r--r--   1 ldm      user        8764 Apr  8 11:19 99098151217.ingest
>-rw-r--r--   1 ldm      user        7924 Apr  8 11:25 99098151823.ingest
>-rw-r--r--   1 ldm      user        6832 Apr  8 11:30 99098152429.ingest
>-rw-r--r--   1 ldm      user        6580 Apr  8 11:37 99098153035.ingest
>-rw-r--r--   1 ldm      user        7644 Apr  8 11:43 99098153641.ingest
>-rw-r--r--   1 ldm      user        6580 Apr  8 11:49 99098154247.ingest
>-rw-r--r--   1 ldm      user        6188 Apr  8 11:54 99098154853.ingest
>-rw-r--r--   1 ldm      user        5320 Apr  8 12:01 99098155459.ingest
>-rw-r--r--   1 ldm      user       25872 Apr  8 12:24 9909816.ingest
>-rw-r--r--   1 ldm      user        5964 Apr  8 12:06 99098160005.ingest
>-rw-r--r--   1 ldm      user        6356 Apr  8 12:12 99098160611.ingest
>-rw-r--r--   1 ldm      user        6636 Apr  8 12:19 99098161217.ingest
>-rw-r--r--   1 ldm      user        6916 Apr  8 12:24 99098161823.ingest
>
>
>Data available using ltglist:
>
>99040807   thru minute 47
>99040808   thru minute 48 (one ob for minute 48)
>99040809   thru minute 59
>99040810   thru minute 58 (three obs for minute 58)
>99040811   thru minute 49
>99040812   thru minute 52
>99040813   thru minute 53
>99040814   thru minute 59
>99040815   thru minute 59
>
>
>Here's the dcnldn.log file:
>
>DCNLDN[24842]: 990408/0700: Starting up.
>DCNLDN[24842]: 990408/0702: Normal Termination.
>DCNLDN[24842]: 990408/0702: Number of bulletins read and processed: 168
>DCNLDN[24842]: 990408/0702: Shutting Down.
>DCNLDN[27479]: 990408/0707: Starting up.
>DCNLDN[27479]: 990408/0711: Normal Termination.
>DCNLDN[27479]: 990408/0711: Number of bulletins read and processed: 173
>DCNLDN[27479]: 990408/0711: Shutting Down.
>DCNLDN[28010]: 990408/0713: Starting up.
>DCNLDN[28010]: 990408/0713: Normal Termination.
>DCNLDN[28010]: 990408/0713: Number of bulletins read and processed: 153
>DCNLDN[28010]: 990408/0713: Shutting Down.
>DCNLDN[747]: 990408/0719: Starting up.
>DCNLDN[747]: 990408/0720: Normal Termination.
>DCNLDN[747]: 990408/0720: Number of bulletins read and processed: 182
>DCNLDN[747]: 990408/0720: Shutting Down.
>DCNLDN[1267]: 990408/0724: Starting up.
>DCNLDN[1267]: 990408/0725: Normal Termination.
>DCNLDN[1267]: 990408/0725: Number of bulletins read and processed: 171
>DCNLDN[1267]: 990408/0725: Shutting Down.
>DCNLDN[3966]: 990408/0731: Starting up.
>DCNLDN[3966]: 990408/0732: Normal Termination.
>DCNLDN[3966]: 990408/0732: Number of bulletins read and processed: 174
>DCNLDN[3966]: 990408/0732: Shutting Down.
>DCNLDN[6615]: 990408/0736: Starting up.
>DCNLDN[6615]: 990408/0740: Normal Termination.
>DCNLDN[6615]: 990408/0740: Number of bulletins read and processed: 175
>DCNLDN[6615]: 990408/0740: Shutting Down.
>DCNLDN[7164]: 990408/0742: Starting up.
>DCNLDN[7164]: 990408/0754: Normal Termination.
>DCNLDN[7164]: 990408/0754: Number of bulletins read and processed: 339
>DCNLDN[7164]: 990408/0754: Shutting Down.
>DCNLDN[10342]: 990408/0754: Starting up.
>DCNLDN[10342]: 990408/0812: Normal Termination.
>DCNLDN[10342]: 990408/0812: Number of bulletins read and processed: 751
>DCNLDN[10342]: 990408/0812: Shutting Down.
>DCNLDN[22036]: 990408/0818: Starting up.
>DCNLDN[22036]: 990408/0824: Normal Termination.
>DCNLDN[22036]: 990408/0824: Number of bulletins read and processed: 208
>DCNLDN[22036]: 990408/0824: Shutting Down.
>DCNLDN[7562]: 990408/0824: Starting up.
>DCNLDN[7562]: 990408/1032: Normal Termination.
>DCNLDN[7562]: 990408/1032: Number of bulletins read and processed: 4598
>DCNLDN[7562]: 990408/1032: Shutting Down.
>DCNLDN[24943]: 990408/1037: Starting up.
>DCNLDN[24943]: 990408/1038: Normal Termination.
>DCNLDN[24943]: 990408/1038: Number of bulletins read and processed: 254
>DCNLDN[24943]: 990408/1038: Shutting Down.
>DCNLDN[25556]: 990408/1043: Starting up.
>DCNLDN[25556]: 990408/1343: Normal Termination.
>DCNLDN[25556]: 990408/1343: Number of bulletins read and processed: 7617
>DCNLDN[25556]: 990408/1343: Shutting Down.
>DCNLDN[15356]: 990408/1348: Starting up.
>DCNLDN[15356]: 990408/1416: Normal Termination.
>DCNLDN[15356]: 990408/1416: Number of bulletins read and processed: 1285
>DCNLDN[15356]: 990408/1416: Shutting Down.
>DCNLDN[2859]: 990408/1418: Starting up.
>DCNLDN[2859]: 990408/1420: Normal Termination.
>DCNLDN[2859]: 990408/1420: Number of bulletins read and processed: 222
>DCNLDN[2859]: 990408/1420: Shutting Down.
>DCNLDN[16811]: 990408/1425: Starting up.
>DCNLDN[16811]: 990408/1428: Normal Termination.
>DCNLDN[16811]: 990408/1428: Number of bulletins read and processed: 244
>DCNLDN[16811]: 990408/1428: Shutting Down.
>DCNLDN[24777]: 990408/1431: Starting up.
>DCNLDN[24777]: 990408/1432: Normal Termination.
>DCNLDN[24777]: 990408/1432: Number of bulletins read and processed: 241
>DCNLDN[24777]: 990408/1432: Shutting Down.
>DCNLDN[27472]: 990408/1437: Starting up.
>DCNLDN[27472]: 990408/1438: Normal Termination.
>DCNLDN[27472]: 990408/1438: Number of bulletins read and processed: 252
>DCNLDN[27472]: 990408/1438: Shutting Down.
>DCNLDN[28034]: 990408/1443: Starting up.
>DCNLDN[28034]: 990408/1444: Normal Termination.
>DCNLDN[28034]: 990408/1444: Number of bulletins read and processed: 246
>DCNLDN[28034]: 990408/1444: Shutting Down.
>DCNLDN[688]: 990408/1449: Starting up.
>DCNLDN[688]: 990408/1450: Normal Termination.
>DCNLDN[688]: 990408/1450: Number of bulletins read and processed: 287
>DCNLDN[688]: 990408/1450: Shutting Down.
>DCNLDN[1144]: 990408/1455: Starting up.
>DCNLDN[1144]: 990408/1456: Normal Termination.
>DCNLDN[1144]: 990408/1456: Number of bulletins read and processed: 317
>DCNLDN[1144]: 990408/1456: Shutting Down.
>DCNLDN[1755]: 990408/1502: Starting up.
>DCNLDN[1755]: 990408/1502: Normal Termination.
>DCNLDN[1755]: 990408/1502: Number of bulletins read and processed: 301
>DCNLDN[1755]: 990408/1502: Shutting Down.
>DCNLDN[4339]: 990408/1507: Starting up.
>DCNLDN[4339]: 990408/1508: Normal Termination.
>DCNLDN[4339]: 990408/1508: Number of bulletins read and processed: 309
>DCNLDN[4339]: 990408/1508: Shutting Down.
>DCNLDN[4931]: 990408/1514: Starting up.
>DCNLDN[4931]: 990408/1514: Normal Termination.
>DCNLDN[4931]: 990408/1514: Number of bulletins read and processed: 328
>DCNLDN[4931]: 990408/1514: Shutting Down.
>DCNLDN[7522]: 990408/1519: Starting up.
>DCNLDN[7522]: 990408/1525: Normal Termination.
>DCNLDN[7522]: 990408/1525: Number of bulletins read and processed: 590
>DCNLDN[7522]: 990408/1525: Shutting Down.
>DCNLDN[10544]: 990408/1530: Starting up.
>DCNLDN[10544]: 990408/1533: Normal Termination.
>DCNLDN[10544]: 990408/1533: Number of bulletins read and processed: 241
>DCNLDN[10544]: 990408/1533: Shutting Down.
>DCNLDN[13156]: 990408/1537: Starting up.
>DCNLDN[13156]: 990408/1559: Normal Termination.
>DCNLDN[13156]: 990408/1559: Number of bulletins read and processed: 952
>DCNLDN[13156]: 990408/1559: Shutting Down.
>DCNLDN[17664]: 990408/1601: Starting up.
>DCNLDN[17664]: 990408/1605: Normal Termination.
>DCNLDN[17664]: 990408/1605: Number of bulletins read and processed: 187
>DCNLDN[17664]: 990408/1605: Shutting Down.
>DCNLDN[20254]: 990408/1606: Starting up.
>DCNLDN[20254]: 990408/1607: Normal Termination.
>DCNLDN[20254]: 990408/1607: Number of bulletins read and processed: 210
>DCNLDN[20254]: 990408/1607: Shutting Down.
>DCNLDN[20872]: 990408/1612: Starting up.
>DCNLDN[20872]: 990408/1619: Normal Termination.
>DCNLDN[20872]: 990408/1619: Number of bulletins read and processed: 458
>DCNLDN[20872]: 990408/1619: Shutting Down.
>DCNLDN[24187]: 990408/1624: Starting up.
>
>
>
>=========================================================================
>Arthur A. Person
>Research Assistant, System Administrator
>Department of Meteorology
>Penn State
>email:  address@hidden
>phone:  814-863-1563
>=========================================================================
>