[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #XDD-957859]: SPECIs not being "seen" by pqsurf.conf?/missing SPECIs in pqact.conf



Gilbert,

Between the 0755Z and 0855Z obs you show below, I have the following received 
here and decoded in GEMPAK
for listing with SFLIST:

  KLTS 110756Z AUTO 31027G32KT 5SM TS -RA FEW003 BKN060 14/09 A3008 RMK AO2 PK 
WND 30032/0755 LTG DSNT S - E RAB0751DZE0751 PRESRR SLP174 $

  KLTS 110802Z 32028G48KT 2 1/2SM TS RA FEW003 BKN065 14/11 A3004 RMK AO2A PK 
WND31048/0758 VIS 1 3/4V5 LTG DSNT S - E RAB0751DZE0751 PRESRR SLP162 $
  
  KLTS 110807Z 33022G63KT 3/4SM R17R/3000FT FC TS +RA FEW003 SCT017 SCT029 
BKN06013/10 A3012 RMK AO2A FUNNEL CLOUD AND WALL CLOUD 4N MOV E

  KLTS 110813Z 33012G63KT 1 1/4SM TS +RA FEW002 SCT006 BKN019 BKN030 BKN060 
13/10A3009 RMK AO2A PK WND 27063/0803 VIS 3/4V4 LTG DSNT SE AND S AND W - NE 
RAB0751D

  KLTS 110816Z 01020G33KT 2SM TSRA SCT006 SCT019 BKN029CB OVC050 13/10 A3006 
RMK AO2A FRQ LTG OHD TS OHD MOV NE PRESRR SLP168 $

  KLTS 110821Z 01020G33KT 2SM TS +RA BKN009 13/10 A3006 RMK AO2A PK WND 
27063/0803 WSHFT 0806 LTG DSNT NW - S RAB0751DZE0751 CLDS LWR RWY17R PRESFR 
SLP166 $

  KLTS 110824Z 04018G33KT 2 1/2SM TSRA SCT009 OVC025CB 13/10 A3005 RMK AO2A 
WSHFT0806 FRQ LTG OHD TS OHD MOV NE $

  KLTS 110807Z COR 33022G63KT 3/4SM R17R/3000FT FC +TSRA FEW003 SCT017 BKN029CB 
BKN060 13/10 A3012 RMK FUNNEL CLOUD AND WALL CLOUD 4N MOV E FRQ LTG 0HD TS OHD 
MOV
  
  KLTS 110825Z 02018G28KT 3SM TS +RA SCT009 12/10 A3005 RMK AO2A PK WND 
27063/0803 WSHFT 0806 LTG DSNT NW - S RAB0751DZE0751 CLDS LWR RWY17R PRESFR 
SLP165 $

  KLTS 110834Z 06017KT 8SM -TSRA FEW007 SCT015 OVC025CB 12/10 A3004 RMK AO2A 
OCNLLTG OHD TS OHD MOVE NE
  

This is quite a bit more than just the 0807 and 0824Z times you mention.

Since you said that your general FILE output where you catch all the ^S[AP] 
products was likewise missing the 1807Z
report, it sounds like either:

1) your output is not keeping up with the data, so that the pqact processing 
cannot act on the
data before it is removed from the queue

2) You have multiple request actions that and not identical or completely 
disjoing such that
any broken connections are confused on the last product received.

If the first item is the issue, then you will see ldmd.log messages with a WARN 
level about
processing oldest product in the queue. If you see that, then data is likely 
getting overwritten before it
gets out of the queue. The solution here is to examing disk IO for slowdowns, 
split up the
pqact.conf processing to multiple processes, and or check your "pqmon" output 
for the age of
the oldest product in the queue and increase the queue size if it is too short. 
The LDM 6.5+ distributions
will log this condition, so you are covered there.

If you don't see the above, then look for disconnect/reconnects and the 
possibility that your
request line patterns contain a subset pattern. send your ldmd.conf request 
lines if
you want me to review those.

Steve Chiswell
Unidata User Support


> Hello Steve et al,
> 
> I guess I am one of the few using this file for a program, but I have a
> question that I hope gets answered.
> 
> Using the current pqsurf.conf that I have, many of the SPECI METARs get 
> ignored
> and are not saved to disk. For example, ALtus AFB (KLTS) had special METARs
> that weren't seen:
> 
> KLTS 110855Z 05013KT 10SM -TSRA SCT020 BKN029CB 12/10 A3004 RMK
> AO2A PK WND 27063/0803 WSHFT 0819 OCNL LTG OHD TS OHD MOV E
> PRESFR RAB0751DZE0751 SLP161 P0067 60077 T01240095 55008
> $=
> KLTS 110755Z AUTO 34018KT 10SM TS -DZ OVC060 14/09 A3001 RMK AO2
> PK WND 01026/0719 LTG DSNT SW - E RAE0727DZB0727 PRESFR
> SLP151 P0005 T01400094 $=
> KLTS 110655Z AUTO 02013KT 5SM TS +RA BKN035 14/10 A3002 RMK AO2
> LTG DSNT NE - SE RAB0612DZB0604E0612 TSB0640 PRESFR SLP156
> P0005 T01370103 $=
> 
> There's an ob at 8:07Z and 8:23Z that simply aren't in the raw METAR database
> file generated by my pqsurf.conf. On the other hand, I see Charleston, SC
> SPECIs are in there:
> 
> KCHS 111056Z 36003KT 3SM BR CLR 08/08 A3021=
> KCHS 111131Z 00000KT 1 3/4SM BR CLR 09/08 A3021 RMK AO2=
> KCHS 111133Z 00000KT 3/4SM BR CLR 09/08 A3021 RMK AO2=
> KCHS 111133Z COR 00000KT 3/4SM BR CLR 09/08 A3021 RMK AO2=
> KCHS 111156Z 36003KT 2 1/2SM BR CLR 08/08 A3021 RMK AO2 SLP230
> T00830078 10106 20072 51012=
> 
> I do strip out the word "SPECI" in my program, but rest assured, in the
> Charleston obs above, they are there in the "inbetween" obs. The KLTS obs are
> in a file a make using the FILE header to save them in a raw file, although I
> did notice that the 8:07Z ob is missing from that file as well.
> 
> Anyone else seeing this? My pqsurf.conf entry is as follows:
> 
> WMO   ^(metar ....|speci ....) ([0-3][0-9])([0-2][0-9])
> FILE  domestic/surface_obs/(\2:yy)(\2:mmm)\2_\3
> 
> My pqact.conf entry, which is getting pretty much all of the SPECIs,
> but not all (missing the 8:07Z Sunday KLTS ob), reads like this:
> 
> WMO     ^S[AP].... .... ([0-3][0-9])([0-2][0-9])
> FILE    /home/data/wxp/rawdata/(\1:yy)(\1:mm)\1\2.sao
> 
> Thoughts?
> 
> *******************************************************************************
> Gilbert Sebenste                                                     ********
> (My opinions only!)                                                  ******
> Staff Meteorologist, Northern Illinois University                      ****
> E-mail: address@hidden                                  ***
> web: http://weather.admin.niu.edu                                      **
> *******************************************************************************
> 
> 


Ticket Details
===================
Ticket ID: XDD-957859
Department: Support LDM
Priority: High
Status: Closed