[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #OAO-858724]: No GOES VIS imagery



Hi Chris,

re:
> Hi, we have been missing GOES VIS imagery since last spring.  My pqact.conf
> entry looks like this:
> 
> # Vis (0.65 um) - Relaxed to account for channel change 3/2014  cch
> UNIWISC ^pnga2area Q. (U[^ACXY13]) (.*) (.*)_IMG (0.6[235])um (.*)
> (........) (....)
> PIPE    -close
> pnga2area -vl logs/ldm-mcidas.log
> -a etc/SATANNOT
> -b etc/SATBAND
> data/ldm/gempak/images/sat/\3/\5/VIS/VIS_\6_\7
> 
> I know there was a change around that time and I made a change to the entry
> as suggested by someone else to account for it.  But still nothing coming
> in - can you help?

Yes, we should be able to help.  I must say that I do not see why
your entry is not resulting in the processing of either GOES-East
or GOES-West VIS images. Let's try a tool that can help sort
out the problem...

The LDM utility 'notifyme' is the most useful tool for coming up with
an extended regular expression to be used either in a ~ldm/etc/ldmd.conf
REQUEST line or in a pattern-action file action.  For instance, run the
following:

notifyme -vl- -f UNIWISC -h idd.unidata.ucar.edu -o 1000000

This will list out all of the Unidata-Wisconsin images received by
the upstream specified in the '-h' (host) selection in the past
1000000 seconds or still in the upstream LDM's queue.  The listing
will look something like:

Aug 01 14:54:43 notifyme[1653] NOTE: Starting Up: idd.unidata.ucar.edu: 
20140721010803.641 TS_ENDT {{UNIWISC,  ".*"}}
Aug 01 14:54:43 notifyme[1653] NOTE: LDM-5 desired product-class: 
20140721010803.641 TS_ENDT {{UNIWISC,  ".*"}}
Aug 01 14:54:43 notifyme[1653] INFO: Resolving idd.unidata.ucar.edu to 
128.117.140.3 took 0.001992 seconds
Aug 01 14:54:43 notifyme[1653] NOTE: NOTIFYME(idd.unidata.ucar.edu): OK
Aug 01 14:54:44 notifyme[1653] INFO:  1018047 20140801134145.601 UNIWISC 000  
pnga2area Q3 U7 1241 GOES-15_IMG 3.9um 4km 20140801 1330
Aug 01 14:54:44 notifyme[1653] INFO:  1204818 20140801134146.276 UNIWISC 000  
pnga2area Q3 U9 121 GOES-15_IMG 0.62um 4km 20140801 1330
Aug 01 14:54:44 notifyme[1653] INFO:   949245 20140801134146.654 UNIWISC 000  
pnga2area Q3 U5 131 GOES-15_IMG 10.7um 4km 20140801 1330
Aug 01 14:54:44 notifyme[1653] INFO:   522047 20140801134146.749 UNIWISC 000  
pnga2area Q3 UB 171 GOES-15_IMG 6.5um 4km 20140801 1330
Aug 01 14:54:44 notifyme[1653] INFO:   817397 20140801134203.728 UNIWISC 000  
pnga2area Q3 U8 1251 GOES-15_IMG 13.3um 4km 20140801 1330
Aug 01 14:54:45 notifyme[1653] INFO:   132539 20140801134504.559 UNIWISC 000  
pnga2area Q0 CA 1100 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:45 notifyme[1653] INFO:  2101832 20140801134525.111 UNIWISC 000  
pnga2area Q0 UN 1290 NP_COMP 3.8um 1km 20140801 1042
Aug 01 14:54:45 notifyme[1653] INFO:   134033 20140801134603.942 UNIWISC 000  
pnga2area Q0 CB 1110 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:45 notifyme[1653] INFO:   131688 20140801134802.911 UNIWISC 000  
pnga2area Q0 CD 1130 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:45 notifyme[1653] INFO:   109594 20140801134902.726 UNIWISC 000  
pnga2area Q0 CE 1140 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:45 notifyme[1653] INFO:   119462 20140801135003.749 UNIWISC 000  
pnga2area Q0 CF 1150 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:46 notifyme[1653] INFO:   963515 20140801135612.053 UNIWISC 000  
pnga2area Q0 UJ 1260 GOES-9_IMG UNKBAND 1km 20140801 1100
Aug 01 14:54:46 notifyme[1653] INFO:   701386 20140801140052.980 UNIWISC 000  
pnga2area Q3 UE 1231 GOES-13_IMG 13.3um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   974287 20140801140057.900 UNIWISC 000  
pnga2area Q3 UW 211 GOES-13_IMG 6.5um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:  1719688 20140801140058.861 UNIWISC 000  
pnga2area Q3 UI 151 GOES-13_IMG 10.7um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:  1728567 20140801140059.531 UNIWISC 000  
pnga2area Q3 UD 1221 GOES-13_IMG 3.9um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   320495 20140801140117.514 UNIWISC 000  
pnga2area Q0 CI 80 GOES-13_IMG 10.7um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   268539 20140801140117.875 UNIWISC 000  
pnga2area Q0 CL 50 GOES-13_IMG 13.3um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   310926 20140801140118.376 UNIWISC 000  
pnga2area Q0 CS 60 GOES-13_IMG 3.9um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   195658 20140801140118.510 UNIWISC 000  
pnga2area Q0 CW 70 GOES-13_IMG 6.5um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:  2530844 20140801140120.804 UNIWISC 000  
pnga2area Q3 UV 141 GOES-13_IMG 0.63um 4km 20140801 1345
Aug 01 14:54:46 notifyme[1653] INFO:   368113 20140801140155.990 UNIWISC 000  
pnga2area Q0 CV 90 GOES-13_IMG 0.63um 4km 20140801 1345
Aug 01 14:54:47 notifyme[1653] INFO: 33721203 20140801140230.519 UNIWISC 000  
pnga2area Q3 EV 1281 GOES-13_IMG 0.63um 1km 20140801 1345
Aug 01 14:54:47 notifyme[1653] INFO:   109594 20140801140402.460 UNIWISC 000  
pnga2area Q0 CE 1140 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:47 notifyme[1653] INFO:  1442695 20140801140402.731 UNIWISC 000  
pnga2area Q0 UO 1300 NP_COMP 12.0um 1km 20140801 1054
Aug 01 14:54:47 notifyme[1653] INFO:  1776750 20140801140421.386 UNIWISC 000  
pnga2area Q0 UH 160 NP_COMP 11.0um 1km 20140801 1000
Aug 01 14:54:47 notifyme[1653] INFO:   119462 20140801140503.614 UNIWISC 000  
pnga2area Q0 CF 1150 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:47 notifyme[1653] INFO:   515774 20140801141144.815 UNIWISC 000  
pnga2area Q1 UB 172 GOES-15_IMG 6.5um 4km 20140801 1400
Aug 01 14:54:47 notifyme[1653] INFO:   937943 20140801141145.782 UNIWISC 000  
pnga2area Q1 U5 132 GOES-15_IMG 10.7um 4km 20140801 1400
Aug 01 14:54:47 notifyme[1653] INFO:  1002241 20140801141146.292 UNIWISC 000  
pnga2area Q1 U7 1242 GOES-15_IMG 3.9um 4km 20140801 1400
Aug 01 14:54:47 notifyme[1653] INFO:  1204089 20140801141146.362 UNIWISC 000  
pnga2area Q1 U9 122 GOES-15_IMG 0.62um 4km 20140801 1400
Aug 01 14:54:47 notifyme[1653] INFO:   805856 20140801141205.292 UNIWISC 000  
pnga2area Q1 U8 1252 GOES-15_IMG 13.3um 4km 20140801 1400
Aug 01 14:54:48 notifyme[1653] INFO:  1574650 20140801141707.395 UNIWISC 000  
pnga2area Q0 CC 1120 COMPOSITE UNKBAND 1km 20140801 0000
Aug 01 14:54:48 notifyme[1653] INFO:   109594 20140801141902.378 UNIWISC 000  
pnga2area Q0 CE 1140 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:48 notifyme[1653] INFO:   119462 20140801142003.471 UNIWISC 000  
pnga2area Q0 CF 1150 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:49 notifyme[1653] INFO:   704497 20140801143051.744 UNIWISC 000  
pnga2area Q1 UE 1232 GOES-13_IMG 13.3um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   974612 20140801143057.749 UNIWISC 000  
pnga2area Q1 UW 212 GOES-13_IMG 6.5um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:  1744036 20140801143058.318 UNIWISC 000  
pnga2area Q1 UD 1222 GOES-13_IMG 3.9um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:  1733873 20140801143058.456 UNIWISC 000  
pnga2area Q1 UI 152 GOES-13_IMG 10.7um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:  2596332 20140801143115.213 UNIWISC 000  
pnga2area Q1 UV 142 GOES-13_IMG 0.63um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   309048 20140801143133.498 UNIWISC 000  
pnga2area Q0 CS 60 GOES-13_IMG 3.9um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   320477 20140801143133.716 UNIWISC 000  
pnga2area Q0 CI 80 GOES-13_IMG 10.7um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   267784 20140801143133.969 UNIWISC 000  
pnga2area Q0 CL 50 GOES-13_IMG 13.3um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   195795 20140801143134.289 UNIWISC 000  
pnga2area Q0 CW 70 GOES-13_IMG 6.5um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   851995 20140801143139.483 UNIWISC 000  
pnga2area Q0 UG 60 NP_COMP 6.7um 1km 20140801 1100
Aug 01 14:54:49 notifyme[1653] INFO:   374700 20140801143150.562 UNIWISC 000  
pnga2area Q0 CV 90 GOES-13_IMG 0.63um 4km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO: 34508196 20140801143228.829 UNIWISC 000  
pnga2area Q1 EV 1282 GOES-13_IMG 0.63um 1km 20140801 1415
Aug 01 14:54:49 notifyme[1653] INFO:   109594 20140801143402.794 UNIWISC 000  
pnga2area Q0 CE 1140 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:49 notifyme[1653] INFO:   119462 20140801143503.688 UNIWISC 000  
pnga2area Q0 CF 1150 GOES-15_SND UNKBAND 1km 20140801 1300
Aug 01 14:54:49 notifyme[1653] INFO:  1011260 20140801144145.527 UNIWISC 000  
pnga2area Q3 U7 1242 GOES-15_IMG 3.9um 4km 20140801 1430
 ...

Looking through this list, we can see that VIS images were received
and have LDM/IDD Product IDs that look like:

GOES-West:

Aug 01 14:54:44 notifyme[1653] INFO:  1204818 20140801134146.276 UNIWISC 000  
pnga2area Q3 U9 121 GOES-15_IMG 0.62um 4km 20140801 1330

GOES-East:

Aug 01 14:54:46 notifyme[1653] INFO:  2530844 20140801140120.804 UNIWISC 000  
pnga2area Q3 UV 141 GOES-13_IMG 0.63um 4km 20140801 1345

GOES-East 1km VIS:

Aug 01 14:54:47 notifyme[1653] INFO: 33721203 20140801140230.519 UNIWISC 000  
pnga2area Q3 EV 1281 GOES-13_IMG 0.63um 1km 20140801 1345

The first thing to note is the product codes for the VIS images:

U9 - GOES West 0.62 um VIS
UV - GOES East 0.63 um VIS
EV - GOES East 0.63 um VIS 1km

The next thing to try is using your extended regular expression as the '-p' 
pattern
in a 'notifyme' invocation to see if it works as intended:

notifyme -vl- -f UNIWISC -h idd.unidata.ucar.edu -o 1000000 -p "^pnga2area Q. 
(U[^ACXY13]) (.*) (.*)_IMG (0.6[235])um (.*) (........) (....)"

Aug 01 15:11:55 notifyme[4233] NOTE: Starting Up: idd.unidata.ucar.edu: 
20140721012515.889 TS_ENDT {{UNIWISC,  "^pnga2area Q. (U[^ACXY13]) (.*) 
(.*)_IMG (0.6[235])um (.*) (........) (....)"}}
Aug 01 15:11:55 notifyme[4233] NOTE: LDM-5 desired product-class: 
20140721012515.889 TS_ENDT {{UNIWISC,  "^pnga2area Q. (U[^ACXY13]) (.*) 
(.*)_IMG (0.6[235])um (.*) (........) (....)"}}
Aug 01 15:11:55 notifyme[4233] INFO: Resolving idd.unidata.ucar.edu to 
128.117.140.3 took 0.001945 seconds
Aug 01 15:11:55 notifyme[4233] NOTE: NOTIFYME(idd.unidata.ucar.edu): OK
Aug 01 15:11:58 notifyme[4233] INFO:  2530844 20140801140120.804 UNIWISC 000  
pnga2area Q3 UV 141 GOES-13_IMG 0.63um 4km 20140801 1345
Aug 01 15:11:58 notifyme[4233] INFO:  1204089 20140801141146.362 UNIWISC 000  
pnga2area Q1 U9 122 GOES-15_IMG 0.62um 4km 20140801 1400
Aug 01 15:11:59 notifyme[4233] INFO:  2596332 20140801143115.213 UNIWISC 000  
pnga2area Q1 UV 142 GOES-13_IMG 0.63um 4km 20140801 1415
Aug 01 15:11:59 notifyme[4233] INFO:  1238835 20140801144145.985 UNIWISC 000  
pnga2area Q3 U9 122 GOES-15_IMG 0.62um 4km 20140801 1430
Aug 01 15:12:05 notifyme[4233] INFO:  2947386 20140801151203.166 UNIWISC 000  
pnga2area Q3 UV 142 GOES-13_IMG 0.63um 4km 20140801 1445
Aug 01 15:14:46 notifyme[4233] INFO:  1413383 20140801151445.521 UNIWISC 000  
pnga2area Q1 U9 123 GOES-15_IMG 0.62um 4km 20140801 1500
 ...

So, your extended regular expression _does_ match the 4 km GOES-East/West VIS
images, so you should be correctly processing them on your system.  Because
of this, I would guess that the problem is on the GEMPAK configuration side
(IF I am remembering correctly that you use GEMPAK).

Request:

- please do a directory listing to see if the VIS images are, in fact, being
  written to your disk:

<as 'ldm'>

ls ~/data/ldm/gempak/images/sat/GOES*/*km/VIS
                                 ^     ^
                                 |     |______ \5 in your extended regular 
expression
                                 |____________ \3 in your extended regular 
expression

By the way, the extended regular expression that you are using does _not_
match the GOES-East 1 km VIS product (product code EV; example Product ID
is listed above), so you may want to make a modification to process those
images also (they are very nice!).

re:
> Thanks,

No worries.  As soon as we see the output from the 'ls' invocation
requested above, we may be able to shed more light into what is
going on.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: OAO-858724
Department: Support IDD
Priority: Normal
Status: Closed