[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[Support #HDQ-517625]: Assistance requested for "Gap in packet sequence" log entries from noaaportIngester
- Subject: [Support #HDQ-517625]: Assistance requested for "Gap in packet sequence" log entries from noaaportIngester
- Date: Mon, 06 Jul 2020 09:29:19 -0600
Hi Gregg,
Since the NOAAPort ingest machines at UW/SSEC are the only ones that
I have login access to that are logging port 1208 (multicast IP address
224.0.1.8) traffic directly (meaning a separate log file for this traffic),
I did a quick comparison between the two SSEC ingest machines for traffic
for several periods starting around 12 UTC today. Here is a representative
example comparison of one of the time intervals that I looked at:
np1.ssec.wisc.edu - ~ldm/logs/channel8.log
20200706T120003.369202Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTH99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311288 size 103845]
20200706T120009.403141Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTO99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311289 size 98334]
20200706T120012.323347Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTN99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311290 size 191644]
20200706T120013.627893Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTF99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311291 size 1531308]
20200706T120013.673216Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTD99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311292 size 112315]
20200706T120016.427435Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTJ99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311293 size 3274207]
20200706T120016.631650Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTI99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311294 size 241820]
20200706T120041.435319Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTQ99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311295 size 30829517]
20200706T120041.436475Z noaaportIngester[53911]
process_prod.c:process_prod() NOTE IXTG99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311296 size 111540]
np2.ssec.wisc.edu - ~ldm/logs/106_experimental.log
20200706T120003.368784Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTH99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311288 size 103845]
20200706T120009.402709Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTO99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311289 size 98334]
20200706T120012.323013Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTN99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311290 size 191644]
20200706T120013.627893Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTF99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311291 size 1531308]
20200706T120013.673455Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTD99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311292 size 112315]
20200706T120016.428849Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTJ99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311293 size 3274207]
20200706T120016.631426Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTI99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311294 size 241820]
20200706T120041.438143Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTQ99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311295 size 30829517]
20200706T120041.439232Z noaaportIngester[791]
process_prod.c:process_prod() NOTE IXTG99 KNES 061200 inserted [cat 5 type 12
ccb 2/0 seq 311296 size 111540]
The other randomly selected intervals I looked at showed the same result: the
sizes of the same products processed on different machines being fed by
different
Novra S300N receivers that are, in turn, getting their signal from the same
satellite dish (4.5m Pioneer non-tracking dish) and being ingested by
the same version of the LDM (v6.13.7) were the same.
Here is a comparison of a 5-second time period starting at 12 UTC for ingest
on two UCAR/Unidata machines both of which are logging ports 1205, 1208,
1209 and 1210 traffic in the same log file:
leno.unidata.ucar.edu - /data/tmp/nother.log
20200706T120000.245068Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS03 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651492 size 263454]
20200706T120000.669410Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS08 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651493 size 733887]
20200706T120000.858468Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR04 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830941 size 98913]
20200706T120000.916674Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR01 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830942 size 164587]
20200706T120000.933050Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR06 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830943 size 71009]
20200706T120001.099358Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR03 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830944 size 333886]
20200706T120001.168401Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS11 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651494 size 879592]
20200706T120001.331972Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR05 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830945 size 356503]
20200706T120001.473143Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS12 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651495 size 847968]
20200706T120002.166357Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS07 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651496 size 1025350]
20200706T120002.461545Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS10 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651497 size 728928]
20200706T120002.489318Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS01 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651498 size 187347]
20200706T120002.722827Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS05 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651499 size 330726]
20200706T120002.911800Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR11 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830946 size 347638]
20200706T120003.091105Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR10 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830947 size 287463]
20200706T120003.177564Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS07 KNES 061150 PAD inserted [cat
8 type 9 ccb 2/0 seq 1651500 size 705508]
20200706T120003.325353Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR14 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830948 size 344237]
20200706T120003.364414Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR12 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830949 size 287771]
20200706T120003.367479Z noaaportIngester[2390]
process_prod.c:process_prod:217 NOTE IXTH99 KNES 061200 inserted [cat 5
type 12 ccb 2/0 seq 311288 size 103845]
20200706T120003.593802Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR13 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830950 size 342436]
20200706T120003.673032Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS14 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651501 size 867795]
20200706T120003.828442Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR16 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830951 size 298998]
20200706T120003.858484Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR07 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830952 size 270480]
20200706T120003.952719Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS09 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651502 size 755639]
20200706T120004.079407Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR09 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830953 size 219795]
20200706T120004.118030Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR15 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830954 size 347319]
20200706T120004.379792Z noaaportIngester[2388]
process_prod.c:process_prod:217 NOTE TIUR08 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830955 size 231816]
20200706T120004.450893Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS16 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651503 size 801472]
20200706T120004.702356Z noaaportIngester[2387]
process_prod.c:process_prod:217 NOTE TIRS06 KNES 061150 PAD inserted [cat
8 type 9 ccb 2/0 seq 1651504 size 593072]
uni14.unidata.ucar.edu - /data/tmp/nother.log
20200706T120000.246383Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS03 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651492 size 263454]
20200706T120000.670372Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS08 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651493 size 733887]
20200706T120000.859769Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR04 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830941 size 98913]
20200706T120000.917821Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR01 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830942 size 164587]
20200706T120000.934018Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR06 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830943 size 71009]
20200706T120001.100197Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR03 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830944 size 333886]
20200706T120001.170796Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS11 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651494 size 879592]
20200706T120001.371988Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR05 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830945 size 356503]
20200706T120001.474213Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS12 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651495 size 847968]
20200706T120002.167626Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS07 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651496 size 1025350]
20200706T120002.462672Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS10 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651497 size 728928]
20200706T120002.490304Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS01 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651498 size 187347]
20200706T120002.724992Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS05 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651499 size 330726]
20200706T120002.913002Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR11 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830946 size 347638]
20200706T120003.092572Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR10 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830947 size 287463]
20200706T120003.178887Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS07 KNES 061150 PAD inserted [cat
8 type 9 ccb 2/0 seq 1651500 size 705508]
20200706T120003.326760Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR14 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830948 size 344237]
20200706T120003.365442Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR12 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830949 size 287771]
20200706T120003.368701Z noaaportIngester[26456]
process_prod.c:process_prod:217 NOTE IXTH99 KNES 061200 inserted [cat 5
type 12 ccb 2/0 seq 311288 size 103845]
20200706T120003.595022Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR13 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830950 size 342436]
20200706T120003.674287Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS14 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651501 size 867795]
20200706T120003.830023Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR16 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830951 size 298998]
20200706T120003.859538Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR07 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830952 size 270480]
20200706T120003.953989Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS09 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651502 size 755639]
20200706T120004.080495Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR09 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830953 size 219795]
20200706T120004.119049Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR15 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830954 size 347319]
20200706T120004.381213Z noaaportIngester[26454]
process_prod.c:process_prod:217 NOTE TIUR08 KNES 061159 PAA inserted [cat
3 type 10 ccb 2/0 seq 1830955 size 231816]
20200706T120004.452246Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS16 KNES 061150 PAC inserted [cat
8 type 9 ccb 2/0 seq 1651503 size 801472]
20200706T120004.703312Z noaaportIngester[26453]
process_prod.c:process_prod:217 NOTE TIRS06 KNES 061150 PAD inserted [cat
8 type 9 ccb 2/0 seq 1651504 size 593072]
The setup on the two UCAR/Unidata ingest machines are much the same: both are
running LDM v6.13.11, each is being fed from a different Novra S300N, and
both of the Novra S300Ns are being fed from the same NWS standard NOAAPort
downlink which includes a 3.8m solid dish, a signal path of about 100' of
quad shielded RG-6 coax cable, a signal amplifier, a ChannelMaster 8-port
signal splitter (of which 4 ports are used and the others capped), and
the path from each Novra S300N is fed into a separate 24-port, rackmount
Gbps switch to which are connected one or more Linux or Solaris machines
running current or new, test versions of the LDM.
As you can see from the listing, the sizes of the same products being processed
by the two UCAR/Unidata machines are the same. Moeover, the sizes of the same
product shown in all 4 listings is also identical:
20200706T120003.368701Z noaaportIngester[26456]
process_prod.c:process_prod:217 NOTE IXTH99 KNES 061200 inserted [cat 5
type 12 ccb 2/0 seq 311288 size 103845]
My conclusion is that the product size differences that you emailed us about
earlier is somehow an artifact of the setup at NOAA/SCD.
Cheers,
Tom
--
****************************************************************************
Unidata User Support UCAR Unidata Program
(303) 497-8642 P.O. Box 3000
address@hidden Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage http://www.unidata.ucar.edu
****************************************************************************
Ticket Details
===================
Ticket ID: HDQ-517625
Department: Support NOAAPORT
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata
inquiry tracking system and then made publicly available through the web. If
you do not want to have your interactions made available in this way, you must
let us know in each email you send to us.
