[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Support #HDQ-517625]: Assistance requested for "Gap in packet sequence" log entries from noaaportIngester

Hi Gregg,

re:
> Have you ever seen a difference in 1 Byte in products received via one
> noaaportIngester and another noaaportIngester (i.e. see Jay's email
> below)? 

No, but I have to admit that I rarely compare ingest log files on different 
machines
when there is no indication of ingest problems like Gap messages.

re:
> In this case, SBN1 is connected to the NOVRA, SBN2 is in the
> server room and uses media converters to the satellite farm.

> ---------- Forwarded message ---------
> From: Jay Liang - NOAA Federal <address@hidden>
> Date: Thu, Jul 2, 2020 at 2:44 PM
> Subject: Re: [Support #HDQ-517625]: Assistance requested for "Gap in packet
> sequence" log entries from noaaportIngester
> To: Gregory Grosshans <address@hidden>
> Cc: Joseph Byerly - NOAA Federal <address@hidden>
> 
> 
> I noticed something interesting: if you compare all log entries on sbn1 vs.
> sbn2, you will see all of the entries on sbn1 is 1 byte less than the same
> product on sbn2. For example,
> 
> sbn1: ~ldmcp/logs/8.exp.log:
> 
> [root@sbn1 logs]# tailf 8.exp.log
> 20200702T193917.370030Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTG99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215614 size 138840]
> 20200702T193924.580370Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTW01 KNES 021939 inserted [cat 8 
> type 12 ccb 2/0 seq 215615 size 317449]
> 20200702T193925.102590Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTJ99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215616 size 692787]
> 20200702T193934.381563Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215617 size 106567]
> 20200702T193934.453402Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTN99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215618 size 181922]
> 20200702T193934.582174Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTO99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215619 size 97173]
> 20200702T193942.394873Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTD99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215620 size 125479]
> 20200702T193944.580294Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTI99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215621 size 361100]
> 20200702T193944.597316Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTG99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215622 size 145742]
> 20200702T193945.079803Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215623 size 439517]
> 20200702T193952.614826Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTW01 KNES 021939 inserted [cat 8 
> type 12 ccb 2/0 seq 215624 size 397400]
> 20200702T193956.406061Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215625 size 105583]
> 20200702T194000.866426Z noaaportIngester[3137] 
> process_prod.c:process_prod:217     NOTE  IXTD99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215626 size 880463]
> 
> sbn2: ~ldmcp/logs/8.exp.log:
> 
> [root@sbn2 logs]# tailf 8.exp.log
> 20200702T193917.369893Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTG99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215614 size 138841]
> 20200702T193924.580290Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTW01 KNES 021939 inserted [cat 8 
> type 12 ccb 2/0 seq 215615 size 317450]
> 20200702T193925.102650Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTJ99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215616 size 692788]
> 20200702T193934.381574Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215617 size 106568]
> 20200702T193934.453417Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTN99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215618 size 181923]
> 20200702T193934.582110Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTO99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215619 size 97174]
> 20200702T193942.395062Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTD99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215620 size 125480]
> 20200702T193944.580258Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTI99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215621 size 361101]
> 20200702T193944.597261Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTG99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215622 size 145743]
> 20200702T193945.079851Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215623 size 439518]
> 20200702T193952.614860Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTW01 KNES 021939 inserted [cat 8 
> type 12 ccb 2/0 seq 215624 size 397401]
> 20200702T193956.406107Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTH99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215625 size 105584]
> 20200702T194000.866557Z noaaportIngester[4142] 
> process_prod.c:process_prod:217     NOTE  IXTD99 KNES 021939 inserted [cat 5 
> type 12 ccb 2/0 seq 215626 size 880464]
> 
> This is true for all products. I wonder if the network extending from
> satellite farm added 1 additional byte vs direct connect?

This is very interesting indeed.  I'll do a similar comparison among machines 
here
in UCAR/Unidata, LSU/SRCC an UW/SSEC either on Sunday, or, more likely, sometime
on Monday and let you know what I find.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: HDQ-517625
Department: Support NOAAPORT
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.