Re: [ldm-users] Receipt of "duplicated" products over the IDD with some debugging string attached to the end of the product

  • To: Gilbert Sebenste <gilbert@xxxxxxxxxxxxxxxx>, "Wojtowicz, David P Jr" <davidw@xxxxxxxxxxxx>
  • Subject: Re: [ldm-users] Receipt of "duplicated" products over the IDD with some debugging string attached to the end of the product
  • From: "Herzmann, Daryl E [AGRON]" <akrherz@xxxxxxxxxxx>
  • Date: Fri, 4 Mar 2022 19:04:06 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=iastate.edu; dmarc=pass action=none header.from=iastate.edu; dkim=pass header.d=iastate.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=RAe1QwFY7n6c8OLqRZt1YV0xlyTMkDRSuwlRi/P9WU8=; b=RtwobaQ3ADCR8NU7kFQoftx1LN4+RrFODe5TVPX6YrCb9/h5RHY43qMRz7Hv78WOOqbK1K9aRZvN5kJ3Dq1bVxUn4XicYTq2wSQ6fOS4cwZG3TnLHjy9AmeG1xWvo6srGpSMtlKQwwBgH2VP/5fgxvTSQM3B4bh9QqbGT/L0QZUU5dY5zjvbOq2iQJy35NtoqySuumTl4Te+iIGH9hPwKLGlMlmbN+ElQVwbYFNlFq3fZiluPxxO5zONIFFxElckUg2HZZawGXv4gTGYeI6R/iQvwVzteFkvxTughPWUebYuvjvXpVgvoyRqz5z3eUe2zQ32e400gT5eSoZGlRUwwg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=C13XQ3XDQQ18TyZZd+ws1NfoIgZZqg3pD6b6AjDEzI9N0PCwjixaCvFyF0Qx+vdlTWGpapC6ojGq3ee/TSYAKKbGwHskz+Vzs9w4Qbyiiwzy0mvtqP1hreX0aYXNAPZAjAfSzy2Df4GB6meETBhpBjA7vKOg6cgmuCIdg099o6bySZxjs5VUp+LyV//jTURdYmceIBFfXyxjq6lT426fyAq74a39xQSZLshFyBQ3nGvvDvmOjZVQoeujqSA5gjmSLJFU7X0WmnmcEVMoq2MkLH58Uet87cpMdTFA/PcK8F++jMQbINaS/dBLTEXYNA+g6BXbAxXE+FhTSPXoEiHlmg==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=iastate.edu;
  • Suggested_attachment_session_id: 96116538-1dbd-9d55-78e5-70afb1c0ea11
Greetings,

The issue has been found with a weatherwire ingest into the IDD, hopefully it 
gets removed before tomorrow :)  In the interim, look for the \017 character 
and drop those products / dedup them against the noaaport content.  That 
doesn't catch them all, but most of it.

daryl

________________________________________
From: ldm-users <ldm-users-bounces@xxxxxxxxxxxxxxxx> on behalf of Gilbert 
Sebenste <gilbert@xxxxxxxxxxxxxxxx>
Sent: Friday, March 4, 2022 12:58 PM
To: Wojtowicz, David P Jr
Cc: ldm-users@xxxxxxxxxxxxxxxx
Subject: Re: [ldm-users] Receipt of "duplicated" products over the IDD with 
some debugging string attached to the end of the product

True, but they may have been doing additional testing related to this. When 
they did the testing last week, they had some significant issues…

Gilbert

On Mar 4, 2022, at 12:42 PM, Wojtowicz, David P Jr <davidw@xxxxxxxxxxxx> wrote:


Changing the underlying network shouldn't cause duplicated products.  (For 
example, the network equipment knows nothing about the data headers and would 
have no possible way of producing the extra strings)

From: ldm-users <ldm-users-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Gilbert 
Sebenste
Sent: Friday, March 4, 2022 11:59 AM
To: Mike Zuranski <zuranski.wx@xxxxxxxxx>
Cc: ldm-users@xxxxxxxxxxxxxxxx
Subject: Re: [ldm-users] Receipt of "duplicated" products over the IDD with 
some debugging string attached to the end of the product

NCEP was testing their network routers and related activities this morning.

NOUS42 KWNO 041141
ADASDM

SENIOR DUTY METEOROLOGIST NWS ALERT ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1141Z FRI MAR 04 2022

..SCHEDULED NCWCP NETWORK MAINTENANCE TODAY

WHAT: NCO WILL BE PERFORMING A FAILOVER TEST ON THE ROUTERS
LOCATED AT COLLEGE PARK/NCWCP.

WHEN: FRIDAY, MARCH 4, 2022 BETWEEN 1200Z AND 1400Z.

IMPACTS: WFOS/RFCS/RHQS/CWSUS/NWR/CENTERS/WCOSS-I&II MAY
EXPERIENCE TWO BRIEF (3-5) MINUTES OUTAGE AT THE START AND END OF
THE MAINTENANCE WINDOW WHILE TRAFFIC GETS AUTO REROUTED BACK AND
FORTH BETWEEN PRIMARY AND SECONDARY PATHS DURING THIS FAILOVER
TEST.

PUBLIC ACCESS TO NWS WEBSITES INCLUDING IDP AND NIDS WILL NOT BE
IMPACTED.

LIDDICK/SDM/NCO/NCEP


Gilbert

On Fri, Mar 4, 2022 at 11:18 AM Mike Zuranski 
<zuranski.wx@xxxxxxxxx<mailto:zuranski.wx@xxxxxxxxx>> wrote:
I can confirm that double product looks the same for me, complete with 
LOX-846094 at the end of the second.  I'm not sure which site was feeding that 
at the time though.

-Mike

======================
Mike Zuranski
Meteorology Support Analyst
College of DuPage - Nexlab
Weather.cod.edu<https://urldefense.com/v3/__http:/weather.cod.edu/__;!!DZ3fjg!o1bK4FJaMKZ5_t1qEkELlilHYevjZtBWwmCexGZCYVOlLAXVgqyWlw_XQSV1LFAZhg$>
======================


On Fri, Mar 4, 2022 at 11:05 AM Herzmann, Daryl E [AGRON] 
<akrherz@xxxxxxxxxxx<mailto:akrherz@xxxxxxxxxxx>> wrote:
Greetings,

Over the past couple of hours, I have noticed a problem with product text over 
IDD including what appears to be a debug tag at the end of the product.  For 
example:

WWUS76 KLOX 041650

Came at 2022-03-04T16:50:36Z with 2026 bytes and again at 2022-03-04T16:50:38Z 
at 2038 bytes.  The second product had the following at the end of the text:

&&

$$
 LOX-846094

That "LOX-846094" appears to be some debugging string with the transmission of 
the product?  Looking at the my IDD logging, I see:

wxengine4.fox.com<https://urldefense.com/v3/__http:/wxengine4.fox.com__;!!DZ3fjg!o1bK4FJaMKZ5_t1qEkELlilHYevjZtBWwmCexGZCYVOlLAXVgqyWlw_XQSVerSLGBg$>

as the ingest source of this product.  Anybody know anything about this?

daryl



_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


ldm-users mailing list
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe,  visit: 
https://www.unidata.ucar.edu/mailing_lists/<https://urldefense.com/v3/__https:/www.unidata.ucar.edu/mailing_lists/__;!!DZ3fjg!o1bK4FJaMKZ5_t1qEkELlilHYevjZtBWwmCexGZCYVOlLAXVgqyWlw_XQSXzKCu6Bw$>
_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


ldm-users mailing list
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe,  visit: 
https://www.unidata.ucar.edu/mailing_lists/<https://urldefense.com/v3/__https:/www.unidata.ucar.edu/mailing_lists/__;!!DZ3fjg!o1bK4FJaMKZ5_t1qEkELlilHYevjZtBWwmCexGZCYVOlLAXVgqyWlw_XQSXzKCu6Bw$>


--
----

Gilbert Sebenste
Consulting Meteorologist
AllisonHouse, LLC
_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


ldm-users mailing list
ldm-users@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
https://www.unidata.ucar.edu/mailing_lists/
  • 2022 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: