[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #LFI-210024]: LDM ingesting some products ~30 minutes late and missing others.

Hi Gregg,

> In regards to your detailed response below, a similar issue has cropped up
> again.  Previously/below, you indicated:
> 
> The delay between a downstream notifyme(1) indicating that a data-product
> exists in an upstream LDM's product-queue and the insertion of that product
> into a downstream product-queue can be caused by 1) the upstream LDM
> responsible for transmitting the product being way behind; or 2) the same
> data-product being received from a different upstream LDM site and the
> downstream queue being too-small to reject it because the previous version
> has been eliminated from the queue.
> 
> 
> How does a downstream user, or a LDM user/administrator on the upstream LDM
> determine if condition "1)" exists?  That is how does one check the
> following: "the upstream LDM responsible for transmitting the product being
> way behing"?
> 
> I do NOT believe condition "2)" is valid as there is only one upstream LDM
> site the product is beings retrieved from.

The downstream site could run notifyme(1) -- specifying the upstream site -- 
and compare the initial log message timestamps with the product creation-times. 
For example:

    notifyme -vl- -h <upstream site> |& head

A small time difference means that the products are being inserted into the 
upstream site's product-queue soon after they are created -- which is good. A 
large time difference pushes the problem further upstream. If you see a small 
time difference, then you should check the bandwidth between the upstream and 
downstream sites.

Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: LFI-210024
Department: Support LDM
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.