[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #YYF-400085]: ldm files size



Hi Jordi,

re:
> These last days we have some problems with the data download. Some files
> seem to be OK but others have less size than expected:
> 
> -rw-r--r--  1 ldm models 168M Jul  8 08:34 FILE:2016-07-09_00
> > -rw-r--r--  1 ldm models 168M Jul  8 08:35 FILE:2016-07-09_03
> > -rw-r--r--  1 ldm models 168M Jul  8 08:36 FILE:2016-07-09_06
> > -rw-r--r--  1 ldm models 168M Jul  8 08:36 FILE:2016-07-09_09
> > -rw-r--r--  1 ldm models 168M Jul  8 08:37 FILE:2016-07-09_12
> > -rw-r--r--  1 ldm models 168M Jul  8 08:38 FILE:2016-07-09_15
> > -rw-r--r--  1 ldm models 168M Jul  8 08:38 FILE:2016-07-09_18
> > -rw-r--r--  1 ldm models 168M Jul  8 08:39 FILE:2016-07-09_21
> > -rw-r--r--  1 ldm models 168M Jul  8 08:39 FILE:2016-07-10_00
> >
> > *-rw-r--r--  1 ldm models 142M Jul  8 08:40 FILE:2016-07-10_03
> >  -rw-r--r--  1 ldm models 140M Jul  8 08:40 FILE:2016-07-10_06
> >  -rw-r--r--  1 ldm models  41M Jul  8 08:41 FILE:2016-07-10_09
> >  -rw-r--r--  1 ldm models  25M Jul  8 08:41 FILE:2016-07-10_12
> >  -rw-r--r--  1 ldm models  15M Jul  8 08:41 FILE:2016-07-10_15
> >  -rw-r--r--  1 ldm models  14M Jul  8 08:41 FILE:2016-07-10_18*
> >  -rw-r--r--  1 ldm models 168M Jul  8 08:41 FILE:2016-07-10_21
> >
> > *-rw-r--r--  1 ldm models  79M Jul  8 08:42 FILE:2016-07-11_00
> >  -rw-r--r--  1 ldm models  19M Jul  8 08:42 FILE:2016-07-11_03
> >  -rw-r--r--  1 ldm models  41M Jul  8 08:42 FILE:2016-07-11_06
> >  -rw-r--r--  1 ldm models  81M Jul  8 08:42 FILE:2016-07-11_09*
> >
> > -rw-r--r--  1 ldm models 168M Jul  8 08:43 FILE:2016-07-11_12
> > -rw-r--r--  1 ldm models 168M Jul  8 08:43 FILE:2016-07-11_15
> > -rw-r--r--  1 ldm models 168M Jul  8 08:44 FILE:2016-07-11_18
> > -rw-r--r--  1 ldm models 168M Jul  8 08:45 FILE:2016-07-11_21
> > -rw-r--r--  1 ldm models 168M Jul  8 08:45 FILE:2016-07-12_00
> 
> Is it a problem in our system, or it is happening to someone else?

We have had no reports other than yours about missing products in the
CONDUIT datastream.  Also, since the latencies that your machine is
reporting for today (July 8):

http://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_nc?CONDUIT+eady.uib.es

look reasonably low, and since the volumes you are currently receiving
don't appear to be abnormal:

http://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_vol_nc?CONDUIT+eady.uib.es

I assume that the smaller than expected output files for the forecast days/times
that you reported are indicating something on your end.

re:
> I'm attaching the output of notifyme and ldmping, for additional
> information:
> 
> eady:~> notifyme -vl - -h idd.unidata.ucar.edu
> 
> > Jul 08 15:44:06 notifyme[13586] NOTE: Starting Up: idd.unidata.ucar.edu: 
> > 20160708154406.300 TS_ENDT {{ANY,  ".*"}}
> > Jul 08 15:44:06 notifyme[13586] NOTE: LDM-5 desired product-class: 
> > 20160708154406.300 TS_ENDT {{ANY,  ".*"}}
> > Jul 08 15:44:06 notifyme[13586] INFO: Resolving idd.unidata.ucar.edu to 
> > 128.117.140.3 took 0.003003 seconds
> > Jul 08 15:44:06 notifyme[13586] NOTE: NOTIFYME(idd.unidata.ucar.edu): 
> > reclass: 20160708154406.300 TS_ENDT 
> > {{EXP|NXRDSRC|NEXRAD2|NEXRAD3|NPORT|NIMAGE|GEM|FNMOC|GPS|FAA604|DIFAX|NMC|FSL5|FSL4|FSL3|FSL2|UNIDATA|SPARE|0x80000000,
> >  ".*"}}
> > Jul 08 15:44:06 notifyme[13586] NOTE: NOTIFYME(idd.unidata.ucar.edu): OK
> > ^CJul 08 15:44:13 notifyme[13586] NOTE: exiting
> > eady:~>
> > eady:~>
> > eady:~> ldmping idd.unidata.ucar.edu
> > Jul 08 15:44:14 INFO:      State    Elapsed Port   Remote_Host rpc_stat
> > Jul 08 15:44:14 INFO: Resolving idd.unidata.ucar.edu to 128.117.140.3 took 
> > 0.002721 seconds
> > Jul 08 15:44:15 INFO: RESPONDING   0.356209  388   idd.unidata.ucar.edu
> > ^C

The real time stats that your machine is reporting (see the links for latency
and volume for CONDUIT above) seem to indicate that all of the data is making
it into your LDM queue, so the problem is not one of the data being delivered
to you, but, rather, one of it being processed on your end.

re:
> Any advice?

What, if anything, do your LDM log file (~ldm/logs/ldmd.log) indicate?

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: YYF-400085
Department: Support IDD
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.