[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #NTD-472266]: Excessive loading of data in bundles

> > Yuan:
> >
> > I had a chance to try the nightly build today. I'm still seeing the
> > same problem with the attached bundle.  It keeps loading and reloading
> > fields before finally plotting frontogenesis after a considerable wait.
> >
> > Jim
> >
> >
> 
> Jim,
> I can see the problem when I tried this bundle at home during the weekend. 
> Likely, the speed of network in my office covers up the problem.
> 
> I will look into it.
> 
> 
> Yuan

Jim,
     What is the correct procedure to calculate the frnt?   I called this 
function frnt, and input potential temperature and wind vector, it looks 
different from
yours in the bundle. Do I need to calculate the theta?

Yuan
> >
> > On 7/22/15 10:53 AM, Unidata IDV Support wrote:
> > >> Yuan:
> > >>
> > >> These are new bundles.  I've abandoned all the old ones and have
> > >> been developing new ones this summer to take advantage of time-matching
> > >> and subsetting abilities in the IDV, as well as the better THREDDS
> > >> capabilities.  Much of this has gone really well, but I've been
> > >> reporting some of the hiccups I've encountered.
> > >>
> > >> The new bundles are in
> > >> http://weather.utah.edu/synoptic/idv/Site_Config/bundles/Real-Time-WX/.
> > >> Skip those in the Diagnostics directory as those I haven't updated yet
> > >> because of the problem noted below.
> > >>
> > >> Jim
> > > Jim,
> > >         I will check in the fixed for the bug and you should be able to 
> > > get the nightly earlier this afternoon.
> > >         This bug is related to the setting time driver in the animation 
> > > widget.
> > >         I tried your bundle and the timing seems right to me even though 
> > > you will still seeing
> > > reading data for many times, those message might not be corrected. I set 
> > > the break point for the data
> > > reload, and make sure only happen one time at the beginning.
> > >
> > >
> > > Yuan
> > >>
> > >>
> > >> On 7/20/15 4:03 PM, Unidata IDV Support wrote:
> > >>>> I'm not sure what you mean by old bundle.  If you mean
> > >>>> Frontogenesis-OnlyFr.xidv, yes, that is the one I am working with.
> > >>>>
> > >>> Jim,
> > >>>           I thought you were modifying your old bundles. But, I believe 
> > >>> I know what went wrong now.
> > >>> The problem is that the IDV don't have the subset information when 
> > >>> calling these diagnostic function. Those
> > >>> subset information including the time matching, are hiding in its 
> > >>> parameters and the parameters can be derived
> > >>> itself. So, some of the logic must be wrong in the current release. I 
> > >>> will find a solution asap.
> > >>>
> > >>>
> > >>> Yuan
> > >>>> We need to find a way to hunt down the source of this problem. Bundles
> > >>>> are especially important for more complex, integrated analysis,
> > >>>> including diagnostics like frontogenesis.  To have to try and create
> > >>>> such an analysis by hand each time would be extremely time consuming.
> > >>>>
> > >>>> Jim
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> On 7/20/15 3:11 PM, Unidata IDV Support wrote:
> > >>>>>> Yuan:
> > >>>>>>
> > >>>>>> Yes, your bundle works fine.  It loads the fields once and then
> > >>>>>> plots it.
> > >>>>>>
> > >>>>>> However, when I load the bundle that I sent you (attached - note
> > >>>>>> that the name OnlyFr means I'm not plotting other additional
> > >>>>>> frontogenesis diagnostics, this bundle is meant to plot frontogenesis
> > >>>>>> along with several other fields and images), it still is loading t
> > >>>>>> fields many times over and over and it takes an inordinate amount of
> > >>>>>> time to plot the frontogenesis.  Have you tried this bundle?  Watch 
> > >>>>>> how
> > >>>>>> many times it loads temperature and u/v.
> > >>>>>>
> > >>>>>> Jim
> > >>>>>>
> > >>>>> Jim,
> > >>>>>         I did try your bundle and saw the same problem, I don't know 
> > >>>>> what causes these multiple reloads. Are you working on the old bundle?
> > >>>>>
> > >>>>> Yuan
> > >>>>>> On 7/20/15 2:52 PM, Unidata IDV Support wrote:
> > >>>>>>>>> Hi:
> > >>>>>>>>>
> > >>>>>>>>> I've been working on some bundles that include frontogenesis
> > >>>>>>>>> calculated in IDV using the FRNT function (derived from gempak) 
> > >>>>>>>>> using
> > >>>>>>>>> potential temperature and wind vectors on an isobaric surface.
> > >>>>>>>>>
> > >>>>>>>>> When I plot frontogesis directly in IDV, it loads up those fields
> > >>>>>>>>> and does the calculations in a reasonable amount of time. 
> > >>>>>>>>> However, if I
> > >>>>>>>>> then save to a bundle, and reload the bundle, it loads those 
> > >>>>>>>>> fields many
> > >>>>>>>>> times and takes an excessive amount of time to plot.  The attached
> > >>>>>>>>> bundle should illustrate the problem.  It will load in several 
> > >>>>>>>>> fields,
> > >>>>>>>>> but then hit a wall as it loads and reloads potential temperature 
> > >>>>>>>>> and
> > >>>>>>>>> wind components over an extended period of time before finally 
> > >>>>>>>>> plotting
> > >>>>>>>>> frontogenesis.
> > >>>>>>>>>
> > >>>>>>>>> Jim
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>> Jim,
> > >>>>>>>> I tried to reproduce your problem from scratch and no luck. The 
> > >>>>>>>> attached bundle uses the time matching and only
> > >>>>>>>> calls the frnt function, everything works as expected. Could you 
> > >>>>>>>> give it a try ?
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> Yuan
> > >>>>>>> Sorry I forgot the bundle.
> > >>>>>>>
> > >>>>>>> Yuan
> > >>>>>>>
> > >>>>>>> Ticket Details
> > >>>>>>> ===================
> > >>>>>>> Ticket ID: NTD-472266
> > >>>>>>> Department: Support IDV
> > >>>>>>> Priority: Normal
> > >>>>>>> Status: Open
> > >>>>> Ticket Details
> > >>>>> ===================
> > >>>>> Ticket ID: NTD-472266
> > >>>>> Department: Support IDV
> > >>>>> Priority: Normal
> > >>>>> Status: Open
> > >>>>>
> > >>> Ticket Details
> > >>> ===================
> > >>> Ticket ID: NTD-472266
> > >>> Department: Support IDV
> > >>> Priority: Normal
> > >>> Status: Open
> > >>>
> > >>
> > >
> > > Ticket Details
> > > ===================
> > > Ticket ID: NTD-472266
> > > Department: Support IDV
> > > Priority: Normal
> > > Status: Closed
> > >
> >
> >
> >
> 


Ticket Details
===================
Ticket ID: NTD-472266
Department: Support IDV
Priority: Normal
Status: Open