[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[netCDFJava #ZMD-614767]: BUFR data does not work with a recent ncIdv.jar



Great - I grabbed a copy of the files and will look later today to see if I can
figure something out.

Thanks Bob!

Sean

> Hi Sean,
> 
> Thanks for the quick response!  I put 4 files on our anonymous ftp on
> the chance that things behave differently from file to file:
> 
> * ftp://ftp.ssec.wisc.edu/pub/incoming/GOESE.CDFTWIND.D2015196.T150304Z.bufr
> * 
> ftp://ftp.ssec.wisc.edu/pub/incoming/MSG2-SEVI-MSGTOZN-0000-0000-20110201194500.000000000Z-996938.bfr
> * ftp://ftp.ssec.wisc.edu/pub/incoming/AMDARUA.4.0.11310048.1414.bufr4
> * ftp://ftp.ssec.wisc.edu/pub/incoming/DOPPLER.6.1.2018150.1443.bufr4
> 
> These files will be there for a week before they are automatically
> removed, so let me know if you need me to re-post them.  These files
> used to work in McIDAS-V and the IDV when netCDF 4.3.17 was used, and
> broke when we updated to 4.3.18.
> 
> If there's anything else you need, let me know.
> 
> Thanks again!
> Bob
> 
> On 6/5/2018 2:06 PM, Unidata netCDF Java Support wrote:
> > Greetings Bob!
> >
> > Oh boy, an oldie but goodie. We no longer run the jira instance, and 
> > migrated
> > many of the old issues over to github, but it looks like that one didn’t 
> > make it
> > over. Do you have a sample of a problematic BUFR file we could checkout?
> >
> > The BUFR code was rewritten a few years back before John left, and from what
> > I understand, the old code made quite a few improper assumptions about how
> > to represent the data as a netCDF-Java dataset object. The new code removed
> > a lot of those assumptions, and many BUFR files became unreadable.
> >
> > If you have a sample, I’ll take a look and hopefully we can knock this 
> > oldie out.
> >
> > Cheers,
> >
> > Sean
> >
> >> Hello,
> >>
> >> This is a pretty old ticket, but we have still been getting questions
> >> from our users on a pretty regular basis about why BUFR data doesn't
> >> work in the IDV or McIDAS-V.  In particular, we just got this specific
> >> question from one of our NASA users:
> >>
> >>> For the issue with the BUFR files no longer work with McV, do you
> >>> think it may have to do with the CDL (Common Data Language) files that
> >>> describe the netCDF objects?  Do those need to be updated if the
> >>> netCDF file format changes?
> >> I was hopeful that the bug tracking ticket may have some specifics on
> >> the problem that we could point users to, but the link from the
> >> 01/21/2014 email below
> >> (https://bugtracking.unidata.ucar.edu/browse/TDS-527) no longer works.
> >> Is there an active ticket for this problem?  I tried digging around but
> >> I haven't been able to find one.
> >>
> >> Thanks!
> >> Bob Carp
> >>
> >> On 5/21/2014 2:45 PM, Unidata netCDF Java Support wrote:
> >>> Hi Bob:
> >>>
> >>> Sorry, not yet.
> >>>
> >>> John
> >>>
> >>>> Hi again -
> >>>>
> >>>> Just following up on this.  We had another user come to us with a BUFR
> >>>> file and that reminded me that you still can't display any BUFR data in
> >>>> McIDAS-V or the IDV (you get an NPE involving
> >>>> 'CoordVarExtractorVariable' being missing... full error written out
> >>>> below in a previous email).
> >>>>
> >>>> Are there any status updates on this that we can pass off to our users?
> >>>>
> >>>> Thanks!
> >>>> Bob Carp
> >>>>
> >>>> On 4/3/2014 9:02 PM, Unidata netCDF Java Support wrote:
> >>>>> Hi Bob
> >>>>>
> >>>>> Still havent got to this. sorry,
> >>>>>
> >>>>> John
> >>>>>
> >>>>>> Hello -
> >>>>>>
> >>>>>> We had another user asking about using BUFR data in McIDAS-V.  We were
> >>>>>> wondering what the status of this ticket is, are there any updates?
> >>>>>>
> >>>>>> Thanks!
> >>>>>> Bob Carp
> >>>>>> McIDAS Help Desk
> >>>>>>
> >>>>>> On 1/21/2014 10:01 AM, Unidata netCDF Java Support wrote:
> >>>>>>> Greetings!
> >>>>>>>
> >>>>>>> I wanted to pass along the link to the bug tracking ticket for this 
> >>>>>>> item:
> >>>>>>>
> >>>>>>> https://bugtracking.unidata.ucar.edu/browse/
> >>>>>>> I'll see if I can get an ETA about a fix and update the ticket.
> >>>>>>>
> >>>>>>> Cheers,
> >>>>>>>
> >>>>>>> Sean
> >>>>>>>
> >>>>>>>> Hello -
> >>>>>>>>
> >>>>>>>> Here's the email that I sent to address@hidden and
> >>>>>>>> cc'd you on (sent 10/10/13).  Also, here's the Ticket that got sent 
> >>>>>>>> back.
> >>>>>>>>
> >>>>>>>>> McIDAS Help Desk,
> >>>>>>>>>
> >>>>>>>>> Your Ticket has been received, and a Unidata staff member will 
> >>>>>>>>> review it and reply accordingly. Listed below are details of this 
> >>>>>>>>> new Ticket. Please make sure the Ticket ID remains in the Subject: 
> >>>>>>>>> line on all correspondence related to this Ticket.
> >>>>>>>>>
> >>>>>>>>>          Ticket ID: XKK-684884
> >>>>>>>>>          Subject: BUFR data does not work with a recent ncIdv.jar
> >>>>>>>>>          Department: Support netCDF Java
> >>>>>>>>>          Priority: Normal
> >>>>>>>>>          Status: Open
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> Please let us know how we can assist you further.
> >>>>>>>>>
> >>>>>>>>> Unidata User Support
> >>>>>>>> Thanks!
> >>>>>>>> Bob
> >>>>>>>>
> >>>>>>>> On 10/10/2013 11:27 AM, McIDAS Help Desk wrote:
> >>>>>>>>> Hello -
> >>>>>>>>>
> >>>>>>>>> A user reported to us that he cannot load in BUFR data into McIDAS-V
> >>>>>>>>> using our most recent release (also cannot load into the last stable
> >>>>>>>>> IDV 4.1).  The error when creating the display is "Creating obs
> >>>>>>>>> java.lang.NullPointerException" with the stack trace at the bottom 
> >>>>>>>>> of
> >>>>>>>>> this email.  This BUFR data did work correctly in our last McIDAS-V
> >>>>>>>>> 1.3 release which used ncIdv.jar with netCDF version 4.3.16.  Our
> >>>>>>>>> current version (1.4) uses ncIdv.jar with netCDF version 4.3.18.  I
> >>>>>>>>> found a location online to pick up a ncIdv.jar file with netCDF
> >>>>>>>>> version 4.3.17 and the BUFR data worked fine with this version.
> >>>>>>>>>
> >>>>>>>>> Summary:
> >>>>>>>>> - BUFR data is working with ncIdv.jars using netCDF 4.3.16 and 
> >>>>>>>>> 4.3.17
> >>>>>>>>> - BUFR data is not working with an ncIdv.jar using netCDF 4.3.18
> >>>>>>>>> - I've attached a sample BUFR file that you can use for testing
> >>>>>>>>>
> >>>>>>>>> Any thoughts as to what may have changed between 4.3.17 and 4.3.18
> >>>>>>>>> that causes BUFR data to no longer work correctly?
> >>>>>>>>>
> >>>>>>>>> Thanks -
> >>>>>>>>> Bob Carp
> >>>>>>>>> McIDAS User Services
> >>>>>>>>>
> >>>>>>>>>> java.lang.NullPointerException
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.standard.NestedTable$CoordVarExtractorVariable.isMissing(NestedTable.java:234)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.standard.CoordVarExtractor.isMissing(CoordVarExtractor.java:88)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.standard.NestedTable.isTimeMissing(NestedTable.java:536)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.standard.StandardPointFeatureIterator.isMissing(StandardPointFeatureIterator.java:77)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.standard.StandardPointFeatureIterator.makeFeature(StandardPointFeatureIterator.java:69)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.nc2.ft.point.PointIteratorFromStructureData.hasNext(PointIteratorFromStructureData.java:70)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.PointObFactory.makePointObs(PointObFactory.java:1882)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.NetcdfPointDataSource.makeObs(NetcdfPointDataSource.java:360)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.NetcdfPointDataSource.makeObs(NetcdfPointDataSource.java:322)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.PointDataSource.getDataInner(PointDataSource.java:1297)
> >>>>>>>>>>         at 
> >>>>>>>>>> ucar.unidata.data.DataSourceImpl.getData(DataSourceImpl.java:2379)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.DirectDataChoice.getData(DirectDataChoice.java:332)
> >>>>>>>>>>         at 
> >>>>>>>>>> ucar.unidata.data.DataChoice.getData(DataChoice.java:637)
> >>>>>>>>>>         at 
> >>>>>>>>>> ucar.unidata.data.DataInstance.getData(DataInstance.java:243)
> >>>>>>>>>>         at 
> >>>>>>>>>> ucar.unidata.data.DataInstance.getData(DataInstance.java:207)
> >>>>>>>>>>         at 
> >>>>>>>>>> ucar.unidata.data.DataInstance.dataOk(DataInstance.java:295)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.PointDataInstance.init(PointDataInstance.java:83)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.data.point.PointDataInstance.<init>(PointDataInstance.java:69)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.ObsDisplayControl.doMakeDataInstance(ObsDisplayControl.java:796)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.DisplayControlImpl.initializeDataInstance(DisplayControlImpl.java:3224)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.DisplayControlImpl.setData(DisplayControlImpl.java:3206)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.ObsListControl.setData(ObsListControl.java:438)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.ObsListControl.init(ObsListControl.java:151)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.DisplayControlImpl.init(DisplayControlImpl.java:1421)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.control.DisplayControlImpl.init(DisplayControlImpl.java:1106)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.ControlDescriptor.initControl(ControlDescriptor.java:986)
> >>>>>>>>>>         at
> >>>>>>>>>> ucar.unidata.idv.ControlDescriptor$1.run(ControlDescriptor.java:911)
> >>>>>>>>>>         at ucar.unidata.util.Misc$3.run(Misc.java:1251)
> >>>>>>> Ticket Details
> >>>>>>> ===================
> >>>>>>> Ticket ID: ZMD-614767
> >>>>>>> Department: Support netCDF Java
> >>>>>>> Priority: Critical
> >>>>>>> Status: Open
> >>>>>>>
> >>>>> Ticket Details
> >>>>> ===================
> >>>>> Ticket ID: ZMD-614767
> >>>>> Department: Support netCDF Java
> >>>>> Priority: Critical
> >>>>> Status: Open
> >>>>>
> >>> Ticket Details
> >>> ===================
> >>> Ticket ID: ZMD-614767
> >>> Department: Support netCDF Java
> >>> Priority: Critical
> >>> Status: Closed
> >>>
> >>
> >>
> >
> > Ticket Details
> > ===================
> > Ticket ID: ZMD-614767
> > Department: Support netCDF Java
> > Priority: Critical
> > Status: Open
> > ===================
> > NOTE: All email exchanges with Unidata User Support are recorded in the 
> > Unidata inquiry tracking system and then made publicly available through 
> > the web.  If you do not want to have your interactions made available in 
> > this way, you must let us know in each email you send to us.
> >
> >
> 
> 
> 


Ticket Details
===================
Ticket ID: ZMD-614767
Department: Support netCDF Java
Priority: Critical
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.