[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[THREDDS #YBV-904566]: Thredds crashes on request for huge netcdf4 file

Hi Rostislav,

First thing's first: I notice that you're using old versions of TDS, libnetcdf, 
etc. I recommend that you upgrade, as we generally lack the resources to 
provide support for anything other than the latest versions. In particular, I 
notice that you're using libnetcdf v4.1.1, but we require version 4.3.1 or 
above in order to interface with TDS.

https://www.unidata.ucar.edu/software/thredds/current/netcdf-java/reference/netcdf4Clibrary.html

Also, I see that the problematic stack frame is [libhdf5.so.6+0x209cba]. So, 
it's best to update libhdf5 as well.

Incidentally, I notice you're getting a lot of warnings of the form:

Sep 19, 2017 8:12:47 AM java.util.prefs.FileSystemPreferences syncWorld
WARNING: Couldn't flush user prefs: java.util.prefs.BackingStoreException: 
Couldn't get file lock.

See this for how to get rid of those:

http://www.unidata.ucar.edu/software/thredds/current/tds/faq.html#javaUtilPrefs

Cheers,
Christian


> Hi,
> 
> Few days ago our thredds server (http://silam.fmi.fi/thredds/) started
> crashing.  Indeed whole java virtual machine went down. That happened on
> a request for a huge netcdf4 file. Logs attached. Looks like a problem
> is in C netcdf library, or interfacing to it, since same request with
> netcdf3 outptu went through.  If i got it right, the C library is only
> needed for writing nc4, but not reading. Can that be just disabled
> somehow?
> 
> 
> As a workaround I have limited the maximum file size produced by NCSS
> (<maxFileDownloadSize>800 MB</maxFileDownloadSize>), but it did not work for
> netcdf4, whereas perfectly works for netcdf. Any idea why?
> 
> Thank you!
> 
> BR,
> Rostislav


Ticket Details
===================
Ticket ID: YBV-904566
Department: Support THREDDS
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.