Dear Thredds community,
I was wondering when 2 issues will be solved, and if it is or will be solved in
which version of TDS.
Many users here in Europe are impacted (CMEMS community), as well as Hycom
users apparently.
- The capacity of NCSS to manage subset across the grid boundary
- A bug on netCDF 4 output writing :
https://github.com/Unidata/thredds/issues/330
Is the TDS 5.0 the good one ? If yes, is this version considered as a stable
version ?
Thanks,
Tony
-
Tony Jolibois
Product Dissemination Services
Space Oceanography
+33 5 61 39 37 97
[logo_cls_small]
http://www.cls.fr/
________________________________
Ce message et toutes les pi?ces jointes (ci-apr?s le "message") sont ?tablis ?
l'intention exclusive de ses destinataires et sont confidentiels. Si vous
recevez ce message par erreur ou s'il ne vous est pas destin?, merci de le
d?truire ainsi que toute copie de votre syst?me et d'en avertir imm?diatement
l'exp?diteur. Toute lecture non autoris?e, toute utilisation de ce message qui
n'est pas conforme ? sa destination, toute diffusion ou toute publication,
totale ou partielle, est interdite. L'Internet ne permettant pas d'assurer
l'int?grit? de ce message ?lectronique susceptible d'alt?ration, l'exp?diteur
(et ses filiales) d?cline(nt) toute responsabilit? au titre de ce message dans
l'hypoth?se o? il aurait ?t? modifi? ou falsifi?.
This message and any attachments (the "message") is intended solely for the
intended recipient(s) and is confidential. If you receive this message in
error, or are not the intended recipient(s), please delete it and any copies
from your systems and immediately notify the sender. Any unauthorized view, use
that does not comply with its purpose, dissemination or disclosure, either
whole or partial, is prohibited. Since the internet cannot guarantee the
integrity of this message which may not be reliable, the sender (and its
subsidiaries) shall not be liable for the message if modified or falsified.
--- Begin Message ---
Indeed, we have this (mostly) working on our 5.0 development branch. We're not
really sure about when we'll release 5.0, but it should be by the end of the
year at the latest.
On Mon, Sep 14, 2015 at 3:38 PM, Don Murray (NOAA Affiliate)
<don.murray@xxxxxxxx<mailto:don.murray@xxxxxxxx>> wrote:
Hi Michael-
In the current versions of TDS/netCDF-Java, you cannot subset across the
grid boundary. Since your model runs -180 to 180, that's what you are running
into. For model output that runs 0-360, the problem is at the prime meridian.
I think this is to be fixed in the next iteration (5.0?), but I'm sure
Unidata can verify that.
Don
On 9/14/15 3:25 PM, Michael McDonald wrote:
Is there some trick I am not understanding for making NCSS queries
that span the 180-degree east dateline? We've had users on the
HYCOM.org forum asking about this, and I cannot get a netcdf object
which does not stop at 180-degrees east.
http://www.unidata.ucar.edu/software/thredds/current/tds/reference/NetcdfSubsetServiceReference.html#Subsetting
We are using the latest 4.6.3
http://ncss.hycom.org/thredds/catalog.html
1. Start with our HYCOM reanalysis product,
http://ncss.hycom.org/thredds/ncss/grid/GLBa0.08/reanalysis/dataset.html
2. See if you can successfully get data that spans the dateline,
i.e., West 170 to East 200
If successful, please let me know how to accomplish this.
--
Don Murray
NOAA/ESRL/PSD and CU-CIRES
303-497-3596<tel:303-497-3596>
http://www.esrl.noaa.gov/psd/people/don.murray/
_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx<mailto:thredds@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe, visit:
http://www.unidata.ucar.edu/mailing_lists/
Cliquez
ici<https://www.mailcontrol.com/sr/0rp!JUjVdg7GX2PQPOmvUo1yZ91kITL4y92GS5Ba1a1R!khHnxdqh5TV!DiD!7MCQGpUKsswpNw5N50IUBelLw==>
si ce message est indésirable (pourriel).
_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe, visit:
http://www.unidata.ucar.edu/mailing_lists/
--- End Message ---
--- Begin Message ---
- To: Ryan May <rmay@xxxxxxxx>
- Subject: Re: [thredds] TDS NCSS: issue with netCDF4 files as input and netCDF4 requested as output
- From: Jolibois Tony <tjolibois@xxxxxx>
- Date: Mon, 14 Dec 2015 10:25:36 +0000
Dear Ryan,
Ok, new issue. Do you have a planning for the correction ? More generally, do
you have a roadmap for Thredds Data Server developments ? The next versions,
what will be corrected etc ?
Thanks.
Best regards,
Tony
De : Ryan May [mailto:rmay@xxxxxxxx]
Envoyé : samedi 12 décembre 2015 00:30
À : Jolibois Tony
Cc : THREDDS community; joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx
Objet : Re: [thredds] TDS NCSS: issue with netCDF4 files as input and netCDF4
requested as output
Thanks for the files, I'm able to reproduce the problem locally. Unfortunately,
it doesn't appear to be related to the issue #301 as I thought.
I've opened a new issue: https://github.com/Unidata/thredds/issues/330
You can follow any progress there as I continue to dig.
Thanks,
Ryan
On Fri, Dec 11, 2015 at 1:45 AM, <tjolibois@xxxxxx<mailto:tjolibois@xxxxxx>>
wrote:
Hi Christian,
Please find some FTP link in the end of this email, to download some netCDF4
files we've used here for the tests. I've also added part of catalina.out, the
java_opts used, and the Thredds configuration (simple joinExisting aggregation).
Note that it's only when you request netCDF4 as output that we have an error.
Best regards,
Tony
Hi Tony,
Can you provide an example of the NetCDF-4 input file so that we can recreate
the problem locally?
Thanks,
Christian
On Thu, Dec 10, 2015 at 8:29 AM, Jolibois Tony wrote:
Hi Thredds team,
We’re currently testing TDS netCDF Subset Service, its performance,
robustness.. These tests include different netCDF format, to study the impact
on performance and robustness with different compression levels.
To study this impact, we run 4 scenarios for input/output data files for TDS
NCSS.
Input netCDF3 => output netCDF3
Input netCDF4 => output netCDF3
Input netCDF3 => output netCDF4
Input netCDF4 => output netCDF4
We’re facing an error only with the 4th scenario, netCDF4 => netCDF4 (NCSS REST
parameter &accept=netcdf4).
java.io.IOException: -101: NetCDF: HDF error
at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2821)
~[netcdf4-4.6.3.jar:4.6.3]
at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2729)
~[netcdf4-4.6.3.jar:4.6.3]
at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:953)
~[cdm-4.6.3.jar:4.6.3]
at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:937)
~[cdm-4.6.3.jar:4.6.3]
at ucar.nc2.FileWriter2.copyAll(FileWriter2.java:427) ~[cdm-4.6.3.jar:4.6.3]
at ucar.nc2.FileWriter2.copyVarData(FileWriter2.java:380) ~[cdm-4.6.3.jar:4.6.3]
at ucar.nc2.dt.grid.CFGridWriter2.writeOrTestSize(CFGridWriter2.java:244)
~[cdm-4.6.3.jar:4.6.3]
at ucar.nc2.dt.grid.CFGridWriter2.writeFile(CFGridWriter2.java:112)
~[cdm-4.6.3.jar:4.6.3]
at
thredds.server.ncss.controller.GridResponder.writeGridFile(GridResponder.java:250)
~[classes/:4.6.3]
at
thredds.server.ncss.controller.GridResponder.writeLatLonSubset(GridResponder.java:166)
~[classes/:4.6.3]
at
thredds.server.ncss.controller.GridResponder.getResponseFile(GridResponder.java:97)
~[classes/:4.6.3]
at
thredds.server.ncss.controller.NcssController.handleRequestGrid(NcssController.java:175)
~[classes/:4.6.3]
at
thredds.server.ncss.controller.NcssController.handleRequest(NcssController.java:140)
~[classes/:4.6.3]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_65]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_65]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_65]
at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65]
The error comes from netcdf4 java library used inside TDS version 4.6.3 (latest
stable version).
The error appears only if we have a geographical subset (works with no subset
or temporal aggregation).
Different NetCDF-4 input files have been tested:
• original Netcdf3 files converted with the command nccopy –k4 –d3
input.nc<http://input.nc> output.nc4
• original Netcdf4 generated with python library
For information on software versions:
misgw-qt-new:/home/misgw# ls -ltr
total 246300
-rw-r--r-- 1 root root 9130958 oct 7 21:09 apache-tomcat-8.0.28.tar.gz
-rw-rw-r-- 1 misgw misgw 181260798 nov 9 10:48 jdk-8u65-linux-x64.gz
-rw-r--r-- 1 root root 61808104 nov 9 11:03 thredds_4.6.3.war
Thanks for the support.
Tony Jolibois
-
Tony Jolibois
Product Dissemination Services
Space Oceanography
+33 5 61 39 37 97<tel:%2B33%205%2061%2039%2037%2097>
Files attached to this message
Filename
Size
netCDF4.zip
13 MB
catalina.out
6 KB
java_opts.sh
1012.0 B
m_LR_OBS_nc4.xml
2 KB
m_Surcouf_C4.xml
2 KB
Please click on the following link to download the attachments:
http://ftp-mail.cls.fr/message/XY07Uo3bGqdx38DKHGNgyD
The attachments are available until: Friday, 18 December.
Message ID: XY07Uo3
CLS — Secure Filetransfer Appliance<http://www.allardsoft.com/filetransfer>:
http://ftp-mail.cls.fr/
_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx<mailto:thredds@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe, visit:
http://www.unidata.ucar.edu/mailing_lists/
--
Ryan May
Software Engineer
UCAR/Unidata
Boulder, CO
Cliquez ici<https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==> si ce
message est indésirable (pourriel).
_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe, visit:
http://www.unidata.ucar.edu/mailing_lists/
--- End Message ---
