[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Fwd: Re: problems reading GFS data from NOMADS-HD; DConnect]



Hi Dan, Glenn:

java.net.SocketException: Connection reset

probably means that the socket was closed on the server.

To go further with this we need to look at the threddsServlet.log files and see if we are getting any error messages in there that correspond to what Gerald is seeing. this may be hard without knowing the exact URL and a small time window during which the errors happened, and maybe the client IP address. Gerald do you have any of that?

this can also happen when the connection gets very slow, eg if one of the IP routes is flaky. Gerald can you ask your network guys (if you have them) to test to see if your network routing to nomads has any problems?

On 4/23/2010 6:59 AM, Dan Swank wrote:
John,
This addy is for NCDC-NOMADS servers nomads.ncdc.* only.
For NCEP-NOMADS ~ you should contact their HelpDesk: @
http://nomads.ncep.noaa.gov/txt_descriptions/Help_Desk_doc.shtml

-Dan


address@hidden wrote the following on 4/22/2010 8:41 PM:
hmm-
John
can you assist here?

thx, glenn

----- Original Message -----
From: Gerald Spreitzhofer<address@hidden>
Date: Thursday, April 22, 2010 4:28 pm
Subject: Re: [Fwd: Re: problems reading GFS data from NOMADS-HD; DConnect]

Thanks, John.
Glenn, could you please answer my mail or explain me the error
messages I
am receiving from time to time (see below)? I think there were similar
messages some days in fall, some people from the mailing list
complainedand then you were able to fix them.
Best regards, Gerald

On Do, 22.04.2010, 22:18, John Caron wrote:
gerald, send reports to

address@hidden



On 4/22/2010 12:54 PM, Gerald Spreitzhofer wrote:
John,
I am having the same problems as before and the same error
message (see
below, java.net.SocketException) most of the day, using
DODS/OPENDAP.>> Also
just clicked again on the motherlode-link, there I can download GFS
0.5deg
data (well, some gridpoints, I did not check for big amounts of
data).>> The
amount of data I am downloading is max. 20 MB (like always), I
don't>> think
this is a problem. The error usually ocurs some time during the
downloading, not just at the beginning.
Can you forward this mail to persons who might help?
Thanks, Gerald

On Mo, 19.04.2010, 16:44, john caron wrote:

gerald, can you try hitting datasets on
http://motherlode.ucar.edu/thredds/ and see if you have any
problems?>>>
Gerald Spreitzhofer wrote:

Hi John,
Thanks for answering my mail last Friday that quickly.
Problems still
persist, but it looks like they are not permanent (sometimes in
between
GFS data can be read without problems). Maybe the error
messages below
help (they were produced this morning around 8 UTC).
Best Regards, Gerald

===== Reading 3d-variable 58: pressfc=====
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:168)
at
java.io.BufferedInputStream.fill(BufferedInputStream.java:183)>>>>
at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
at
java.io.BufferedInputStream.read(BufferedInputStream.java:277)>>>>
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:741)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:702)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:712)
        at

sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:583)>>>>
at dods.dap.DConnect.openConnection(DConnect.java:174)
at dods.dap.DConnect.getDataFromUrl(DConnect.java:380)
at dods.dap.DConnect.getData(DConnect.java:339)
at dods.dap.DConnect.getData(DConnect.java:522)
at
ucar.nc2.dods.DODSNetcdfFile.readDODSData(DODSNetcdfFile.java:536)>>>>
at ucar.nc2.dods.DODSVariable.readDODSData(DODSVariable.java:497)
at ucar.nc2.dods.DODSVariable.read(DODSVariable.java:393)
at SEVIS.NetcdfUtil.readNcArrayLayer(NetcdfUtil.java:1846)
at SEVIS.NetcdfUtil.readNcArray(NetcdfUtil.java:1708)
at
SEVIS.NetcdfUtil.readNcArray_0MedAdapted(NetcdfUtil.java:1659)>>>>
at SEVIS.DODSReader.writeNcVariables(DODSReader.java:825)
        at SEVIS.DODSReader.createNetcdfFile(DODSReader.java:676)
        at SEVIS.DODSReader.<init>(DODSReader.java:159)
        at SEVIS.SuperDataFile.getDodsFile(SuperDataFile.java:2526)
        at

SEVIS.SuperDataFile.getSpecifiedNetcdfFile(SuperDataFile.java:2344)>>>> at
SEVIS.MainFrame.forecastUpdate(MainFrame.java:2131)
        at

SEVIS.MainFrame.jButtonDataUpdate_actionPerformed(MainFrame.java:2163)>>>>
------------------------ Ursprüngliche Nachricht
------------------------
Betreff: Re: problems reading GFS data from NOMADS-HD; DConnect
Von: "Glenn Rutledge"<address@hidden>
Datum: Fr, 16.04.2010, 19:41
An: "John Caron"<address@hidden>
Cc: "Gerald Spreitzhofer"<address@hidden>
address@hidden
---------------------------------------------------------------
-----------
Thanks John,
We don't seem to be experiencing any issues. I've cc:ed Dan
Swank>>>> here
and he might be able to track down this issue.
Regards, Glenn

John Caron said the following on 4/16/2010 1:01 PM:


Hi gerald: im not having any trouble with that URL. is it still
happening (11 am MST) ?

On 4/16/2010 10:15 AM, Gerald Spreitzhofer wrote:


Hi John,
I am operationally reading GFS 0.5deg data from the NOMADS-
HD server
via
DODS and the Java/NetCDF library. I did not change anything
in my
code
during the last couple of months, but recently (for instance
the>>>>>> last
20
hours) there have been some errors reading data from there
(see the
protocol below). I think I remember that there was a similar
problem>>>>>> last
fall, and the reason was a change in some security or firewall
setting on
NOMADS, just concerning this protocol. Do you know what the
reason>>>>>> for the
messages can be or who might be responsible? Thanks, Gerald


===== Reading 3d-variable 28: hgtsfc===== DConnect getData failed; retry (1,100)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]>>>>>>
DConnect getData failed; retry (2,200)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]>>>>>>
DConnect getData failed; retry (3,400)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]>>>>>>
DConnect getData failed; retry (4,800)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]>>>>>>
DConnect getData failed; retry (5,1600)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]>>>>>>
DConnect getData failed; retry (1,100)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]>>>>>>
DConnect getData failed; retry (2,200)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]>>>>>>
DConnect getData failed; retry (3,400)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]>>>>>>
DConnect getData failed; retry (4,800)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]>>>>>>
DConnect getData failed; retry (5,1600)

http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]>>>>>>


-----------------------------------------
Dr. Gerald Spreitzhofer, Researcher
Institute of Meteorology and Geophysics
University of Vienna
A-1090 Vienna, Althanstrasse 14, UZA2
Tel.: +43-1-4277-537 33
email: address@hidden
-----------------------------------------








NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.