[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Fwd: Re: problems reading GFS data from NOMADS-HD; DConnect]

John,
I am having the same problems as before and the same error message (see
below, java.net.SocketException) most of the day, using DODS/OPENDAP. Also
just clicked again on the motherlode-link, there I can download GFS 0.5deg
data (well, some gridpoints, I did not check for big amounts of data). The
amount of data I am downloading is max. 20 MB (like always), I don't think
this is a problem. The error usually ocurs some time during the
downloading, not just at the beginning.
Can you forward this mail to persons who might help?
Thanks, Gerald

On Mo, 19.04.2010, 16:44, john caron wrote:
> gerald, can you try hitting datasets on
> http://motherlode.ucar.edu/thredds/ and see if you have any problems?
>
> Gerald Spreitzhofer wrote:
>> Hi John,
>> Thanks for answering my mail last Friday that quickly. Problems still
>> persist, but it looks like they are not permanent (sometimes in between
>> GFS data can be read without problems). Maybe the error messages below
>> help (they were produced this morning around 8 UTC).
>> Best Regards, Gerald
>>
>> ===== Reading 3d-variable 58: pressfc=====
>> java.net.SocketException: Connection reset
>>      at java.net.SocketInputStream.read(SocketInputStream.java:168)
>>      at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
>>      at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
>>      at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
>>      at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:741)
>>      at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:702)
>>      at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:712)
>>      at
>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:583)
>>      at dods.dap.DConnect.openConnection(DConnect.java:174)
>>      at dods.dap.DConnect.getDataFromUrl(DConnect.java:380)
>>      at dods.dap.DConnect.getData(DConnect.java:339)
>>      at dods.dap.DConnect.getData(DConnect.java:522)
>>      at ucar.nc2.dods.DODSNetcdfFile.readDODSData(DODSNetcdfFile.java:536)
>>      at ucar.nc2.dods.DODSVariable.readDODSData(DODSVariable.java:497)
>>      at ucar.nc2.dods.DODSVariable.read(DODSVariable.java:393)
>>      at SEVIS.NetcdfUtil.readNcArrayLayer(NetcdfUtil.java:1846)
>>      at SEVIS.NetcdfUtil.readNcArray(NetcdfUtil.java:1708)
>>      at SEVIS.NetcdfUtil.readNcArray_0MedAdapted(NetcdfUtil.java:1659)
>>      at SEVIS.DODSReader.writeNcVariables(DODSReader.java:825)
>>      at SEVIS.DODSReader.createNetcdfFile(DODSReader.java:676)
>>      at SEVIS.DODSReader.<init>(DODSReader.java:159)
>>      at SEVIS.SuperDataFile.getDodsFile(SuperDataFile.java:2526)
>>      at SEVIS.SuperDataFile.getSpecifiedNetcdfFile(SuperDataFile.java:2344)
>>      at SEVIS.MainFrame.forecastUpdate(MainFrame.java:2131)
>>      at
>> SEVIS.MainFrame.jButtonDataUpdate_actionPerformed(MainFrame.java:2163)
>>
>>
>> ------------------------ Ursprüngliche Nachricht
>> ------------------------
>> Betreff: Re: problems reading GFS data from NOMADS-HD; DConnect
>> Von:     "Glenn Rutledge" <address@hidden>
>> Datum:   Fr, 16.04.2010, 19:41
>> An:      "John Caron" <address@hidden>
>> Cc:      "Gerald Spreitzhofer" <address@hidden>
>>          address@hidden
>> --------------------------------------------------------------------------
>>
>> Thanks John,
>> We don't seem to be experiencing any issues.  I've cc:ed Dan Swank here
>> and he might be able to track down this issue.
>> Regards, Glenn
>>
>> John Caron said the following on 4/16/2010 1:01 PM:
>>
>>> Hi gerald: im not having any trouble with that URL. is it still
>>> happening (11 am MST) ?
>>>
>>> On 4/16/2010 10:15 AM, Gerald Spreitzhofer wrote:
>>>
>>>> Hi John,
>>>> I am operationally reading GFS 0.5deg data from the NOMADS-HD server
>>>> via
>>>> DODS and the Java/NetCDF library. I did not change anything in my code
>>>> during the last couple of months, but recently (for instance the last
>>>> 20
>>>> hours) there have been some errors reading data from there (see the
>>>> protocol below). I think I remember that there was a similar problem
>>>> last
>>>> fall, and the reason was a change in some security or firewall
>>>> setting on
>>>> NOMADS, just concerning this protocol. Do you know what the reason
>>>> for the
>>>> messages can be or who might be responsible? Thanks, Gerald
>>>>
>>>>
>>>> ===== Reading 3d-variable 28: hgtsfc=====
>>>> DConnect getData failed; retry (1,100)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]
>>>>
>>>> DConnect getData failed; retry (2,200)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]
>>>>
>>>> DConnect getData failed; retry (3,400)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]
>>>>
>>>> DConnect getData failed; retry (4,800)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]
>>>>
>>>> DConnect getData failed; retry (5,1600)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[5:5][250:299][704:719]
>>>>
>>>> DConnect getData failed; retry (1,100)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]
>>>>
>>>> DConnect getData failed; retry (2,200)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]
>>>>
>>>> DConnect getData failed; retry (3,400)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]
>>>>
>>>> DConnect getData failed; retry (4,800)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]
>>>>
>>>> DConnect getData failed; retry (5,1600)
>>>> http://nomads.ncep.noaa.gov:9090/dods/gfs_hd/gfs_hd20100415/gfs_hd_18z.dods?hgtsfc[0:0][250:299][0:66]
>>>>
>>>>
>>>>
>>>>
>>>>>> -----------------------------------------
>>>>>> Dr. Gerald Spreitzhofer, Researcher
>>>>>> Institute of Meteorology and Geophysics
>>>>>> University of Vienna
>>>>>> A-1090 Vienna, Althanstrasse 14, UZA2
>>>>>> Tel.: +43-1-4277-537 33
>>>>>> email: address@hidden
>>>>>> -----------------------------------------
>>>>>>
>>>>>>
>>>>
>>
>>
>
>
>