Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.
Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.
John, I am trying to access a really large NetCDF file (~3GB), but it results in error as shown below. uri='http://www.gri.msstate.edu/rsearch_data/nopp/fvcom_2.5gb.ncml'; >>>> GridDataset gds = GridDataset.open(uri); ?? Java exception occurred: java.io.IOException: Server has malformed Content-Length headerat ucar.unidata.io.http.HTTPRandomAccessFile.<init>(HTTPRandomAccessFile.java:110)
........... <<<<In 'HttpRandomAccessFile.java', I see that this error is due to the 'content-length' in http header being parsed as 'Integer'. So, any file size exceeding the 32bit representation will have this problem.
>>>> nj2.2.22public HTTPRandomAccessFile(String url, int bufferSize) throws IOException {
.....
head = method.getResponseHeader("Content-Length");
.......
total_length = Integer.parseInt(head.getValue());
} catch (NumberFormatException e) {
throw new IOException("Server has malformed Content-Length header");
}
<<<<
Is there any strong reason the 'Content-Length' cannot be parsed as
'Long' to accommodate file size > 2.1GB ?
My internal tests shows that changing the code to parse as 'long' surely
solves the problem, but I am not sure
if I am setting myself for some unforeseen disaster dealing with other
aspects of netcdf-java API.
Will appreciate your valuable input, thanks Sachin. -- Sachin Kumar Bhate, Research Associate MSU-High Performance Computing Collaboratory, NGI John C. Stennis Space Center, MS 39529 http://www.northerngulfinstitute.org/ <http://www.northerngulfinstitute.org/>
netcdf-java archives: