Unidata - To provide the data services, tools, and cyberinfrastructure leadership that advance Earth system science, enhance educational opportunities, and broaden participation. Unidata
         
  advanced  
 

Re: Performance problem with large files

Konrad,

>Date: Fri, 25 Jun 1999 19:07:05 +0200
>From: hinsen@xxxxxxxxxxxxxxxxxxxxx
>Organization: .
>To: netcdfgroup@xxxxxxxxxxxxxxxx
>Subject: Performance problem with large files
>Keywords: 199906251709.LAA21081

In the above message, you wrote:

> My problem is that this is not only extremely slow (slower by a factor
> 2000 than doing the same on a file of a hundredth the size), but
> periodically blocks my computer in that all programs wanting to do
> some disk access have to wait for about five seconds until some
> operation is finished. And my office neighbour is complaining about
> the never-ending noise from the disk.

I suspect (but do not know) that this problem is related to the way that
Linux manages memory rather than to the netCDF library.  We've seen
other strange behaviors from Linux when using large files.

You might see what increasing the swap size does.

--------
Steve Emmerson   <http://www.unidata.ucar.edu>

 
 
  Contact Us     Site Map     Search     Terms and Conditions     Privacy Policy     Participation Policy
 
National Science Foundation (NSF) UCAR Community Programs   Unidata is a member of the UCAR Community Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation.
P.O. Box 3000     Boulder, CO 80307-3000 USA     Tel: 303-497-8643     Fax: 303-497-8690