Unidata - To provide the data services, tools, and cyberinfrastructure leadership that advance Earth system science, enhance educational opportunities, and broaden participation. Unidata
         
  advanced  
 

Re: Newbie question about VisAD and large datasets

Hi Daniel,

> I am considering using VisAD to develop some neuroimaging applications.  I
> was curious as to how well VisAD deals with large datasets.  For example, a
> 16 bit dataset with dimensions 64 x 64 x 24 x 576 is what I consider to be
> large.
>
> If anybody has experience using data of this size or larger, please comment.

64 * 64 * 24 = 98304 which is quite easy to deal with as a
volume of data. However, 98304 * 576 = 56.6 M, which will
be a big challenge for Java3D (and hence VisAD) unless you
have a version utilizing a 64-bit architecture (these days
several GB of RAM is quite reasonable, but there is a problem
finding Java implementations that can use it).

I think Curtis Rueden has some experience with very large
data sets in his VisBio application (I think with data sets
a lot like yours), and has come up with some clever work
arounds for memory issues (e.g., multi-resolution
rendering). He and I discussed the possibility of a custom
DataRenderer for dealing with long time sequences of images
(I assume your 576 is a time count), although I understand
its not his highest priority. Perhaps he will comment.

Gooc luck,
Bill


 
 
  Contact Us     Site Map     Search     Terms and Conditions     Privacy Policy     Participation Policy
 
National Science Foundation (NSF) UCAR Community Programs   Unidata is a member of the UCAR Community Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation.
P.O. Box 3000     Boulder, CO 80307-3000 USA     Tel: 303-497-8643     Fax: 303-497-8690