[ldm-users] Best linux file system for data on large raid5 array?

[Arthur A. Person]

Pete,

I've read good things about Sun's zfs... doesn't ever have to be fsck'd 
which, to me, is the scariest thing about n-TB systems.  I'm getting ready 
to try one of these in real life so I can't say anything about it from 
experience.  It's downside might be that it's proprietary (you have to run 
Solaris) and it seems to want to run its own software raid... I don't know 
whether it would make sense to run it on top of a hardware raid system or 
not.  http://www.opensolaris.org/os/community/zfs.


                           Art


On Mon, 8 Oct 2007, Pete Pokrandt wrote:

> All,
>
> What filesystem type are people using for data storage on linux?
>
> I have a 5+ Tb archive that's sitting on a hardware raid5, using
> reiserfs (Reiserfsprogs-3.6.19 on CentOS), and just recently I started
> getting hard machine crashes when trying to write to that file system. I
> did a reiserfsck --rebuild-tree on it (since a -check reported that I
> needed to) and now about 1/5 of the data that was on it is either gone
> or in the lost+found directory named with inode names.
>
> This is the second time now that I've had a reiserfs file system go
> kablooey on me.
>
> I'm considering toasting the whole thing and rebuilding with a different
> file system type, but I'm not sure what is most reliable/best
> performance for this kind of usage. It's a combination of lots of large
> files (i.e. GRIB/GRIB2 model data files and gempak of the same) and also
> lots of smaller files, i.e. nexrad level 3, lots of small files in a
> bunch of directories.
>
> I've read that ext3 (linux default) is extremely stable but can be slow.
> Other choices would be jfs, xfs, others??
>
> Any suggestions or experiences would be appreciated.
>
> Thanks!
>
> Pete
>
> -- 
> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
> ^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
> ^ Systems Programmer               V Madison,         WI     53706    ^
> ^                                  V       poker at aos.wisc.edu         ^
> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
> ^ University of Wisconsin-Madison  V (608) 262-0166 (Fax)             ^
> +<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
>
> _______________________________________________
> ldm-users mailing list
> ldm-users at unidata.ucar.edu
> For list information or to unsubscribe,  visit: http://www.unidata.ucar.edu/mailing_lists/
>
>

Arthur A. Person
Research Assistant, System Administrator
Penn State Department of Meteorology
email:  person at meteo.psu.edu, phone:  814-863-1563