[ldm-users] Best linux file system for data on large raid5 array?


What filesystem type are people using for data storage on linux?

I have a 5+ Tb archive that's sitting on a hardware raid5, using reiserfs (Reiserfsprogs-3.6.19 on CentOS), and just recently I started getting hard machine crashes when trying to write to that file system. I did a reiserfsck --rebuild-tree on it (since a -check reported that I needed to) and now about 1/5 of the data that was on it is either gone or in the lost+found directory named with inode names.

This is the second time now that I've had a reiserfs file system go kablooey on me.

I'm considering toasting the whole thing and rebuilding with a different file system type, but I'm not sure what is most reliable/best performance for this kind of usage. It's a combination of lots of large files (i.e. GRIB/GRIB2 model data files and gempak of the same) and also lots of smaller files, i.e. nexrad level 3, lots of small files in a bunch of directories.

I've read that ext3 (linux default) is extremely stable but can be slow. Other choices would be jfs, xfs, others??

Any suggestions or experiences would be appreciated.



^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
^ Systems Programmer               V Madison,         WI     53706    ^
^                                  V       poker@xxxxxxxxxxxx         ^
^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
^ University of Wisconsin-Madison  V (608) 262-0166 (Fax)             ^

  • 2007 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: