[ldm-users] Best linux file system for data on large raid5 array?

[Gerry Creager]

We tried, and abandoned, reiserfs a long time ago.  We've been playing 
with some of the proprietary large array FS's, but mostly used xfs. 
Overall, I'd say it's worked pretty well.  I'm considering a run at the 
open source version of gpfs, and zfs _does_ look attractive.

One thought though: We've started migrating all of our RAID from RAID5 
to RAID6.  We've seen one too many multi-drive failures to be satisfied 
with RAID5 anymore.

Arthur A. Person wrote:
> Pete,
> 
> I've read good things about Sun's zfs... doesn't ever have to be fsck'd 
> which, to me, is the scariest thing about n-TB systems.  I'm getting ready 
> to try one of these in real life so I can't say anything about it from 
> experience.  It's downside might be that it's proprietary (you have to run 
> Solaris) and it seems to want to run its own software raid... I don't know 
> whether it would make sense to run it on top of a hardware raid system or 
> not.  http://www.opensolaris.org/os/community/zfs.
> 
> 
>                            Art
> 
> 
> On Mon, 8 Oct 2007, Pete Pokrandt wrote:
> 
>> All,
>>
>> What filesystem type are people using for data storage on linux?
>>
>> I have a 5+ Tb archive that's sitting on a hardware raid5, using
>> reiserfs (Reiserfsprogs-3.6.19 on CentOS), and just recently I started
>> getting hard machine crashes when trying to write to that file system. I
>> did a reiserfsck --rebuild-tree on it (since a -check reported that I
>> needed to) and now about 1/5 of the data that was on it is either gone
>> or in the lost+found directory named with inode names.
>>
>> This is the second time now that I've had a reiserfs file system go
>> kablooey on me.
>>
>> I'm considering toasting the whole thing and rebuilding with a different
>> file system type, but I'm not sure what is most reliable/best
>> performance for this kind of usage. It's a combination of lots of large
>> files (i.e. GRIB/GRIB2 model data files and gempak of the same) and also
>> lots of smaller files, i.e. nexrad level 3, lots of small files in a
>> bunch of directories.
>>
>> I've read that ext3 (linux default) is extremely stable but can be slow.
>> Other choices would be jfs, xfs, others??
>>
>> Any suggestions or experiences would be appreciated.
>>
>> Thanks!
>>
>> Pete
>>
>> -- 
>> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
>> ^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
>> ^ Systems Programmer               V Madison,         WI     53706    ^
>> ^                                  V       poker at aos.wisc.edu         ^
>> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
>> ^ University of Wisconsin-Madison  V (608) 262-0166 (Fax)             ^
>> +<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
>>
>> _______________________________________________
>> ldm-users mailing list
>> ldm-users at unidata.ucar.edu
>> For list information or to unsubscribe,  visit: http://www.unidata.ucar.edu/mailing_lists/
>>
>>
> 
> Arthur A. Person
> Research Assistant, System Administrator
> Penn State Department of Meteorology
> email:  person at meteo.psu.edu, phone:  814-863-1563
> _______________________________________________
> ldm-users mailing list
> ldm-users at unidata.ucar.edu
> For list information or to unsubscribe,  visit: http://www.unidata.ucar.edu/mailing_lists/ 

-- 
Gerry Creager -- gerry.creager at tamu.edu
Texas Mesonet -- AATLT, Texas A&M University	
Cell: 979.229.5301 Office: 979.458.4020 FAX: 979.862.3983
Office: 1700 Research Parkway Ste 160, TAMU, College Station, TX 77843