Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[bkenobi]

I have a local file server I've been running for 5-10 years now that's based on a hardware RAID 5 controller.  I like the setup in that it has redundancy and was pretty quick at the time of build.  I started with 3x750GB drives and later added a 4th so I have 2TB of fault tolerant storage.

I just realized over the weekend that a drive had failed in July but I was not notified (alarms disabled apparently). I swapped the drive and the system rebuilt but today it says the same drive unit is bad.  I will have to check the connections, but I may have to update my setup.

So the question is, what are others using or could recommend?  I need a LAN accessible solution that is somewhat fault tolerant.  I store music, photos, media on the system that I don't want to lose.  The files must be accessible to media players and PC/Android on the LAN.  I am currently also using the server for P2P type things though I assume that could be accomplished in another way (e.g., RPi).

[petera]

I find most users of Raid are from the commercial or industrial sector. As you're clearly aware it's not a substitute for a backup although many people treat it as if it was. The fact that your system has been running since July with a failed disk is slightly worrying though. I assume in addition to RAID you're backing up your system regularly anyway.

What server software do you use and what media type forms your array. Are they hot swappable Do you use NAS as well. Is your server used for commercial purposes as well as domestic.

[bkenobi]

The server is strictly for home use for personal files.  I have no real backup other than some very old burned discs.  The goal was to have things backed to a secondary location with a different type of media, but never got there.

This is a fairly robust setup in that it's a commercial hardware RAID (3ware) rather than a software solution.  I could have used a MB software RAID, but those are problematic if the MB fails. Because this is a hardware controller, I can pull the card and drives and move it to a new system if needed.

That said, it does nothing for a lightning strike or fire.  I still need to address that concern for the more important files, but the bulk are my music collection and arcade roms.  Losing them would be very annoying but not life altering.  I am mainly looking for something better than a single drive NAS where a single failure loses everything.

[HA Dave]

File storage? Isn't that what the cloud is for? Cloud files are backed-up and can NOT be robbed or destroyed in a house fire or other disaster. The files can be assessed via all sorts of devices from anywhere in the world and shared "with permissions" as you desire.   

[brobin]

File storage? Isn't that what the cloud is for? Cloud files are backed-up and can NOT be robbed or destroyed in a house fire or other disaster. The files can be assessed via all sorts of devices from anywhere in the world and shared "with permissions" as you desire.

There's nothing wrong with cloud storage, it's convenient and reliable - but not infallible. Case in point: Some years ago I logged into my gmail account and found that, other than mail received that day, years of saved emails were simply gone. Vanished for good. Google was of no help and said there was no way to recover them and they didn't know why they were missing.  Free service, you get what you pay for.  Fortunately I had archived copies of most of them on my PC but I did learn a lesson about the cloud.

[petera]

Yes data once again shared from the cloud without permission. https://economictimes.indiatimes.com/news/international/world-news/google-exposed-user-data-feared-repercussions-of-disclosing-to-public-wsj/articleshow/66125333.cms

This carry on is only the tip of the iceberg. On top of this the so called free storage will come to an end once reliance on cloud storage becomes irreversible. Then what. Ridiculous monthly storage plan fees to be paid or as @brobin mentions the mysterious disappearance of your data.

@bkenobi not sure how old your storage media is but I'd look at replacing it with something like SSD. Four 500gb SSD drives for approx $280. I assume you want your data permanently on line and accessible so for convenience I'd stick with the RAID setup and take regular backups on one of those large capacity SATA drives.

You had an unchecked disk failure on Raid 5 for nearly three months. No doubt you were aware that a second failure during that period and everything was gone.

You don't mention what server software you use but I have regular backups scheduled with cron jobs on my Ubuntu Server Edition server. I do periodic restores to check the integrity of my backups. Nothing worse to discover your backup won't restore in the event of catastrophic system failure.

[bkenobi]

I didn't list all the detailed specs because I didn't think it mattered nor would anyone be interested.

Windows XP SP2
AthlonXP 3000+ based PC
AAMC 9590SE-8MI RAID controller
4x 750GB SATA HDD comfigured in RAID 5
relativley small system HDD


The RAID controller deals with the RAID and WinXP is used with file sharing and RDC as well as P2P.  I have nothing currently for scheduled backups.  I had considered a second drive as the backup location, but that doesnt help if the system is the fault (MB, power spike, etc).  I considered a second location (either a web share or simply a different NAS device located in the home.

Yes, I'm aware that the data would be lost with 1 more failure which is why I asked the question. After swapping a single failed drive, a day later the same unit had failed. Leads me to believe it's some other issue.  If so, I need to consider migrating.  I know what I've been doing is ok, but I figured others may have the same type of requirement and came to some setup that may be interesting.  I don't want to get a new controller really, but RAID 6 was just starting to be available when I set this up.  It was cost prohibitive for me at the time, but storage is so cheap now...

FWIW, calling a web server the cloud is trendy, but it's not new or inovative in any way.  "Free" web storage is an option, but whether you pay for it or not, web shares are only useful while they are online.  I've seen many disapear and the content is gone.  What was the image share that ate many people's personal photo libraries a couple years back?

[HA Dave]

…. FWIW, calling a web server the cloud is trendy, but it's not new or inovative in any way. 

You haven't been reading the posts here! Using the word "cloud" makes servers sound MUCH scarier. 

"Free" web storage is an option, but whether you pay for it or not, web shares are only useful while they are online.  I've seen many disapear and the content is gone.  What was the image share that ate many people's personal photo libraries a couple years back?

Nothings free! Ever! I've ran PC's at home 24/7 for years.... that wasn't free either. Data management is a "job description". Just like landscaper, painter, mechanic, cook, dishwasher, window washer, etc.. Back-ups are VERY important! And I don't take data management lightly. But even retired.... my days still only last 24 hours each. For me.... that makes "time management" my number one job. Setting up a computer to manage/do your repetitive job of backing up files locally as well as with a professionally managed service can manage your most valuable assess..... your time.   

[bkenobi]

I'm thinking that something like the Drobo 5N2 and a scheduled backup to some other location would be a good fit.  Drobo was brand new and untested when I built this setup.  Since they survived, they must be doing something right.  I'll have to consider a web share of some kind or a second NAS drive located somewhere.  I suppose I might even be able to route a wireless NAS into my fire safe if I tried hard!

[petera]

I'm thinking that something like the Drobo 5N2 and a scheduled backup to some other location would be a good fit.  Drobo was brand new and untested when I built this setup.  Since they survived, they must be doing something right.  I'll have to consider a web share of some kind or a second NAS drive located somewhere.  I suppose I might even be able to route a wireless NAS into my fire safe if I tried hard!

Yes we used to store our QIC backup tapes in the fire safe 20 or more years ago. Definitely worked. Rotated the tapes on a five day cycle. Had a number of occasions that required restoring and they worked each time. Never a fire luckily enough.

I suppose an off site NAS could work. Probably a complete backup archived would protect the data and then some form SSD storage should you need everyday access to them.

Dare I ask. Windows XP 2. I assume you don't have that exposed to the outside world. That would be a belt and braces safety approach required.

[HA Dave]

…. Windows XP 2. I assume you don't have that exposed to the outside world.

It's been a long time since my retirement. But it used to be any device connected to an Internet device.... is also (by proxy permission) an Internet device.

[bkenobi]

I used XP as it was easier to set up at the time.  I ran Win7 on my other machines, but trusted XP at the time.  It is exposed to the lan obviously, but I have no open exterior connection through the router.  Technically it's exposed via WiFi, but everything is at that point.

I heard back from the current owners of 3Ware/AAMC/LSI/whatever.  They recommended trying a different port on the controller with a good drive.  I suppose the new drive could be DOA, but I lean towards a kinked SATA cable causing a broken lead.

I really like hardware RAID and I'm still not fully convinced BeyondRAID isn't just marketing hype for JBOD + parity bits.

[petera]

I used XP as it was easier to set up at the time.  I ran Win7 on my other machines, but trusted XP at the time.  It is exposed to the lan obviously, but I have no open exterior connection through the router.  Technically it's exposed via WiFi, but everything is at that point.

I heard back from the current owners of 3Ware/AAMC/LSI/whatever.  They recommended trying a different port on the controller with a good drive.  I suppose the new drive could be DOA, but I lean towards a kinked SATA cable causing a broken lead.

I really like hardware RAID and I'm still not fully convinced BeyondRAID isn't just marketing hype for JBOD + parity bits.

In technology terms 10 years is a lifetime. Something that has worked reliably for 10 years has got to be a recommendation in itself. As you say there's so much marketing hype around you'd have to wonder if that's all it is.

I'd stick with what works. It could well be just a faulty cable. Unlikely to be a DOA drive. One thing you might consider though is the actual RAID controller failing.

Did you ever consider upgrading to XP SP3. Probably not a big issue now but it gave the last gasp patches and security updates before the big shutdown. You probably had good reason not to.

[bkenobi]

I didn't check, but it could be SP3.  I know the installer disc is SP2, but MS pushed a lot of updates before stopping support, so I could have accepted the SP3 update.  No, it's certainly not secure enough to put online, but since it's behind my router's "firewall", it should be ok.

I think if I can verify that the controller is still good, then I'll probably opt to purchase a few new drives (SSD looks attractive) and build a second array that can eventually replace the one I have now.  I can then use those units (8 total available, 4 free currently).  Also, if I can locate a reasonably priced SSD external drive with WiFi, I'd add that inside my fire safe and schedule backups of the more critical files.  I'd prefer SSD since this will be minimal writes so it should have very little chance of failure.  HDD are much cheaper, but they have the same risk of failure as the RAID without the parity making them a poor backup media choice.

[brobin]

I have an XP SP3 box that I'm still using at my rarely used place (where I am now) and just got some XP updates today.  I've been getting updates regularly since I did a registry change to get security updates for XP POS computers. Here's a link on how to do that.  https://betanews.com/2017/06/27/get-regular-free-security-updates-for-windows-xp-and-vista/