Author Topic: RAID/NAS storage solutions  (Read 5009 times)

    • Tekforums.net - It's new and improved!
  • Offline Clock'd 0Ne

  • Clockedtastic
  • Posts: 10,945
  • Administrator
  • Hero Member
RAID/NAS storage solutions
on: March 08, 2010, 01:53:05 AM
Hi guys.

Since Im in need of a few new drives and gingerly awaiting click of death on a couple of drives, Im looking for something robust, but cost effective in terms of space vs redundancy to dump my data on. Ive spent a good deal of time this weekend reading up on various solutions and pondering the best route to take for storing a lot of data with some redundancy for peace of mind should the worst happen.

To put this in perspective I currently have 2x 750Gb Samsung Spinpoint drives, 1 is the boot partition (this drive is developing bad sectors and suchlike and desperately wants an RMA). I also have an external Seagate FreeAgent Pro 750Gb, this was connected via eSATA that is having problems and I can only get to read sporadically at present. Like the first Samsung drive, its due an RMA.

So realistically I have 1.5Gb of data I need to rescue quite soon.

Options and considerations Ive come up with so far are:

1) External NAS device with RAID (e.g. QNAP TS-410)
Pros: External and therefore easy to maintain or expand seperate from the main rig. Security. Minimal downtime. Often use proven/reliable base hardware. Multiple RAID levels (e.g. 10/1+0, 5/6 for peace of mind)
Cons: Expensive. Capacity wall can be quickly reached, meaning another additional device/solution is needed.

2) Homebrew NAS server
Pros: Cheap (relative to an external NAS device). Potentially more expandable as requirements grow assuming a good RAID controller.
Cons: Needs much more time in setup and configuration. More time needed maintaining the OS on the boot drive. Likely much bigger form factor and power drain.

3) Combination of onboard RAID in my current rig and external HDDs for backup
Pros: Cheapest option to implement. Everything housed in one machine so less space/power needed.
Cons: Reliability could be a factor. Drain on the system. The array will need to be rebuilt if I upgrade mainboards in the future I assume (unless at that stage I turn the old hardware into homebrew NAS)?

Whatever option I take, im probably going to purchase a 2Tb drive this month to rescue my data while I work out the best long term solution.

Also, in terms of the hardware available at the moment, is it worth waiting for SATA3 compatible RAID cards/NAS devices for a bit more future proofing?

All thoughts, opinions and ideas welcome!

RAID/NAS storage solutions
Reply #1 on: March 08, 2010, 02:10:02 AM
already said this to nige on msn, but Ill chip it in here too

my vote goes for a raid card and internal drives

couple of cheap drives in raid 0 for os/programs/etc..
couple of tb drives in raid 1 for storage

or just 4 tb drives in raid 0+1 to do the lot...

as a side not tho... have you tried taking the external drive out of its case and making it internal ?

    • Tekforums.net - It's new and improved!
  • Offline Clock'd 0Ne

  • Clockedtastic
  • Posts: 10,945
  • Administrator
  • Hero Member
Re:RAID/NAS storage solutions
Reply #2 on: March 08, 2010, 03:25:43 AM
No I havnt tried that, it should still be under warranty. I only need to get it working once to copy the data off onto the 2Gb, then I can send it off to Seagate to replace. Maybe theyll be kind and send me something better!

  • Offline Serious

  • Posts: 14,467
  • Global Moderator
  • Hero Member
Re:RAID/NAS storage solutions
Reply #3 on: March 08, 2010, 10:15:17 AM
If youre just after backing up then a large external USB drive might do the trick cheaper. You shouldnt have backup connected all the time unless its backing up constantly. If so you should have a second backup thats disconnected regularly to reduce wear.

Only issue is speed.

I would have suggested optical media but that amount of data would take ages.

Re:RAID/NAS storage solutions
Reply #4 on: March 08, 2010, 12:57:48 PM
My preference would always be for a NAS raid solution. Slow power consumption, separate from your main rig so added security. Can also access it form all computers not just the one its in, as well as stream any media or photos if you have any need for that.

Down side is its probably the most expensive and non-expandable as youve already said but a 4gb version, 3gb data and 1gb for redundancy you should have a decent amount of headroom.

Im currently running a 300Gb Maxtor Shareddrive i bought from someone on here (sorry, cant remember) with two 1tb drives attached to it via USB, works well but an integrated solution would be better.
Formerly sexytw

    • Tekforums.net - It's new and improved!
  • Offline Clock'd 0Ne

  • Clockedtastic
  • Posts: 10,945
  • Administrator
  • Hero Member
Re:RAID/NAS storage solutions
Reply #5 on: March 08, 2010, 15:10:57 PM
Well Ive just ordered myself a Seagate Barracuda ST32000542AS 2TB.

Looking at the options a bit more today, theres a new Synology NAS, the DiskStation DS1010+, its a 5 bay unit with nothing special in it really, but you can buy an expansion module the DX510 that adds another 5 bays to the unit, so when Ive filled 5 I could expand to 10 bays quite easily under the same NAS.

I think Im definitely moving away from the idea of building my own NAS when I can buy something reliable and slick off the shelf, really I think that or Alans ideas are best. Id need to start saving lots of money though If I dont use Alans idea.

  • Offline Mardoni

  • Posts: 2,636
  • Global Moderator
  • Hero Member
  • On the Sofa, probably ;)
RAID/NAS storage solutions
Reply #6 on: March 08, 2010, 15:27:34 PM
Having recently gone through a similar loop for all my data, media and HTPC requirements Ill offer you this:

Is "fail over" really that necessary to you ? Or could you actually cope with maybe a day or two of downtime in a worst case scenario ?

I asked myself the same question and I decided that I could survive with having to rebuild if I really had to. As a result the solution I came up with for my backup needs was:

1) Replaced power hungry Dell PowerEdge server and Pentium D HTPC with an Acer Revo !
2) Hooked up an IcyBox Dual SATA USB enclosure (2 * 1TB HDD) and a Western Digital Elements 500GB USB HDD to the Revo.
3) All movies and TV onto the HDDs in the Icy Box
4) All Music, Pictures and Documents to the WD Elements
5) EVERYTHING thats important to me is backed up to Carbonite; "Cloud backup" service.

Now the "cunning" bit:
My "important" work machine runs Acronis and automagically generates an image of the boot partition which is stored onto the WD HDD connected to the Revo. Other "bits and pieces" from my work machine are also backed up onto the same WD HDD. Remember this is then uploaded to Carbonite.

I then make use of all of the "unused" space on other devices that I own (a laptop and a netbook).
Using SyncBack I keep an up-to-date copy of my entire music and picture collections on my netbook and laptop.
I also have a complete copy of all of my "work stuff" synchornised between the WD HDD and my laptop.

Here are my failure scenarios:
"ergh" case - The HDD in my Revo dies:
   Replace HDD, restore boot partition from Acronis which is located on a local USB HDD.

"annoying" case - My IcyBox dies taking the 2 SATA disks with it:
   All of my movies and TV are lost; until I restore them from Carbonites service.

"omg" case - Someone steals my entire living room:
   Restore everything except Movies and TV from other devices. Movies and TV are downloaded from Carbonite.

"seriously?" case - An EMP wipes out all electronics in my house:
   Buy new hardware and restore everything from Carbonite.


Hopefully Ill never need the carbonite service but the whole offsite storage thing just seems better than purely relying on local RAID and USB disks; plus its not all that expensive.

No doubt theres a scenario that Ive missed but hey, when it happens...Ill cry :p

RAID/NAS storage solutions
Reply #7 on: March 08, 2010, 15:47:38 PM
Wow, that carbonite looks like a brilliant service, thats amazingly good value.

How are you finding it?

EDIT: The mentioned file sizes are around 10Gb, does it work ok with 2Tb+ ?
Formerly sexytw

  • Offline Mardoni

  • Posts: 2,636
  • Global Moderator
  • Hero Member
  • On the Sofa, probably ;)
RAID/NAS storage solutions
Reply #8 on: March 08, 2010, 16:55:32 PM
Its spot on, with a couple of caveats:

1) Its a "Backup" service and not an "Archiving" service. Its designed to keep a 30 day delayed mirror of your actual files backed up. That is to say that if you delete file x from your pc, 30 days later file x will be removed from carbonite.
This also means that their software will not let you backup from a USB device; as you could simpily unplug the USB device but to their software this would look like the file being deleted...

...but how then are you doing exactly that ? (I hear you say ;))
Ive actually mounted the USB disks to NTFS folders rather than drive letters. Each of the USB mount points are located within a folder that is on a "static" HDD.
Their software has no problems with this ;)

So basically for the money it does seem really good. Just as long as you work around the fact that its a live backup.

The restore is pretty good too (had to try it out); pretty nippy downloads and you pick particular files/folders, not just the whole thing.

  • Offline Mardoni

  • Posts: 2,636
  • Global Moderator
  • Hero Member
  • On the Sofa, probably ;)
RAID/NAS storage solutions
Reply #9 on: March 08, 2010, 17:06:09 PM
Quote from: sexytw

EDIT: The mentioned file sizes are around 10Gb, does it work ok with 2Tb+ ?


None of my individual files are bigger than about 10GB. It does have 1 annoyance, you have to manually add any file over 2GB to the backup list. So as you can image, that took a while with my movie back catalogue :s

One other thing I have just remembered and I am not sure if this is expected or not, it certainly wasnt what I expected:
During testing the service, I had everything I wanted to backup in my C:\Users\John\ directory.
I added the directory to the Carbonite software.
I then manually added a couple of 4GB files, just to check ;)

Over the course of the next 24 hours everything was uploaded fine.

I then decided to move my entire profile from C:\Users\John to D:\John

Now I was expecting the carbonite software to do 1 of 2 things:
1) Warn me that C:\Users\John was no longer a valid path, suggest I download the backup and then continue monitoring.
2) Notice, realise, let me, update the carbonite software to show the new path and continue monitoring.

It did neither !
Instead it offered me the chance to restore from the web, to which I said no (as all the files were still here). At that point it deleted the remote backup and that was that.
I had to setup a new profile to cover D:\John and then wait for all of the files to upload again, even though they hadnt changed :/

This was its single biggest short coming and as a result I have now taken measures to ensure that everything I back up comes from a standard path of: C:\DATA_TO_BACKUP\
My thinking is that if I ever move files between folders or even entire disks, as long as the structure remains unchanged I will not have to upload everything again.

Hope that sort of makes sense :S

p.s.
Let me know if youre thinking of taking it up...
You can save $$$ by going through QuidCo and also if you stick me down as a referrer Ill get some extra months for free :)

  • Offline Pete

  • Posts: 5,155
  • Hero Member
Re:RAID/NAS storage solutions
Reply #10 on: March 08, 2010, 18:29:53 PM
Online backups work great but they eat lots of bandwidth - Ive used them before... tbh you might as well plug a usb drive in and run a daily backup job. Unless you really want an offsite solution

Id do what alan said, although you could go for a SS drive for the OS and apps and then just use onboard RAID to mirror 2 2gb drives.
I know sh*ts bad right now with all that starving bullsh*t and the dust storms and we are running out of french fries and burrito coverings.

    • Tekforums.net - It's new and improved!
  • Offline Clock'd 0Ne

  • Clockedtastic
  • Posts: 10,945
  • Administrator
  • Hero Member
Re:RAID/NAS storage solutions
Reply #11 on: March 08, 2010, 19:50:08 PM
I agree, even with it sounding so good as an offsite backup, I simply dont have the bandwidth capacity for it, my line is terrible and I can barely sustain 2Mbps. Im not sure I really like the idea forking out a fee either, a few years of paying them is the equivalent of paying for a NAS, plus I figure any truly vital work data for instance I could FTP to my own webspace. I dont like the idea that if for some reason my internet drops or they close the service Im suddenly without access to my backups.

What I really want is something I can manage myself and doesnt involve any 3rd parties, whatever the solution its going to involve some sort of RAID array, whether its a NAS or running off my own computer. Im trying to think fairly long term here, hence the idea of a expandable NAS being very appealing - when I need more space I can just drop a new disk in or upgrade a disk. The new Synology systems with an extra 5-bays available further down the line is especially appealing for this. 10 drives in a RAID 1+0/5/6? Sounds very appealing to me. Of course this is where it comes back to cost and while I do like the idea of having a controller in my rig I dont like the fact that I cant just unplug it all and hide it in the loft if I go away for example. The other big problem I keep forgetting about is that a lot of the bigger/better RAID controllers dont have up to date drivers for Windows 7 yet. The cost of the controllers themselves doesnt make a seperate NAS system seem as expensive either when some of these cards run into the hundreds of pounds.

But as I say, whatever option seems best will be a long term investment, hopefully.

RAID/NAS storage solutions
Reply #12 on: March 08, 2010, 20:23:51 PM
Wow, that Synology DiskStation DS1010+ is £700 with no disks, thats some crazy investment, i guess if you use 2tb disks it should be fine for a long time but wow.

Despite it not being quite as perfect, not expandable etc something like Buffalo 4TB LinkStation Quad Network Hard Drive, at £400ish with 4Tb, even if you buy a second one when youre out of space its going to be cheaper.

EDIT: Also, nimrod, thanks for the info, im not sure its for me right now but if i decide otherwise ill be sure to put your name down.
Formerly sexytw

RAID/NAS storage solutions
Reply #13 on: March 08, 2010, 20:41:04 PM
one thing to remember is.... by the time you run out of space, the available hard drives will be much bigger... and much cheaper per Gb....

so theres no pointing going for a solution thatll last 10 years... when it will be out of date in 2 anyway...

    • Tekforums.net - It's new and improved!
  • Offline Clock'd 0Ne

  • Clockedtastic
  • Posts: 10,945
  • Administrator
  • Hero Member
Re:RAID/NAS storage solutions
Reply #14 on: March 08, 2010, 21:27:40 PM
Hmm, good point Alan. Maybe a controller card is the way to go then since 6Gb/s SAS PCIe 2.0 cards are available now, although having just checked it seems thats £400 on its own too! :drama:

What sexytw said is true too, The Synology thing is twice the cost of a QNAP TS-410, which is 4 bay. I could get two of those for the same money! Admittedly its only just come out but thats still a lot of money of an empty set of bays.

The more I read the more its looking like daydreaming and prohibitely expensive to actually set something worthwhile up in this way.

Perhaps the most sensible solution is just to RAID 1 my data drives until Im rich enough for one of these bigger boys. The only thing I really dont like about considering onboard is that when I upgrade it could mean backing up all the data and reconfiguring the array on a new onboard controller - I have no idea if you can transplant RAID 1 arrays, although Ive read things that suggest you can since mirrored drives are intended to be readable individually too as failsafe if the raid dies - but again Im not certain on this. Again, it may not even be possible at all if I opted for a RAID 5/10 at some point too.

I guess I could get a cheapie PCI controller, then I can shift the whole lot in one go to another machine and only need worry about drivers I guess.

0 Members and 1 Guest are viewing this topic.