You Can’t Back Your Files Up Enough
Posted by SpikeAug 29
…. and you always learn the lesson the hard way.
Point 1: The electricity supply in Hong Kong village houses is somewhat antiquated. Any time there’s a thunder storm and lightning comes down out of the sky somewhere in the immediate vicinity, the main circuit breaker pops and my house loses all electricity. The circuit breaker is outside the house and of course it only needs to be reset when the rain is coming down in buckets. For various reasons, it’s not always possible for me to shut my computer down when a storm is coming and I know this could happen. Or I suppose I could bring in some electrical contractor to redo the wiring or to modernize this stuff. Except that I only rent the joint and I expect to be gone next year and I know my landlord wouldn’t pay for it.
Point 2: I keep my important data on RAID 1 drives – two identical drives, one mirroring the other. One drive fails, the other is okay and you don’t lose anything. Or so you are told.
So, thunder storm. Power goes out. Power gets switched back on and one of my RAID boxes, 750 gig X 2 drives by Buffalo, indicates that drive 1 ain’t doing so well. I switch off the box, switch it back on and it starts rebuilding drive 1. A few hours later, it all seems good. Except it wasn’t.
Some of the files are missing. And some are now just 0 bytes. I keep two kinds of data on this drive – my iTunes collection and all of my photos. I start going through iTunes – I start at “A,” checking every file to see which ones are gone and which ones are still there but are now “nothing.” Of course I can’t finish this in one sitting because I have almost 45,000 songs sitting in iTunes. And when I come back the next day, some of the files that were okay the day before are now also screwed. Some of the files that I re-added the day before are gone again.
The problem would seem to be that the power surge (and yes, I do have this plugged into a surge protector, albeit a cheap one) has damaged the drive controller. Which then screws up the directories and file systems. And the files are fucked.
I got a new RAID box, copied over everything copy-able from the old drive. I’ll smash open the Buffalo box, rescue the two hard disks (which I can reformat and reuse) and toss the box.
The iTunes stuff can all be restored – it’s just really freaking time consuming.
The photos? Actually, I’m too scared to look right now. I don’t want to think about what might have been lost – and 95% of them can’t be recovered if they’re gone.
So, now … back-ups on two separate physical devices? Off-site storage? Seems like “the cloud” is a possible answer but since I’m talking at least 100 gig here, I don’t know if there’s any solution that falls within my meager budget. Suggestions? Recommendations?
Sigh.


17 comments
Comment by jisampedro on August 30, 2010 at 12:19 am
I think sometimes depends on your own luck but that´s not very technical explanation at all. It´s like, maybe you don´t have any antivirus installed and surf the web without getting infections and in the other hand, someone more concerned about security gets more attacks. Why?…
In my case, I have all my files in just one external hard drive. Too risky? though I have one partition for system and another for data in my notebook, I just keep some recent files in the data partition but finally they are all moved to the external hdd. Hope one day does not fail, ´til now everything is fine.
Maybe you have seen this video already http://blog.chasejarvis.com/blog/2010/06/workflow-and-backup-for-photo-video/
This would be the dream of anyone but of course the pocket is first.
Maybe having like 3 hdd´s . One quite big for everything and then other 2 to make some backups and separate music in one and then photos and documents in the other.
Hope you are able to recover the information. Sure is not all lost and can minimize the loss.
Cheers.
Comment by Wilson Smith on August 30, 2010 at 1:46 am
I have two external 1TB USB drives that I manually mirror from time to time. God knows if they’d survive a power system like you have and I can certainly imagine the pain you’re going through. I hope it winds up working out reasonably well!
Comment by Yusuf on August 30, 2010 at 4:59 am
Couple of options
a) BackBlaze: http://www.backblaze.com/ US$ 5/computer. Doesn’t involve any bw or storage charges. I’ve not been able to determine if they are doing multi-datacenter or multi-pod backups themselves
b) JungleDisk: http://www.jungledisk.com/. Pay per computer as well as bw/storage charge of either Amazon or Rackspace Cloud storage
The initial upload will take a bit of a while so either you find someone who has a fat symmetrical pipe in HK or you see if the vendor takes a copy of the disks and can do an upload for you from within their datacenter.
Comment by Brad on August 30, 2010 at 7:57 am
http://www.apc.com/products/family/index.cfm?id=17
Comment by TonyB on August 30, 2010 at 8:37 am
I use the 3 HDD method.
All the stuff I dont want to lose live on mirrored drives and once a month I back all of it up to a single drive.
Comment by whitedusk on August 30, 2010 at 9:05 am
I burn all my important photos onto a DVD periodically. Survives any short-circuit.
Comment by Uncovery on August 30, 2010 at 9:54 am
I have a Raid supported NAS with a UPS where I backup my stuff regularly by copying it over from my PC. That way I am save from deletion and hardware outages.
Comment by eric on August 30, 2010 at 11:37 am
Tech guy like you, and you don’t have it backed up to something that is either not kept plugged into the grid 24/7 or in a server farm somewhere ?
Comment by Spike on August 30, 2010 at 12:10 pm
Whiteduskred – extraordinarily time consuming and I’ve had a number of DVD-R failures over the years.
Comment by Spike on August 30, 2010 at 12:11 pm
I don’t have the budget Eric.
Comment by Billy on August 30, 2010 at 12:41 pm
Get an external USB drive and back up to it once a month; keep it in your car or office, unplugged. Cheap but effective.
Comment by Fernando on August 30, 2010 at 12:47 pm
I had a backup scare recently as well. Right now duplicating medium sized HardDrives seems like the most cost effective approach. I’m using both Time Machine to external and also the backup and archive options in Scrivener, Sibelius, Lightroom and Logic to back everything up.
Prices for cloud is coming down, but right now it is still slower (from my perspective) than doing it manually.
Where I live the power is good. But, I only survived India with a lot UPS units on *every* electronic powerpoint.
Comment by whitedusk on August 30, 2010 at 1:46 pm
*crossing fingers* I haven’t had bad luck with a DVD-r over the years and hopefully it stays that way. If you are going to increase storage devices the extra electricity usage may “trip” you even more. Best you get a UPS with whatever you plan to do~
Comment by lastchancekowloon on August 30, 2010 at 8:31 pm
I use mobileme, and it works brilliantly, but I’m only dealing with about 2 gigs of files. Cloud is def the way to go… The initial upload, however, as someone alluded to, would take ages.
Comment by mikke on August 31, 2010 at 12:53 am
I have been through hell with back ups over the past 2 months. Due to space constraints on some of the PC’s ( I have 3 PC’s and 2 macs) I bought a HP Media Server (2x1TB). Main reason was, I wanted to have all music in one location, and make back up from there. I have tried using the Media Collector, the Back up service, just moving files. iTunes files disappear, get’s duplicated, I loose connectivity (although computers and media server are all in one house), pretty much everything happens. The worst thing is, the feeling that the set up can’t be trusted. I am now back to separate drives for each computer, although external, but I am uncertain if I can use the Media Server even to back them up. Not sure where I go from here.
Comment by jd on August 31, 2010 at 10:17 am
It’s funny (not if it happens to oneself) how many times I’ve heard of RAID failures like this – I’m skeptical of having some system that automatically overwrites the data on the “failed” drive. I apologize for mentioning it, but you’ve had quite a few RAID failures that you’ve mentioned on this blog!
I’d much rather have separate physical devices that are backed up to periodically – time machine does that for me now, but rsync will suffice in a pinch.
Comment by Spike on August 31, 2010 at 12:17 pm
I’ve had quite a few disk failures, yes, but not that many RAID failures.
One of the tech support guys in my office told me yesterday that the problem was my reliance on hardware RAID solutions – he says software-based RAID is a better approach. Or maybe the issue is that I’m buying cheap boxes and getting what I pay for.