OT: what's your storage solution?

turnstyle

Veteran Member
Messages
1,980
Reaction score
271
Location
NYC, NY, US
Hi all,

I archive files to a 500GB USB drive, and I mirror that to a second 500GB drive. I opted to get a pair of drives rather than a mirrored RAID because, it seemed to me, a single RAID could become a single point of failure.

Anyhow, with 24MB RAW files I can see that it's not too long before I'll need more storage.

So, I'm wondering: what's your storage solution?
 
two small LaCie 0.5Tb drives for portability & convenience (esp.
in travel scenarios) + 2Tb Iomega Prestige, and I do backup original
RAWs in shoot batches = each on their own dedicated 4.7 Gb DVDs;

but... all this "free" storage disappears in a frightening speed :(,

jpr2
--
~
street candids (non-interactive):
http://www.flickriver.com/photos/qmusaget/sets/72157609618638319/
music and dance:
http://www.flickriver.com/photos/qmusaget/sets/72157600341265280/
B&W:
http://www.flickriver.com/photos/qmusaget/sets/72157623306407882/
wildlife & macro:
http://www.flickriver.com/photos/qmusaget/sets/72157600341377106/
interactive street:
http://www.flickriver.com/photos/qmusaget/sets/72157623181919323/

Comments and critique are always welcome!
~
 
I ran out of HD space on my old computer, and needed to upgrade processor speed and RAM anyway, so I just got a brand-new system built. Part of that was storage solutions, which I use thusly:

Twin 1TB drives in the computer, in a RAID backup array

Two 1.5 TB external drives - one which backs up the main drive weekly or daily (depending on how much I shoot) via USB3.0, and the second which I use to manually back up all data once a quarter or so, and keep off site.

This gives me triplicate backup - the RAID for whole computer backup in the event of a single drive failure, the main external backup for regular backup to a seperate device, and a second external backup stored off site for emergencies and redundancy.

If I run out of room on the 1TB internal drives, I can switch them to non-raid and use them as dual drives for a total of 2TB, and continue to use the externals to back up data - purchasing an additional 2TB external drive for whole system backup...that would still give me double backup redundancy and a doubling of my storage capacity at minimal cost.

--
Justin
galleries: http://www.pbase.com/zackiedawg
 
Readynas Ultra 6 +
6 2TB drives (X-Raid 2)

Has 2xGigE.

With snapshots and offsite backups. Everything accessible via DLNA for file share. This NAS is actually faster access than the disks in my computer.

The best way to fly.
 
Am I crazy for not quite trusting RAID? Somehow I feel like something could go wrong in the enclosure, whereas with two totally separate drives (in separate enclosures) seems safer.
 
Am I crazy for not quite trusting RAID? Somehow I feel like something could go wrong in the enclosure, whereas with two totally separate drives (in separate enclosures) seems safer.
No, you're not crazy. If the controller fails, both (or all if you are using several) drives can be corrupted.
 
Short term - a 1 terabyte USB drive plus backups to DVD.

Longer term, when they become available, Millenniata Blu-Ray disks. So far, they have only released DVDs.
 
I can't bring myself to use disks (or discs) anymore.

Does anybody happen to know if WinXP has a size limit for drives attached via USB?

(Yeah, I know, XP is old -- but I have an old XP box that I use as our home server.)
 
I wouldn't call it crazy. Even though I have one, I still back up to externals seperately mostly because I don't 100% trust that the RAID would be safe, as mentioned if there were a control failure or virus intrusion. It should be safe for a drive failure, which is how I intend to use mine.

I've considered backing up photos to BluRay disks too - need to look into how many I'd need to back up my photos now.

--
Justin
galleries: http://www.pbase.com/zackiedawg
 
Does anybody happen to know if WinXP has a size limit for drives attached via USB?
Same as any other drive. The limits are dictated by the format rather than the connection type. Use NTFS on all drives including USB and you're unlikely to hit any meaningful drive size limits in the foreseeable future.

--
John Bean [GMT]
 
Hi all,

I archive files to a 500GB USB drive, and I mirror that to a second 500GB drive. I opted to get a pair of drives rather than a mirrored RAID because, it seemed to me, a single RAID could become a single point of failure.

Anyhow, with 24MB RAW files I can see that it's not too long before I'll need more storage.

So, I'm wondering: what's your storage solution?
Primary Drive:

Files stored on a Drobo with four 1.5TB drives with DROBO RAID.. one drive can fail.

Onsite Backup:
TimeMachine on networked Drobo five 2TB drives, where two drives can fail.

Crashplan backed up to Linux Raid Server ..

Aperture Files are also backed up to single 2TB USB3 drive which is then turned off.

Offsite/Fire Backup:

Crashplan central vault in .. I think.. Minnesota. House burns down and these are still available.

BluRay: In locked fireproof safe within another large fireproof safe.

JPG on Flickr Professional Account.

I'm a big fan of Drobo.. slow but reliable (Linux under the hood) and Ubuntu servers... again a cheap/reliable Linux solution.
 
Am I crazy for not quite trusting RAID? Somehow I feel like something could go wrong in the enclosure, whereas with two totally separate drives (in separate enclosures) seems safer.
You are not crazy. Offsite backups is best. FWIW, look into "rsnapshot" as well for various recovery needs. Every hour every folder is archived (with very small increase in overall disk use).

WRT offsite. Most folks just plug a drive into their RAID and grab a snapshot. Then store in the trunk of the car. Another option is to synchronize with another NAS (see things like rsync) in a distant location.

CDs/DVDs/Blu-rays are not cutting it for me anymore. Too much labor when you are dealing with HD video and large pictures. Also, verification of CDs/DVDs/Blu-Ray on a routine basis is important (and most folks don't do this).
 
Perhaps generalizing this a bit.

You should not trust one technology, nor one program, nor one location for backup.

It isn't a matter of don't trust raid because the enclosure might fail. If this were rational, then there would be no reason for a mirrored type of raid to exist. Do not trust any one device to survive.

Also, don't trust people. My office keeps medical and financial records on computer. I once had a primary data failure where my office person probably was responsible for the failure. She tried to figure out recovery on her own and in the process she corrupted multiple back strategies. Luckily, I made sure that she could not get to my offsite backup and all files were recovered.
 
Personally I have two portable lacie rugged I use to carry around and where I keep my working aperture library, this is backed up to a 1tb NAS box, which also has all my other media, which inturn I back up every quarter or so.

I also upload full size pics onto flickr which I keep private and is there purely for backup reasons, the 2 lacies are only 160gb each so I will need to upgrade those and will need to upgrade the nas at some point in the future too(hopefully I can hold off until ssd drives are cheap enough for large storage sizes)
 
I personally use mirrored 2TB sata drives to store my data and I make backups to an RD1000 to take offsite as needed. This arrangement is sufficient in 99% of all cases, regardless of industry. Anything more is simply a level of incremental protection or, as it is in most cases, for time saving purposes, not disaster recovery purposes.

If you are only storing your images on a raid array of some sort, YOU DO NOT HAVE A BACKUP. RAID, in and of itself, is NOT a backup. It's simply a redudent storage medium that is designed to handle some level of hardware failure. It does not protect against corrupt files, ovewritten files, delete files or total disaster (fire at your home, flood, etc).

Likewise if you have multiple raid arrays and are mirroring them in some way, you still don't have a real backup. File corruption / delete / edits will still be pushed across those arrays and you still have no answer for disaster situations.

A single drive solution that is backed up regularly (after any major changes, nightly, etc) to something that is removed from that main location is more than sufficient for most peoples use and for most disaster situations. If you want to take the local protection up a notch, you get a raid array of some sort which will protect you against a single hardware failure. All this really does for you is prevent you from having to invest the time in retreiving your data from your real backup source. Most of the software's for these online services are designed to monitor for changes and backup when there are any. It happens real time. So using those along with a single or multiple drive solution at home is plenty. You can spend limitless amounts of money on disaster recovery solutions, but there is a point where spending only results in a fraction of a percentage point of difference. Common sense is your friend.

controller or array (backplane) failures rarely result in drive corruption anymore, especially if it's a mirror.
 
Does anybody happen to know if WinXP has a size limit for drives attached via USB?
Same as any other drive. The limits are dictated by the format rather than the connection type. Use NTFS on all drives including USB and you're unlikely to hit any meaningful drive size limits in the foreseeable future.
I think there is some sort of limit in some cases of 2TB. There are troubles, depending on partition type, that were making some 3TB drives show up significantly smaller (750GB or something?) to Windows. I believe it has to do with the partition table style... The Master Boot Record (MBR) style is limited to 2.2TB, but GUID Partition Tables (GPT) are not. Windows XP doesn't support GPT, so you have to use a special disk utility to break a 3+TB drive into smaller partitions. On Vista or 7, you can use GPT.

You can't boot a GPT partitioned drive unless you have a newer motherboard that uses the UEFI BIOS, but you can mount a GPT partitioned drive to use for data storage after the computer has booted into Windows Vista/7.

Have a look at this informative page from Seagate:
http://seagate.custkb.com/seagate/crm/selfservice/search.jsp?DocId=218619

Personally, I have 4 1TB 7200rpm drives in a RAID0+1 array, which gives me the benefits of both high performance and redundancy. It is configured as two RAID0 striped sets that are mirrored (RAID1) to each other. It gives me only 2TB of usable storage space, but if any one drive fails, I won't lose my data (I could technically lose two drives, so long as the two drives were members of the same RAID0 array). I also get twice the data throughput of a single drive.

In addition to my big RAID setup, I have a 1TB 2.5" drive that I keep in an external enclosure for moving large bunches of data about, a 120GB SSD in an external USB3.0 enclosure for moving small collections of data about in an extremely fast manner (somewhere around 400MB/s max), and a 3TB external USB3.0 hard drive that I use for backup purposes.
 
Does anybody happen to know if WinXP has a size limit for drives attached via USB?
Same as any other drive. The limits are dictated by the format rather than the connection type. Use NTFS on all drives including USB and you're unlikely to hit any meaningful drive size limits in the foreseeable future.
I think there is some sort of limit in some cases of 2TB. There are troubles, depending on partition type, that were making some 3TB drives show up significantly smaller (750GB or something?) to Windows. I believe it has to do with the partition table style... The Master Boot Record (MBR) style is limited to 2.2TB, but GUID Partition Tables (GPT) are not. Windows XP doesn't support GPT, so you have to use a special disk utility to break a 3+TB drive into smaller partitions. On Vista or 7, you can use GPT.
You're right of course, but to clarify: I was answering a question about USB drive size limitations on XP, which is why I said that as long as it's formatted NTFS it has no additional size limitations compared with any other (non-USB) drive on the same PC.

--
John Bean [GMT]
 
Does anybody happen to know if WinXP has a size limit for drives attached via USB?
Same as any other drive. The limits are dictated by the format rather than the connection type. Use NTFS on all drives including USB and you're unlikely to hit any meaningful drive size limits in the foreseeable future.
I think there is some sort of limit in some cases of 2TB. There are troubles, depending on partition type, that were making some 3TB drives show up significantly smaller (750GB or something?) to Windows. I believe it has to do with the partition table style... The Master Boot Record (MBR) style is limited to 2.2TB, but GUID Partition Tables (GPT) are not. Windows XP doesn't support GPT, so you have to use a special disk utility to break a 3+TB drive into smaller partitions. On Vista or 7, you can use GPT.
You're right of course, but to clarify: I was answering a question about USB drive size limitations on XP, which is why I said that as long as it's formatted NTFS it has no additional size limitations compared with any other (non-USB) drive on the same PC.
Thanks, I really appreciate this info.

To be sure I follow: I would be fine with a 4TB drive via USB on an old XP box, without any need for special drivers or any such? However, if I were to want to install the drives internally (presumably via SATA), that would be a problem -- is that all correct?

For example, from this page:
http://seagate.custkb.com/seagate/crm/selfservice/search.jsp?DocId=218619

"Windows XP sees a 3TB drive as 800GB on boot or data drives" -- that applies to internal, rather than USB use?
 
All,

Keeping your images safe is not all about devices it is about process. If you visit http://dpbestflow.org you will find a very good digital workflow process, and more.

It follows the 3-2-1 principal. You have one working copy of your image, one local backup and one offsite backup. I actually have four. I am using Macs and here is the process I follow;

When I am done with a shoot. I take ingest the card into Aperture.

When I have all the cards imported I use my offline Drobo and export to the vault on the Drobo which then gets unplugged an disconnected.
Apples Time Machine backs up the computer to another drive.

Finally on a regular basis (manual) I use 2.5in bare drives to backup the data to be taken offsite.

I DO NOT edit any images until the export to the Drobo is done. I like to save the memory cars until the time machine backup is also done.

I have abandoned optical media at this point. The RAW images are just too much for me at this point.

rjf
 
All my photos are on a 1tb RAID in my office and every night they are backed up to the Cloud. I use BackBlaze as my off-site storage. I was using Mozy but they put a cap on the gigs of storage. Carbonite will only allow back up of your HD not a connected HD. BackBlaze is apx $50 per year for unlimited. Every night my docs and photos are stored offsite. It took a month to do the full back up but now it is a short time every night to stay updated.

Bob
--
http://www.flickr.com/photos/bobjagendorf/
 

Keyboard shortcuts

Back
Top