What computer to easily process D800 files?

Started Jul 30, 2013 | Discussions thread
Hasa
Regular MemberPosts: 416Gear list
Like?
Re: SSD vs RAID
In reply to moogle73, Aug 4, 2013

Good point!

So my minimum RAID configurations are: 3 disks hooked up in RAID 5 deliver maybe 50% faster performance at 2/3 usable disk space of the whole array + backup in case of failure.

This is the config favoured by many data centres.

The other is minimum 4 disks for RAID 1+0 (some call it RAID 10) which are the two options you mentioned combined (i.e. you can NOT loose the whole raid if 1 drive fails) : 100% faster speed at 1/2 usable disk space of the whole array + backup in case of failure. This cost of backup is the same as copying to external drives assuming they all cost the same / GB.

I run RAID 1+0.

When my RAID was empty it was exactly twice the speed of a single disk outside the raid.

I did partition the RAID into two virtual drives after setting it up. Each has a usable space of 1,81TB after formatting. I do not know the amount of net usable space of a single, formatted 2TB drive outside the RAID.

It seems I last ran defragmentation in 2010 and the status is "0% fragmented" on the 85% full drive.

Now at 85% full these are the benchmarks for the RAID and a reasonably fast and CHEAP flash card I use in the D800:

-- hide signature --

CrystalDiskMark 2.2 (C) 2007-2008 hiyohiyo
Crystal Dew World : http://crystalmark.info/
--------------------------------------------------
RAID drive:

Sequential Read : 142.750 MB/s
Sequential Write : 191.288 MB/s
Random Read 512KB : 73.071 MB/s
Random Write 512KB : 185.334 MB/s
Random Read 4KB : 1.301 MB/s
Random Write 4KB : 10.918 MB/s

Test Size : 100 MB
Date : 2013/08/04 2:47:28
----------------------------------------------------
--------------------------------------------------
CrystalDiskMark 2.2 (C) 2007-2008 hiyohiyo
Crystal Dew World : http://crystalmark.info/
--------------------------------------------------
ADATA CompactFlash 533x 32GB on Kingston USB3 flash readerFCR-HS3
Sequential Read : 70.336 MB/s
Sequential Write : 17.009 MB/s
Random Read 512KB : 61.671 MB/s
Random Write 512KB : 11.438 MB/s
Random Read 4KB : 3.351 MB/s
Random Write 4KB : 0.647 MB/s

Test Size : 100 MB
Date : 2013/08/04 11:17:04

-----------------------------------------------------

So I can write twice as fast on the raid as I read from the flash

The importation of files, conversion to DNG, generation of previews, creating entries in the database must be almost entirely down to the limit of the flash card and the CPU. Writing in a blog consumes 3-6% CPU at 800Mhz while the LR operations increases the clock to the max 3200 MHz and spasmodic 100% CPU utilization of all the 6 cores.

I concur that database operations would possibly gain from faster disk as these operations are limited by the available IOPS on the storage system.

Other contributors have pointed out very useful links to articles about Lightroom optimization and it seems there is comparatively little to gain from the actual LR operation by using SSDs and there is a lot to gain from tuning LR itself.

As an example: a Catalog is recommended NOT to exceed 10.000 files by Adobe unless performance is degraded.

I have an app on the desktop displaying ressource consumption all the time. With LR I never use more than 5GB RAM - but the CPU tops out - so for my rig I would prioritize quicker CPU over anything else at 8GB RAM and RAID 1+0.

However the performance is not at all bad for a 2010 rig!

In any case I will check the disk queues in windows ressource monitor to see if I have a problem that can be solved by reconfiguring LR.

Conclusion:

from what I have read up to now I should install LR on the RAID - alternatively buy a 250GB SSD for a new C: - thereby forcing myself to clean out lots of programs I never use - a BIG job. Plus use the optimization tricks recommended by Adobe.

Computer startup time is FAST - I just put it in "sleep" mode - i.e. I do not need an SSD to make the PC start fast.

C: looks like this:

--------------------------------------------------
CrystalDiskMark 2.2 (C) 2007-2008 hiyohiyo
Crystal Dew World : http://crystalmark.info/
--------------------------------------------------

Sequential Read : 74.136 MB/s
Sequential Write : 75.841 MB/s
Random Read 512KB : 29.537 MB/s
Random Write 512KB : 55.409 MB/s
Random Read 4KB : 0.378 MB/s
Random Write 4KB : 0.825 MB/s

Test Size : 100 MB
Date : 2013/08/04 12:02:37

Smile and the world smiles back!

 Hasa's gear list:Hasa's gear list
Nikon D800 Nikon AF Nikkor 20mm f/2.8D Nikon AF-S Teleconverter TC-17E II Sigma 15mm F2.8 EX DG Diagonal Fisheye Carl Zeiss Distagon T* 2/35 +8 more
Reply   Reply with quote   Complain
Post (hide subjects)Posted by
(unknown member)
(unknown member)
Keyboard shortcuts:
FForum PPrevious NNext WNext unread UUpvote SSubscribe RReply QQuote BBookmark post MMy threads
Color scheme? Blue / Yellow