The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor. Or, at least, all the information that's visually meaningful.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has little to no impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, the 7-bit values used to note the differences aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
This only really matters at base ISO however, since that's the only time you're likely to capture more dynamic range than a 12-bit file can accurately store.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
Dec 6, 2017
Dec 6, 2017
Dec 5, 2017
Nov 30, 2017
|It's good to be at home by Nightcrawler12|
from Best photo of the week...
|Tiny tree by Kaappo|
The Olympus 17mm F1.2 promises to open up new possibilities for Micro Four Thirds shooters seeking razor-thin depth-of-field and smooth, 'feathered' bokeh. Take a peek at our extensive sample gallery.
Are you a speed freak? Hungry to photograph anything that goes 'zoom'? Or perhaps you just want to get Sports Illustrated-level shots of your child's soccer game. Keep reading to find out which cameras we think are best for sports and action shooting.
Still yearning for an Aperture replacement? Here's a quick overview of RAW Power, a Raw image editor for iOS that pairs with the Mac application introduced in 2016. Take a look at some of its capabilities.
Video features have become an important factor to many photographers when choosing a new camera. Read on to find out which cameras we think are best for the videophile.
Tech lover Albert Lee was one of the first to pre-order the intriguing 16-camera module Light L16. Two months in, here's what he has to say about using this not-so-little computational camera.
The public art installation featured blurred portraits, ostensibly captured by the artist under that same underpass... except they weren't. They were actually portraits of comedians, pulled from the 2015 Edinburgh Fringe Festival program.
Edelkrone has upgraded its SliderOne with a SliderOne Pro and introduced a new generation of Wing and Wing Pro models, all while simultaneously improving the app that controls its entirely lineup.
People have waiting a long time for the Canon 85mm F1.4L IS lens, but how does it compare to Canon's 85mm F1.2L and Sigma's 85mm F1.4 Art? Phillip Pettit of Lensrentals took all three lenses for a spin to find out.
Affinity Photo for iPad, one of the first full-featured Raw editors designed specifically for tablet use, has been named Apple's Best iPad App of 2017. And what's more, it's currently 50% off!
VSCO Messages allows VSCO X subscribers and free users alike to share text, images, photo editing 'recipes', VSCO journal entries and more.
Flickr has revealed their top 25 photos of 2017, and there are some truly stunning shots in the mix.
Testing of the Canon G1 X Mark III is well underway, inside of the studio and out. We've just added it to our test scene comparison tool, where you can take a look at its performance side-by-side against peers like the Sony Cyber-shot RX100 V.
Whether it's a trip to the beach for some snorkeling or scrambling up a 10,000 ft volcano, the Olympus Tough TG-5 proved to be a great travel companion for Jeff. That's why it's his 2017 Gear of the Year.
Last year, the DJI Mavic Pro and the Phantom 4 Professional took top honors in our end of year buying guide. Read on to find out who it this year for beginners, consumers, prosumers, and professionals at a price tag less than $2,000.
Meyer Optik Goerlitz is resurrecting yet another classic lens. This time, the company has set its crowdfunding sights on the Primoplan 75mm F1.9, a lens originally manufactured in a run of just 2,000 back in the 1930s.
The folks at Kolari Vision—an infrared camera conversion company based in New Jersey—recently tore down a brand new Sony a7RIII, giving everybody a peek at the camera's much-improved weather sealing.
Resource Travel's Brandon Cunningham recently joined The Giving Lens for a 10-day adventure in India. A trip he won't soon forget, to a country that left him in "sensory and soul overload."
Meet the new Freefly Movi, a handheld gimbal stabilizer designed by cinema stabilization pros for use with the iPhone. Freefly is calling this little beast "the world's most portable, adaptable, and intuitive cinema robot."
Photography portfolio site PhotoShelter is adding their voice to the growing group of online companies that are speaking out in favor of net neutrality, and against the FCC's upcoming vote to kill it.
The Direct app would replace the current Inbox on the Instagram app, doing for Instagram what the Facebook Messenger app did for Facebook on mobile.
Qualcomm's latest high-end mobile chipset offers higher frame rates and a wider color gamut, among other important camera improvements you can expect to see in next year's flagship smartphones.
Photographer Josselin Cornou recently got trapped in a blizzard in the Snowy Mountains of Australia with his Fujifilm GFX 50S and new Tamron 15-30mm F2.8 lens. Find out how they held up to 110km/h winds and -15°C temperatures.
While film nostalgia reaches an all-time high, Seattle-based pro photographer Sofi Lee is turning back to 'digicams' made between 2008 and 2011.
The fixed prime lens camera market may be a bit niche, but it's here that you'll find some of the best cameras you can buy. Sensors ranging from APS-C to full-frame are designed to match their lenses, which cover ranges from 28-75mm equivalent, so image quality is top-notch.
With a capacity of 512GB, Samsung's new UFS chips take built-in storage on smartphones to desktop-PC levels. Will this eliminate the need for microSD slots?
Photographer Josh Rossi decided to go big for this year's Christmas card, so he recreated the Star Wars: The Last Jedi poster using himself, his wife, and their two kids.
In response to a NY Times article about how some traffickers were using Instagram as part of the illicit animal trade, Instagram has added a content advisory screen that pops up to warn users any time they search for hashtags "associated with harmful behavior to animals."
Kodak is expanding its instant photography lineup today with the release of the Kodak Mini Shot Instant 10MP camera. A tiny little digital camera that spits out either 2.1 x 3.4-inch or 2.1 x 2.1-inch prints.
Huawei'e next high-end smartphone could be the first to take computational imaging to the next level with a triple-camera that spits out 40MP files.
Landscape photographer Spencer Cox recalls the single most rewarding—and frightening—landscape photography experience of his life: photographing a sandstorm.