The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has very little impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, then the 7-bit values used to note the differences of the individual pixels aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
Jul 21, 2017
Jul 24, 2017
Jul 21, 2017
Jul 21, 2017
Wildlife and nature photographer Peter Mather tells the story behind this exceptional shot of a mama grizzly and her cub searching for salmon in Yukon, Canada.
Popular YouTube channel TastyTuts has put together this 33-video Beginner's Guide to Adobe Photoshop—a godsend for anybody who wants to learn Photoshop from scratch.
The long anticipated replacement for the popular Rode VideoMic Pro is almost ready for shipping. The price of the upgraded VideoMic Pro+ will be £290/$300 when it goes on sale in mid-August.
A new iOS app called Explorest wants to help you find new locations to shoot. It's limited to Singapore for now, but the app is packed full of useful location scouting features.
Nikon's D850 development announcement is extremely light on details, so we assembled a wish list of upgrades and features we'd love to see.
Nikon has announced the development of the long-awaited replacement to its full-frame D810: the D850. Nikon says that the D850 will build on the strengths of its predecessor and offer 'new technologies, features and performance enhancements.'
Lens manufacturer Voigtlander has introduced a 65mm F2 macro lens for Sony E-mount that it says "rates as one of the finest in the history of Voigtländer."
The UK released a preview of their upcoming drone safety regulations, and it looks like drone pilots will have to both register their device and pass safety awareness tests.
National Geographic photographer Bob Holmes talks about light, and why you need to learn how to 'see' and not just 'look' at your subject.
Photographer Alessandro Barteletti shares the story behind his National Geographic Italia cover, shot with a 10-year-old DSLR and an iPhone flashlight.
Fashion catalog photographers in China have some next-level models to work with. In this video, you see one model hitting 30 poses in 15 seconds as the photographer snaps away.
Photographer Paul Adshead breaks down 11 photography-related smartphone apps he couldn't live without—from a pocket light meter to a lighting diagram app.
Fast-growing Chinese flash brand Godox is teasing a brand new flash trigger... for smartphones. The Godox A1 is a 'phone flash system' that can act as both flash and 2.4GHz trigger.
On July 12, Canon opened its newest Technology and Support Center, designed to serve the motion picture industry, in Burbank, CA. DPReview got a sneak peak and takes you behind the scenes.
The Sigma 14mm F1.8 Art is truly one-of-a-kind. It offers the fastest aperture of any lens that shares its focal length, produces beautiful sunstars and is incredibly sharp to boot. If you're in the market for a fast ultrawide prime, this looks to be the one to get.
In this article, expert macro photographer Thomas Shahan shares advice for successful closeup photography of bugs, insects and small animals.
DJI's new firmware makes it difficult to fly in restricted airspace, even when you have proper clearance. Is DJI placing themselves between professionals and the FAA?
Go behind the scenes with National Geographic photographer Renan Ozturk and see what it takes to capture a dangerous, harrowing, stunning Nat Geo photo essay.
Erez Marom tells the story behind this ominous photo of the sand 'reaching up' towards the mountains at Skagsanden beach in Norway. He calls this photo 'Torment.'
DPReview staffer Carey Rose has taken the Panasonic Leica DG 15mm F1.7 along for everything from a city-side boat ride to a bachelor party across the mountains. Find out how the little Leica fared.
Canon just unveiled the largest 12-ink printer on the market. The new imagePROGRAF PRO-6000 printer can make prints from 17 all the way up to 60 inches wide.
"Standing in one of the holiest places on earth, I felt uneasy," writes Wired's Jason Parham. "Most of my fellow visitors, I realized with a brief bloom of nausea, were taking selfies."
Christopher Nolan's Dunkirk has been receiving great reviews, but it's a challenge to see it in its full glory. This handy infographic reveals the aspect ratio chaos that is wrought as the industry retreats from film.
Anti-bullying organization Ditch the Label's Annual Bullying Survey 2017 reveals yet again that Instagram, more so than any other social network, has the worst effect on youth mental health.
It's been a crazy day for innovative patent news. Apparently Sony is thinking of developing a medium format curved sensor camera.
An update to the Silkypix Raw converter fixes some bugs and adds support for several popular new cameras.
This crazy custom-built underwater camera shoots 8x10 large format film. It's supposedly "the first successful underwater 8x10 ever made," and it can be yours for $5,800... plus shipping.
Blackmagic just reveled a new accessory for their Cintel Film Scanner. The Cintel Audio and KeyKode Reader can capture KeyKode data and high-quality audio from film in real-time as it is being scanned.
A new Nikon patent shows a lens designed for a curved full-frame sensor. Could this be the high-end Nikon mirrorless camera people are hoping for?
The ability to shoot images at 1,000 fps first appeared in a Sony smartphone sensor. Now the Japanese manufacturer is using the same feature for industrial applications.