The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor. Or, at least, all the information that's visually meaningful.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has little to no impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, the 7-bit values used to note the differences aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
This only really matters at base ISO however, since that's the only time you're likely to capture more dynamic range than a 12-bit file can accurately store.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
|splat by Eb Swarbrick|
from Album cover for a rock band
|Madagascar1 by Jaklab|
from Mind and matter - the creations of humanity.
CVS is banning digitally altered beauty imagery on its store-brand beauty products, and plans to mark other brands' images as "Digitally Altered" if they're not up to snuff by the end of 2020.
Canon has announced that it will introduce a series of printers that allow users to refill the ink tanks themselves—a surprising shift that could, in theory, save customers quite a bit of money.
Adventure and lifestyle photographer Lucy Martin put together a useful little video that goes over her 18 favorite Lightroom shortcuts—a great guide for beginners.
Following a series of allegations of sexual misconduct against Bruce Weber and Mario Testino, magazine publisher Conde Nast has severed ties with both of the famed fashion photographers, and released a code of conduct for future photo shoots.
Photographer Christopher Payne captures the 'colorful world of craft and complexity' you'll find in the General Pencil Company's factory in Jersey City... and almost nowhere else.
A new feature in the Google Arts & Culture app compares your facial features to its database of thousands of artworks, finding your fine art "doppelganger."
Recently, we spent a day in Los Angeles with photographer, cook and food blogger Kylie Mazon. Join us and see how Kylie approaches the challenge of shooting lifestyle and promotional images for a downtown hotel with the Canon EOS M6.
Leica has announced a pair of short telephoto lenses for its SL full-frame mirrorless camera. The APO-Summicron-SL 75mm and 90mm F2 ASPH lenses feature an apochromatic design to reduce chromatic aberration, one aspherical element and minimum focusing distances of around 0.5m.
The Panasonic G9 is the brand's top-tier stills camera. We've updated our already large sample gallery with even more photos to enjoy.
The latest product of Huawei's collaboration with Leica is a smartphone with a great all-around imaging feature set that left us very little to complain about.
In this quick video, award-winning travel photographer Bob Holmes shares nine of his most basic and straightforward tips for finding great images, even when you're in a rut.
Gudsen has launched a new gimbal that’s aimed at mirrorless photographers. With a payload of 3.9lbs/1.8kg, the new Moza AirCross can provide stabilization to a mirrorless body even fitted with a cinema lens and a new in-handle option can provide power to Sony and Panasonic cameras.
The Lensbaby 46mm Macro Kit comprises of three stackable filters with different magnification levels, which can be combined with several of the company's "bokeh effect" lenses.
Nikon Rumors is reporting that an upcoming full-frame mirrorless camera from Nikon will sport an all-new "Z-Mount" with an extremely short flange distance of just 16mm.
A lot of people still have positive associations with the Kodak brand and its iconic logos, but it’s worth clearing something up: not everything with the Kodak name on it has much connection to a bunch of clever people in Rochester, New York.
A leaked image of a Galaxy S9 retail box indicates the new model might come with a variable aperture lens and a super-slow-motion video mode.
The portable little scanner features a 3.5-inch color screen, an integrated SD card slot for saving your scans, adapter trays for different types of film, and an HDMI port for viewing your scans directly on an external display.
Yesterday, Canon Italy and Canon Spain accidentally shared a composite photo that contained stolen elements shot with a Fujifilm camera. Today, in a response on social media, the company somehow managed to make things worse.
We've got a pair of Sigma 16mm F1.4 DC DN lenses in the office: one for Micro Four Thirds and the other for Sony E-mount. In this article we have some impressions of the MFT version, as well as some other lenses in this class worth considering.
Most wedding photographers are probably open to a little bit of feedback from their clients, but one Hong Kong couple was reportedly so upset, they provided their photographer with a detailed 30-page report full of their grievances!
It appears Huwei's ties to the Chinese Government and a fear of espionage have played a role in AT&T's decision not to offer the Huawei Mate 10 Pro and it's Leica-branded dual camera to customers in the United States.
The Autel Robotics EVO looks like the first serious competitor for DJI's Mavic Pro Platinum. With a better remote, slightly better camera, and a slightly cheaper price tag, this drone could steal some serious Mavic market share.
Sony has released firmware version 2.00 for its flagship a9 mirrorless camera. The most notable improvements are to continuous AF, but overall stability has been addressed, as well.
Kodak just debuted a bitcoin mining machine for rent at CES, leaving photographers slack-jawed and confused, and cryptocurrency mining experts balking at what they claim is an outright scam.
Hong Kong drone manufacturer Yuneec has announced three new drones at CES including an update to the Typhoon H with a bigger sensor with more resolution and the ability to shoot 4K at 60fps.
Oops. In their rush to post a pretty picture last night, multiple Canon social media accounts accidentally shared a composite, huge portions of which were stolen and shot with a Fujifilm X-T1.
We've published our studio test scene for Panasonic's video-focused Lumix DC-GH5S Micro Four Thirds camera. Have a look to see how it stacks up against the GH5 and Sony's a7S II.
LaCie's new DJI Copilot hard drive was purpose built for drone photographers and videographers who want to back up and even review their full resolution photos and video on-the-go.
The next Samsung flagship smartphone—which might be the first smartphone with a variable aperture lens—is not being announced or even teased at CES, as previously thought. Instead, Samsung confirmed that the phone would arrive in February.
"What bothers me more than the fact that these photographers missed the play of the game, is the amount of 'bashing' that they are being subject to on many social media platforms [...] as an industry, WE ARE BETTER THAN THAT!"