The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor. Or, at least, all the information that's visually meaningful.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has little to no impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, the 7-bit values used to note the differences aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
This only really matters at base ISO however, since that's the only time you're likely to capture more dynamic range than a 12-bit file can accurately store.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
|Lumière croisée by AM91210|
from My Best Photo of the Fortnight
|Reina by Great Bustard|
from in the style of a Large Format Portrait
|_SDI2370bw by rick decker|
from Crashing Wave
Copy That for Mac features integrated checksum verification, detailed reporting, presets, thumbnail support, file renaming and automated error detection.
The winners and finalists have been announced for the Siena Drone Photo Awards. We've rounded them up into a photo gallery for your viewing pleasure.
The $150 lens is fully manual and is available for Canon EOS-M, Fujifilm X, Micro Four Thirds and Sony E-mount camera systems.
The Lumix S family of full-frame primes keeps growing. The 18mm F1.8 is the newest member of Panasonic's lens lineup. Check our our sample gallery to see what it's capable of.
Peep some pixels from the hefty 100 megapixel files created by the new Hasselblad X2D 100C, as we prepare our DPReview TV review of the camera.
About 95% of Earth's oceans haven't been observed. Researchers at MIT have built a battery-free, wireless underwater camera that may help scientists explore more of the oceans.
Drone manufacturer DJI has moved its staff into an innovative and masterfully-designed new building in Shenzhen, China. Here is a first look.
We (metaphorically) sat down with Brandon Faith of Baggen Photos to ask him a few questions about what it's like to photograph motorsports events with his Crown Graphic large format camera.
Sony's new 320GB and 640GB 'Tough' CFexpress Type A cards are due out next month and while the 640GB card will offer the most storage of any Type A card to date, it doesn't come cheap.
Adobe's Photoshop and Premiere Elements apps make editing photos and videos easy for users of all skill levels. The latest versions add more editing tools, more AI features and improved performance.
The Sony FX30 is an explicitly video-focused camera, but could its technology herald a refresh of the company's APS-C stills line-up? We have a look at what that might mean.
The lens offers a constant F2.8 aperture through a rather unique focal length range for full-frame camera systems. It’s expected to be available starting October 27, 2022 for $699.
Can AI overcome the physical limitations of smartphone sensors and lenses? A Qualcomm executive thinks so, thanks in large part to improvements in processing power, hardware and artificial intelligence.
We're starting to see cameras offering 'open gate' video recording, so what is this tool and when is it useful?
The Sony FX30 is a 4K/120p-capable Super35 / APS-C cinema camera that wants to take the battle to the likes of Panasonic's GH series.
Sony's FX30 Super35/APS-C Cinema Line camera is effectively a crop-sensor version of the company's full-frame FX3 camera with sensor-based image stabilization, oversampled 4K/60p capture and '16-bit' Raw output and more.
If you've ever wanted to become an action figure, Hasbro is providing you the opportunity with its new 3D-printed Selfie Series action figures.
When you store photos on the cloud, you expect them to remain safe for a long time. However, some Google Photos users were scared over the weekend when they realized that their photo libraries had become corrupted.
DALL-E's Outpainting feature uses AI to expand existing images and artwork. Ad agency Ogilvy Paris has used Outpainting to expand Johannes Vermeer's famous painting, 'The Milkmaid.'
iOS 16.0.2 addresses, amongst other bug fixes, a problem wherein the second-generation sensor-shift image stabilization tech was causing camera shake issues in some third-party apps.
For the past eight years, the Library of Congress has been working on figuring out the subjects in a large collection of film, TV and music photos. Many of the mysteries have been solved. However, 17 photos have eluded the LC's best efforts, and the public's help is needed to help put names to the final unknown faces.
After having to pull the initial firmware update last month due to an issue that caused some units to stop working, Sony has re-released firmware version 1.1 for its a7 IV full-frame mirrorless camera.
Sigma's latest wide Art-badged prime for full frame is capable of some stunning landscapes. Check out a new batch of sample photos in the gallery.
Winners for this year's annual Comedy Pet Photo Awards have been announced.
While visiting the team in Seattle, Chris and Jordan attempt to eat some chowder. It's difficult. Also, this week they are puppets.
Meike has released its first adapter for Nikon Z cameras. The new MK-EFTZ-B adapter allows Nikon Z users to attach Canon EF and EF-S lenses to their cameras, complete with autofocus and automatic exposure functionality.
The Canon 5D Mark II was released in November 2008. Since then, a photographer used theirs to capture nearly 2.3 million images, which is an average of about 450 photos per day if they shot every single day. The camera is still going strong for its new owner.
Capture One for iPad users cvan now connect their camera, wired or wirelessly, to their iPad for quick image transfers without the need for memory cards and readers.
Digital film scanners can be pricey, so Lomo's latest scanners let shooters do it themselves. Whether you have a digital camera, or simply a smartphone, there's a DigitaLIZA that'll work with your kit. But are the results any good? Let's find out.
The Leica Q2 'Dawn' is the same camera on the inside, but features an all-black paint job and a special Japanese-woven fabric wrap produced by Japanese brand, Hosoo.