The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor. Or, at least, all the information that's visually meaningful.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has little to no impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, the 7-bit values used to note the differences aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
This only really matters at base ISO however, since that's the only time you're likely to capture more dynamic range than a 12-bit file can accurately store.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
|Bowing Ballerina by Kukla|
from Best Photo of the Week...
|Midnight Storks by wam7|
|Ice Pond by wam7|
from moving snow in winter
The OPPO Reno 10x hybrid zoom smartphone uses similar technology as the Huawei P30 Pro to achieve a longer than usual tele reach.
The 15 second video teases upcoming support for eye-detection autofocus with Nikon's Z6 and Z7 cameras.
The Olympus E-M1X offers a faster burst speed than the D5, but Nikon's legendary autofocus system and optical finder outshine this Micro Four Thirds beast.
The lens is available for Canon EF and Nikon F mount cameras and is currently available to pre-order for $799.
A new smartphone app removes the need for doctor visits and lab referrals to get your urine tested.
Zeiss has announced the impending release of the 100mm F1.4, the fourth lens in its Otus lineup.
In a series of 16 slightly quirky questions Adobe determines your creative personality.
If the report holds up, no longer will you have to first import photos into the iOS Camera Roll before importing them into apps like Adobe Lightroom CC and Affinity Photo.
ON1 has announced that the next major version of ON1 Photo RAW 2019.5, will be released in mid-May 2019.
Whether you've bought an inexpensive Fujifilm X-A5 with a kit lens, or a higher-end body like the X-T3, at some point you're going to want some new glass. We've picked out the best X-mount lenses for various shooting situations to aid you in your search.
Nikon's latest point-and-shoot might look like a toy, but it's not lacking in features.
Firmware version 1.10 for the GR III is said to improve low-light autofocus performance and adds a new Wi-Fi option for transferring images via Image Sync.
A leaked data sheet has detailed the specifications of a 63MP full-frame CMOS sensor with Dual Pixel AF.
We've been working through our full review of Panasonic's high-megapixel full-frame flagship, the Lumix S1R, and its lower-resolution S1 sibling, and have published our studio scene images from them – including the R's 187MP high-res mode. It's, well, very high-res.
The update adds Wi-Fi SnapBridge connectivity and addresses a number of bugs.
Panasonic's S Pro 70-200mm F4 is one of three lenses to launch with the full-frame S system, covering a popular focal range with a claimed 6 stops of stabilization to boot.
CareerCast has released its 2018 Jobs Rated Report and among the list was ‘photographer.’
A teardown video shows how Huawei has managed an impressive amount of technology including a 5x tele lens into the body of its flagship smartphone.
Cooperative of Photography, more commonly referred to as COOPH, has shared a video on its YouTube channel showing five inexpensive ways to take unique macro photos.
RawTherapee version 5.6 adds a new Pseudo-HiDPI mode, a new 'Unclipped' processing profile, and hundreds of other improvements and bug fixes to speed up editing.
Astronaut Terry Virts may have had the coolest photography job in the world – or outside of it – shooting over 300,000 photos during seven months in space. On this Earth Day, Virts tells us what it's like to be a space photographer.
Frans Lanting has inspired generations of artists and ecologists with his photography and environmental advocacy. To mark Earth Day 2019, we caught up with Frans to speak about his career and his hopes for the future.
The lens features a 1:1 maximum magnification ratio, a minimum focusing distance of 30cm (11.8in) and weighs 570g (1.3lbs).
Seattle-based photographer Neil Buckland has been working with University of Washington scientist Dr. Tony Irving to photograph, in incredible detail, slices of meteorites that have fallen to earth with his Pentax K-1 and a custom-built rig. Get a look into space, and into the past, with some of Buckland's images.
They say that the best camera is the one you you have with you. Senior Editor Barnaby Britton has been taking the Ricoh GR III with him a lot recently.
The Fujifilm X-T30 and Sony a6400 are two of the newest, most exciting mid-range mirrorless cameras on the market. Chris and Jordan break down the differences between these models to see which comes out on top.
Brian Ach shoots everything from rock and roll world tours to automotive ads. What follows is a detailed look at his workflow.
Nikkei Asian Review says the increasing capabilities of smartphones are at least partially to blame for the downturn in sales.
One of the main features that defines Instagram is its like count. Jane Manchun Wong, who is renowned for her reverse engineering skills, recently discovered that the service is considering hiding like counts.
Leica is facing backlash in China following the publication of a video called 'The Hunt' set in 1989 during, among other things, the Tiananmen Square pro-democracy protests.