The Raw and the cooked: pulling apart Sony's Raw compression
|Raw compression won't be apparent in every image, but there are circumstances in which it risks undermining what should be a great image. Photo by Rishi Sanyal|
Update: September 15, 2015: Sony has announced that the a7S II will have the option to shoot uncompressed Raw, with firmware being rolled out for some existing models, including the a7R II used here, later.
A Raw file is a Raw file, right? Well, not exactly. Lately, there's been a lot of talk (and a lot of anger) about the compression Sony uses in its Raw files. Compressed Raw files aren't uncommon, but they're usually compressed in a way that retains all the original 'raw' data from the sensor. Or, at least, all the information that's visually meaningful.
Instead Sony has, for several years now, chosen to apply non-optional lossy compression to its Raw output. This isn't likely to be an issue for many users, since the impact is generally quite small, but as the company shows its ambitions in the high end market, with the launch of the a7 series and a dedicated support system for professionals, the impact on image quality deserves a little scrutiny.
What exactly is going on with Sony's Raw files, and what might the potential impact be? The compression system has been investigated and detailed by Iliah Borg and Alex Tutubalin, and we've tried to distill their findings. It's important to keep this in perspective, though: in many circumstances you won't see this impact or encounter the limitations it can impose.
Sony's compression process has two parts, and each of the two aspects have a different impact on the Raw files. The first step applies a compression curve to the data. This is a bit like a tone curve and is used to map the 14 bits of captured data down to an 11-bit space.
Although this part of the process is lossy, a well-designed compression curve has little to no impact on image quality. This is because although shot noise makes up a decreasing proportion of the captured data in bright regions, the actual magnitude of the noise increases. This means it doesn't make sense to retain all the information about bright regions of the images, since a lot of that information will just be recording the subtleties of the noise.
Ideally, then, you can get away with a lot of compression in bright tones so long as you preserve increasing amounts of information at the dark end of the file. Unlike the (optional) compression curve Nikon uses, Sony's doesn't fully exploit this phenomenon, meaning that some useful data is lost, as well as some of the noise. This will, theoretically, reduce the dynamic range available in the files.
Sony's Raw compression then has a second stage, where the image is divided up into a series of 16 pixel stripes for each color channel. Rather than recording a separate value for each of these pixels, the Sony system records the brightest and darkest value in each stripe, and a series of simple notes about how all the other pixels vary from those extremes. These notes are recorded using fewer bits than it would take to record the actual pixel values and it's this step that appears to cause most of the problems.
When there's not much difference between the brightest and darkest pixel, the system is able to describe the scene pretty well. However, as soon as you have a big gap between bright and dark, the 7-bit values used to note the differences aren't sufficient to precisely describe the original image information.
This imprecise recording of the original image data leads to artifacts in stripes around high-contrast edges in the photos. These errors can become even more pronounced if you increase the brightness or contrast in those regions when processing the files.
14-bit and 12-bit readout
To compound matters, several Sony cameras we've tested appear to switch their sensor read-out from 14 bits to 12 bits in certain modes: further reducing the amount of dynamic range that the camera ever captures, even before the effects of the compression process are brought into play. Continuous shooting, Bracketing and Bulb exposure modes will all push most Sonys down to 12-bit capture mode, which is then subjected to the two stage compression.
This only really matters at base ISO however, since that's the only time you're likely to capture more dynamic range than a 12-bit file can accurately store.
These approaches probably made sense in consumer-grade cameras, back in the days where processing power and storage space came at a significant premium. However, on a camera as expensive as the a7R II, which is likely to be used for quality critical shooting, it's hard to justify clumsy compression that can, depending on the image, throw away data you were expecting to have access to.
Overall, the effects of this compression aren't often visually significant. Their impact should mostly be understood as a reduction in processing latitude, since it tends only to be when you push and pull the Raw files that the missing data becomes visible. The compression curve throws away more shadow data than would be ideal: reducing dynamic range. There's a further reduction if you shoot in a mode that drops the camera into 12-bit readout mode. Meanwhile, the localized compression of tonal differences only has an impact near high-contrast edges.
|And it's not just heavily-pushed images that start to reveal the lost data: this is a straight out-of-camera JPEG file (shot with DRO Auto), still showing stripes extending from a high-contrast edge. It looks still worse in a gently processed Raw conversion.
It's worth noting, though, that the impact of this process is lessened in the company's higher pixel-count bodies, since a 32-pixel stripe will be a smaller proportion of the a7R II's 40MP images than it would in a 12MP image from the a7S.
It's quite possible to shoot for years and never notice the impact of these design choices Sony has made, but they do add up to mean that you can't access the full capability of the camera. Most people shoot Raw precisely because they want to preserve the maximum possible processing latitude and keep their creative options open. Raw compression isn't the end of the world by any means, but it throws away a little bit of a camera's capability, which might be a little hard to swallow if you've paid multiple thousands of dollars for a cutting-edge camera.
|Dalmatian pelican by Avocet17|
from A big year - birds 2018
|Soup by Coolinarka|
|Off Piste Skiing - rest time by munte|
from Warren miller
|Snowflake by Tigor|
|Wet Rocks by Kukla|
|Flame On! by 6bender|
from - Flowers on Black -
Leaked product images show Samyang/Rokinon is preparing to add another super-fast lens to its Extreme Performance series of lenses: the Samyang XP 50mm F1.2 EF.
There was a time when Fujifilm mirrorless camera users may have felt the need to go to another system to shoot video. Thanks to a new camera and a couple of lenses, they suddenly have some sweet options.
The Rotolight Neo 2 is an LED light panel with the capability to fire its LEDs fast enough and bright enough to act as a strobe. Is it enough to make stills photographers re-think their old-fashioned speed lights? Read on and find out.
Photographer Florian Nick spent six weeks in the Canadian wilderness capturing this Vimeo Staff Pick timelapse. Find out why and how he did it in this detailed behind the scenes guest post.
We've spent some time getting acquainted with Panasonic's freshest mirrorless camera, the GX9, putting its tilting EVF to good use. Check out our initial samples.
Sony has made something of a break-through in sensor development with a new backside-illuminated CMOS sensor that is capable of global shutter, a huge improvement over current CMOS global shutter technology.
As a result of its licensing deal with Getty, Google Images will no longer link directly to an image file from the search results. Instead, users will have to actually visit the site that hosts it.
Microsoft has released a new "Ultimate Performance" mode for Windows 10 Pro for Workstations—a mode that throws all power management out the window (so to speak) in favor of the best possible performance it can pull from your hardware.
If it's upheld, the new New York federal court ruling—which will very likely be appealed—would mean millions of people and publications are violating copyright every single day.
Similar to Apple's AirDrop functionality, Microsoft's new Photos Companion app lets you send photos and videos from an Android or iOS smartphone to a PC via a WiFi network.
The Fujifilm X-H1 is that company's latest flagship, with specs that appeal to stills photographers and serious videographers alike. Here's a detailed look at everything that's new and improved.
The Panasonic Lumix DC-ZS200 is a powerful, pocketable travel zoom compact camera, with an impressively long lens. We've had our hands on one.
Samsung just released a few short advertisement videos for the Samsung Galaxy S9 on its Korean Youtube channel, two of which hint at the upcoming smartphone's new and improved camera features.
After years of planning and dreaming, wet plate photographer Markus Hofstaetter finally accomplished one of his crazier goals: shooting wet plate collodion photography... handheld.
Thomas Escher, Panono's new CEO, wants to steer the company strategy towards customized software development for the real-estate and construction sectors.
"Jurist Thomas Borberg said in a WPP-produced video that 'You have to be able to feel a World Press Photo in your stomach. If not, it’s not a World Press Photo.' Given this position, it’s not surprising that violent images are the ones that provoke stomach churning reactions."
Croatian brand Noa will launch its N7 smartphone at MWC. The phone will feature a 16MP dual-camera setup, and a high-resolution mode that captures 80MP images.
Michigan portrait and wedding photographer Brady Kenniston explains how he captured photos of an incredible, once-in-a-lifetime event: the SpaceX Falcon Heavy rocket launch on February 6th.
Lensbaby has announced the Burnside 35, which it calls an adaptation of the Petzval lens design with the added benefit of an effect slider to adjust the strength of vignetting and bokeh.
Fujifilm has unveiled the X-H1, a flagship 24MP APS-C camera that builds on the X-T2's feature set by adding 5-axis image stabilization, a touchscreen and more advanced video capabilities.
With the release of its Fujinon MKX 18-55mm T2.9 and MKX 50-135mm T2.9 cinema lenses, Fujifilm finally gives X-mount shooters access to some great lenses that have already been available to E-mount shooters for months.
Fujifilm's newest X-series camera takes video very seriously, but also offers a strong stills feature set largely borrowed from the X-T2. We've had some time with a full-production X-H1 that luckily coincided with a little bit of rare February sunshine.
The Korean manufacturer will introduce a suite of AI technologies for its smartphones, including a Vision AI that puts the focus on camera usability and performance. The 2018 version of the flagship LG V30 will be the first device to feature the new tech.
Directors from six US intelligence agencies—including the CIA, FBI, and NSA—have told the Senate Intelligence Committee that it does not recommend Americans purchase Huawei devices, citing multiple security concerns.
Skydio claims the autonomous R1 drone is "the most advanced autonomous device—of any kind—available today." It uses the NVIDIA Jetson AI to continuously track you, even through complex environments like dense woods.
The World Press Photo Foundation has revealed the six finalists for World Press Photo of the Year 2018 today, in preparation for the final awards ceremony in Amsterdam on April 12th.
Tamron just published a teaser image that seems to show a new mirrorless zoom lens is "coming soon." An official announcement is probably planned for CP+, but join us for some good ol' fashioned speculation in the meantime.
The Loxia 25mm F2.4 joins four other manual-focus Loxia lenses designed specifically for Sony's full-frame mirrorless cameras—a "small, robust and versatile" lens that will keep your kit light and inconspicuous when you're on the go.
With video-centric cameras like the Panasonic GH5S in the office, it seemed high time to learn how to shoot with a gimbal. After a struggle up the learning curve, DPR staffer has found some sort of equilibrium.