Dynamic range and the various ways of trying to capture and represent it are the topic of many a heated discussion on the forums. We spoke to Apical, a company working on this challenge whose technologies are incorporated in cameras from the biggest brands, to find out what it is doing to address the matter. We think this interview with managing director Michael Tusch will help shine a little light on this shadowy corner of image processing.
Out of the shadows
You may not have heard of the British imaging technology company Apical but, if you've used a camera made in the last couple of years, there's every chance you've used technology it has developed. This is because a wide variety of cameras, from compacts through to pro-level DSLRs incorporate its processing algorithms. You may know it as D-Lighting, Shadow Adjustment Technology or Dynamic Range Optimization, but the underlying technology starts with Apical.
We visited Apical's Headquarters and spoke to its Managing Director, Michael Tusch, to find out what the company is trying to do to improve the dynamic range capabilities of digital cameras.
Dynamic range has become a hot-topic amongst the camera-owning cognoscenti, who often worry that their camera's sensor cannot capture the full range of tones from the deepest shadows to the brightest highlights in a scene. But the use of simple, whole-image, tone curves often fails to convey all of the captured dynamic range into the final image, with important detail disappearing in the shadows.
'At its most simple, what our algorithms do is called dynamic range compression - trying to render extremes of light and dark in the way that the human eye would interpret them,' he explains. As it turns out, the company's starting point was human vision, rather than digital imaging: it was originally spun-out from a research group working on modeling biological imaging systems. 'The human eye is highly adaptive to light, and is able to interpret great extremes of light and dark,' says Tusch: 'The main thrust of that work was developing algorithms that could model the human visual system and the researchers realized that some aspects of that could be applied to digital image processing.'
'Our aim is to enable digital cameras to produce the most natural image in the most natural way,' he says. 'Other people were trying to do this at the time but all the existing tools either required manual intervention or had processing demands that were unsuitable for cameras. We created a model that achieved this, was suitable for use in a digital camera and could be included in the image processing pipeline. And it did this in a highly adaptive manner, so it's not something the user had to adjust or worry about.'
From small beginnings...
Given that its system was an adaptive one, that required no intervention, it probably shouldn't come as a surprise to find that the first application of Apical's technology first appeared in compact cameras. Nikon was the first digicam customer, building its D-Lighting system on the technology, in its Coolpix range. 'By 2004 all of the Coolpix range included D-Lighting and later Olympus's Mju series started to incorporate our technologies - with their implementation called Shadow Adjustment Technology.'
'People started to realize there is more to creating a realistic-looking image than just tone-curves and demosaicing,' says Tusch. As anyone who has tried 'rescuing' an image in post-processing using curves will know; it's difficult (and often impossible), to preserve extremes of light and shade in the same image without the result looking 'flat' and unrealistic. The problem, Tusch says, is that steepening the tone curve to increase contrast in the dark part of the image means flattening the tone curve somewhere in the midtones or highlights, leading to a loss of contrast and color in those regions. 'Most tone mapping algorithms steadily reduce local contrast as the strength of dynamic range compression is increased.'
Apical attempts to get 'round this problem by assessing the local environment of each pixel and considering its relationship to its immediate neighbors as well as their context within the image as a whole. 'To give it its technical name, our product, Iridix, is a space-variant dynamic range compression algorithm. What the eye does, in camera language, is apply a different gain, based on the local environment of a pixel - for example, a pixel with a specific R,G,B value in a bright region would be interpreted very differently to a pixel with the same R,G,B value in the shadows.' Iridix aims to mimic this response: it assesses how each pixel relates to the ones around it, in order to work out the local contrast, while also working out how that region fits in with the rest of the image.
|Single adjustment curve applied||Iridix result|
|Show adjustment curve||Show Iridix local adjustments|
|Using a single, homogenous, curves adjustment to try to correct the entire image results in a slightly flat, washed-out looking image. Iridix calculates a different tone curve adjustment for each part of the image (varying slightly between each pixel), in an attempt to preserve local contrast all the way across the image, lifting the detail in the shadow regions without the whole image looking washed-out.|
'To achieve this, and ensure the image looks natural, there are four non-trivial factors that need to be considered,' explains Tusch:
- The preservation of the black and white points of the image (to prevent color clipping and avoid true blacks becoming gray)
- The preservation of true color
- The exact preservation of local contrast.
- The complete elimination of any spatial artifacts, such as halos
'Getting any of these four wrong results in a unnatural looking image. For example, if you look at tone mapping algorithms for high dynamic range imagery, they often produce rather un-natural, "painterly" images, this is simply the result of an inappropriate algorithm - the results should look completely natural.'
...to the hands of the professionals
The technology is no longer confined to compact cameras, however. 'We had faith that it would be a very useful tool for professional photographers,' says Tusch, ' if well implemented and well explained.' And to illustrate his point, he points out that the company's technology has become wide-spread in the DSLR sector, appearing in products from Sony and Olympus, amongst others. 'We've built an image engine that produces image quality suitable for professional photographers. However, we wouldn't advocate this always being enabled because you may not always want the photograph to represent the scene the way it appeared - you may wish to present a more creative interpretation.
We simply aim to achieve pictures which look as close as possible to what you see with your eyes when you take the shot. And, of course, studio photographers simply don't need such a feature because they have complete control over the lighting of their scenes. But for photographers outside or, for instance, at weddings in which not all the lighting can be controlled, we think it can be useful.'
'And we've had a very strong positive response. That's because we think the manufacturers have worked hard to work out how to apply it for a professional audience. I think [the professional photographers] realize it's not a touch-up, it's a scientifically-backed quantitative way of improving image quality and getting the result you want.'
Unsurprisingly, Tusch says there is a philosophical distinction between the two sectors: 'In compact cameras, the expectation is that the camera will capture the scene as you saw it, without you having to think about it, so it tends to be an on/off feature. I think with DSLRs there's a lot more interest in being able to control this technology in a quantitative way (although it still has a self-adapting element to it). That way, it can become a tool that, once understood, can be used by photographers to optimize their image, just as they would with any other setting.' In the same way that photographers have demanded that ISO be as easy to access and change as shutter speed or aperture, Tusch says he hopes that in the future, dynamic range compression will be a turn of a thumb-wheel away.
He also believes the technology will improve: 'We're on version 6 of our product now but we're always trying to raise the technical bar - as the processing gets faster we want to get more sophisticated in terms of the algorithms we can use. But it's not just the processing that prevents the use of more complex algorithms - there are also huge technical challenges relating to how data gets moved around inside the camera, especially as you get more megapixels.' But Tusch is confident that the manufacturers share his company's ambitions to keep improving the final results: 'We're a technology provider, we work in many different areas of imaging. It's up to the manufacturers how they want to apply our technologies but the thing we love about working with DSLR companies is that, although (like everyone else) they have strong cost pressures, they will absolutely not compromise on image quality.'
Interview by Richard Butler
Mar 15, 2012
Feb 10, 2012
Feb 25, 2012
Feb 6, 2012
|Nectar Dancing by Lensmate|
from A Big Year - birds
|Sad clown by PEB|
|Mtl Gen X 2015 DP by MarioSS|
from - Gen X - (In Full Colours+ Border)
Go behind the scenes with National Geographic photographer Renan Ozturk and see what it takes to capture a dangerous, harrowing, stunning Nat Geo photo essay.
Erez Marom tells the story behind this ominous photo of the sand 'reaching up' towards the mountains at Skagsanden beach in Norway. He calls this photo 'Torment.'
DPReview staffer Carey Rose has taken the Panasonic Leica DG 15mm F1.7 along for everything from a city-side boat ride to a bachelor party across the mountains. Find out how the little Leica fared.
Canon just unveiled the largest 12-ink printer on the market. The new imagePROGRAF PRO-6000 printer can make prints from 17 all the way up to 60 inches wide.
"Standing in one of the holiest places on earth, I felt uneasy," writes Wired's Jason Parham. "Most of my fellow visitors, I realized with a brief bloom of nausea, were taking selfies."
Christopher Nolan's Dunkirk has been receiving great reviews, but it's a challenge to see it in its full glory. This handy infographic reveals the aspect ratio chaos that is wrought as the industry retreats from film.
Anti-bullying organization Ditch the Label's Annual Bullying Survey 2017 reveals yet again that Instagram, more so than any other social network, has a the worst effect on youth mental health.
It's been a crazy day for innovative patent news. Apparently Sony is thinking of developing a medium format curved sensor camera.
An update to the Silkypix Raw converter fixes some bugs and adds support for several popular new cameras.
This crazy custom-built underwater camera shoots 8x10 large format film. It's supposedly "the first successful underwater 8x10 ever made," and it can be yours for $5,800... plus shipping.
Blackmagic just reveled a new accessory for their Cintel Film Scanner. The Cintel Audio and KeyKode Reader can capture KeyKode data and high-quality audio from film in real-time as it is being scanned.
A new Nikon patent shows a lens designed for a curved full-frame sensor. Could this be the high-end Nikon mirrorless camera people are hoping for?
The ability to shoot images at 1,000 fps first appeared in a Sony smartphone sensor. Now the Japanese manufacturer is using the same feature for industrial applications.
Astronomy expert and photographer Dr. Tyler Nordgren thinks you should "see your first eclipse, photograph your second." But if you do plan on taking photos this August, here are a few tips from someone who's been there.
How confident are you that you can spot a manipulated photo? A recent study at the University of Warwick shows that many people are pretty bad at it.
If you purchased a Leica TL2, do NOT attach Leica's Visoflex electronic viewfinder. Leica is working on a fix, but for now, it's possible the viewfinder will break your camera.
Google just released Motion Stills for Android. Unlike the iOS version, the Android app uses a redesigned video processing pipeline that processes each frame of a video as it is being recorded, creating instant results.
A huge copyright lawsuit between photography firm VHT and Zillow Group is heating up again, as both sides appeal a court ruling that granted VHT $4 million in damages.
European Space Agency astronaut Thomas Pesquet spent 6 months on board the International Space Station where he worked with Google capturing spheric panorama images that are now available in Street View.
It's official. PDN has confirmed with parent company Aurelius that 94-year-old lighting company Bowens is indeed going out of business.
The newly launched firmware version 1.06 fixes AF-issues that can occur with some lenses that are not officially compatible with the MC-11 converter.
Voyager is a waterproof smart light stick you can control entirely from your phone. The light has already blown past its $300K funding goal on Indiegogo.
2018 is the last year Photokina will take place during the traditional end-of-September dates. In 2019, Photokina will take place from the 8th to the 11th of May.
The Canon IXUS 50 (known as the SD400 Digital ELPH in North America) was one of a string of high-performing, pocketable PowerShots of the mid-2000s. In this week's throwback Thursday, Barney casts his mind back to 2005.
A close look at the EOS 6D II's Raw files suggest its dynamic range has taken a significant step backwards compared with the company's recent DSLRs. We look at how much difference this might make for your photos.
With a full-production review unit in our hands, we've got over 100 production samples from the new Canon EOS 6D Mark II to share.
Need a break from your day? Kick back and watch the making of a somewhat unconventional mojito filmed on Canon's new EOS 6D Mark II.
The Bonfoton Camera Obscura Room Lens can turn any room into a camera obscura, projecting the view from your window onto the walls of your room.
Adobe just released version 2015.12 of Lightroom CC, adding support for several new cameras and lenses, and baking in several important bug fixes while they were at it.
In this interview, Chiara Marinai, photo editor for VanityFair.com, explains exactly what she looks for in new photographers and photo submissions. Take notes.