Dynamic range and the various ways of trying to capture and represent it are the topic of many a heated discussion on the forums. We spoke to Apical, a company working on this challenge whose technologies are incorporated in cameras from the biggest brands, to find out what it is doing to address the matter. We think this interview with managing director Michael Tusch will help shine a little light on this shadowy corner of image processing.
Out of the shadows
You may not have heard of the British imaging technology company Apical but, if you've used a camera made in the last couple of years, there's every chance you've used technology it has developed. This is because a wide variety of cameras, from compacts through to pro-level DSLRs incorporate its processing algorithms. You may know it as D-Lighting, Shadow Adjustment Technology or Dynamic Range Optimization, but the underlying technology starts with Apical.
We visited Apical's Headquarters and spoke to its Managing Director, Michael Tusch, to find out what the company is trying to do to improve the dynamic range capabilities of digital cameras.
Dynamic range has become a hot-topic amongst the camera-owning cognoscenti, who often worry that their camera's sensor cannot capture the full range of tones from the deepest shadows to the brightest highlights in a scene. But the use of simple, whole-image, tone curves often fails to convey all of the captured dynamic range into the final image, with important detail disappearing in the shadows.
'At its most simple, what our algorithms do is called dynamic range compression - trying to render extremes of light and dark in the way that the human eye would interpret them,' he explains. As it turns out, the company's starting point was human vision, rather than digital imaging: it was originally spun-out from a research group working on modeling biological imaging systems. 'The human eye is highly adaptive to light, and is able to interpret great extremes of light and dark,' says Tusch: 'The main thrust of that work was developing algorithms that could model the human visual system and the researchers realized that some aspects of that could be applied to digital image processing.'
'Our aim is to enable digital cameras to produce the most natural image in the most natural way,' he says. 'Other people were trying to do this at the time but all the existing tools either required manual intervention or had processing demands that were unsuitable for cameras. We created a model that achieved this, was suitable for use in a digital camera and could be included in the image processing pipeline. And it did this in a highly adaptive manner, so it's not something the user had to adjust or worry about.'
From small beginnings...
Given that its system was an adaptive one, that required no intervention, it probably shouldn't come as a surprise to find that the first application of Apical's technology first appeared in compact cameras. Nikon was the first digicam customer, building its D-Lighting system on the technology, in its Coolpix range. 'By 2004 all of the Coolpix range included D-Lighting and later Olympus's Mju series started to incorporate our technologies - with their implementation called Shadow Adjustment Technology.'
'People started to realize there is more to creating a realistic-looking image than just tone-curves and demosaicing,' says Tusch. As anyone who has tried 'rescuing' an image in post-processing using curves will know; it's difficult (and often impossible), to preserve extremes of light and shade in the same image without the result looking 'flat' and unrealistic. The problem, Tusch says, is that steepening the tone curve to increase contrast in the dark part of the image means flattening the tone curve somewhere in the midtones or highlights, leading to a loss of contrast and color in those regions. 'Most tone mapping algorithms steadily reduce local contrast as the strength of dynamic range compression is increased.'
Apical attempts to get 'round this problem by assessing the local environment of each pixel and considering its relationship to its immediate neighbors as well as their context within the image as a whole. 'To give it its technical name, our product, Iridix, is a space-variant dynamic range compression algorithm. What the eye does, in camera language, is apply a different gain, based on the local environment of a pixel - for example, a pixel with a specific R,G,B value in a bright region would be interpreted very differently to a pixel with the same R,G,B value in the shadows.' Iridix aims to mimic this response: it assesses how each pixel relates to the ones around it, in order to work out the local contrast, while also working out how that region fits in with the rest of the image.
|Single adjustment curve applied||Iridix result|
|Show adjustment curve||Show Iridix local adjustments|
|Using a single, homogenous, curves adjustment to try to correct the entire image results in a slightly flat, washed-out looking image. Iridix calculates a different tone curve adjustment for each part of the image (varying slightly between each pixel), in an attempt to preserve local contrast all the way across the image, lifting the detail in the shadow regions without the whole image looking washed-out.|
'To achieve this, and ensure the image looks natural, there are four non-trivial factors that need to be considered,' explains Tusch:
- The preservation of the black and white points of the image (to prevent color clipping and avoid true blacks becoming gray)
- The preservation of true color
- The exact preservation of local contrast.
- The complete elimination of any spatial artifacts, such as halos
'Getting any of these four wrong results in a unnatural looking image. For example, if you look at tone mapping algorithms for high dynamic range imagery, they often produce rather un-natural, "painterly" images, this is simply the result of an inappropriate algorithm - the results should look completely natural.'
...to the hands of the professionals
The technology is no longer confined to compact cameras, however. 'We had faith that it would be a very useful tool for professional photographers,' says Tusch, ' if well implemented and well explained.' And to illustrate his point, he points out that the company's technology has become wide-spread in the DSLR sector, appearing in products from Sony and Olympus, amongst others. 'We've built an image engine that produces image quality suitable for professional photographers. However, we wouldn't advocate this always being enabled because you may not always want the photograph to represent the scene the way it appeared - you may wish to present a more creative interpretation.
We simply aim to achieve pictures which look as close as possible to what you see with your eyes when you take the shot. And, of course, studio photographers simply don't need such a feature because they have complete control over the lighting of their scenes. But for photographers outside or, for instance, at weddings in which not all the lighting can be controlled, we think it can be useful.'
'And we've had a very strong positive response. That's because we think the manufacturers have worked hard to work out how to apply it for a professional audience. I think [the professional photographers] realize it's not a touch-up, it's a scientifically-backed quantitative way of improving image quality and getting the result you want.'
Unsurprisingly, Tusch says there is a philosophical distinction between the two sectors: 'In compact cameras, the expectation is that the camera will capture the scene as you saw it, without you having to think about it, so it tends to be an on/off feature. I think with DSLRs there's a lot more interest in being able to control this technology in a quantitative way (although it still has a self-adapting element to it). That way, it can become a tool that, once understood, can be used by photographers to optimize their image, just as they would with any other setting.' In the same way that photographers have demanded that ISO be as easy to access and change as shutter speed or aperture, Tusch says he hopes that in the future, dynamic range compression will be a turn of a thumb-wheel away.
He also believes the technology will improve: 'We're on version 6 of our product now but we're always trying to raise the technical bar - as the processing gets faster we want to get more sophisticated in terms of the algorithms we can use. But it's not just the processing that prevents the use of more complex algorithms - there are also huge technical challenges relating to how data gets moved around inside the camera, especially as you get more megapixels.' But Tusch is confident that the manufacturers share his company's ambitions to keep improving the final results: 'We're a technology provider, we work in many different areas of imaging. It's up to the manufacturers how they want to apply our technologies but the thing we love about working with DSLR companies is that, although (like everyone else) they have strong cost pressures, they will absolutely not compromise on image quality.'
Interview by Richard Butler
Mar 15, 2012
Feb 10, 2012
Feb 25, 2012
Feb 6, 2012
|And I'm feeling all fingers and thumbs by Dutch Newchurch|
from Your City - Coffee Break
|Stitch that - macro by Beatsy|
from Household objects- Macro only
|Fiddling Around by garyjb|
from Concert musician playing
|wet red by George Veltchev|
Google's new Pixel 2 phone provides a background-blurring portrait mode with a single-lens camera setup using neural networking and dual-pixels.
With the arrival of the PowerShot G1 X III, there are now seven Canon cameras built around the 24MP Dual Pixel sensor and Digic 7 processor. We take a look at the differences and what might prompt you to choose one over the others.
Meet the HP ZBook x2. The so-called 'world's most powerful and first detachable PC workstation,' it was built with creative professionals in mind, and is being debuted at Adobe MAX.
PDN sat down with Ahmed Fakhr, director of photography at RollingStone.com, to talk about how the famed publication is adapting to the changing photo and video needs of the modern era and how he 'evaluates the skills of potential contributors.'
Kudos to Canon. Earlier today, the camera giant announced that it had produced its 90 millionth EOS camera and 130 millionth EF-series lens.
The ROV Slider is a portable, motorized slider that promises to bring 'beautiful cinematic video and time-lapse' shooting to anybody with a smartphone, GoPro or DSLR that weighs less than 5lbs.
The new Surface Book 2 laptops come with Intel's 8th generation quad-core processors and NVIDIA GeForce GTX 1050 and 1060 GPUs. In other words: they pack a serious punch.
Leica is resurrecting a portrait lens from the 1930s: the Thambar-M 1:2.2/90. This lens features just 4 lens elements, and was famous for its spherical aberration that creates extremely soft images.
Google's Visual Core is an Image Signal Processor designed to power and accelerate HDR+ processing and other imaging tasks in the new Pixel 2 devices (and beyond).
The Google Pixel's camera is among the best we've reviewed, and its successor has already been hailed as class-leading. With expectations set high, the Pixel 2 has nonetheless left a very good first impression on us as we shot some initial sample images.
Leica is one of the oldest names in photography, and has long been one of the most prestigious. Recently, we had the opportunity to visit Wetzlar, to see for ourselves how Leica's lenses are put together.
Canon went and put an APS-C sensor in a G series compact. The result is a mighty tempting camera for travel.
Google Photos is adding a few pet-friendly features that will make it easier to find photos of your favorite pooch. Now, you can organize your pet photos by facial recognition, and you can even search your library by breed.
Colorful tripod maker MeFOTO has launched a new tripod... and a whole new brand name. Meet the GlobeTrotter travel video tripod, the first product to be released under the MeVIDEO brand.
If you own a Moto Z, you'll soon be able to attach a Polaroid instant printer to it. Check out the unreleased Moto Mod, which was leaked earlier today.
DJI has developed a technology called AeroScope that allows law enforcement to identify and track airborne drones that are breaking UAV regulations, while simultaneously addressing privacy concerns.
The Nikon D850 is a 45.7MP full-frame DSLR with an autofocus system lifted wholesale from the pro-sports focused D5. 4K capture, continuous shooting at 7 or 9 frames per second make it sound like the ultimate all rounder. Is it all that these specs suggest?
The Mate 10's Kirin 970 chipset with integrated AI processing allows for object recognition, motion detection and automatic scene selection in the camera app.
DxO has announced version 3.0 of the iOS app for its 'One' connected camera. It adds support for multi-camera Facebook Live broadcasting and both time-lapse still and video capture. Android users will be pleased to hear that a One for their platform is on the way, as well. Several new accessories are available, including a battery pack.
Canon has introduced the PowerShot G1 X Mark III, which borrows the 24MP APS-C sensor and Dual Pixel AF system from the company's recent mirrorless and DSLR cameras, adds a 24-72mm equiv., F2.8-5.6 lens and puts them into a lightweight body – but it'll cost you quite a bit.
It's not often that we see a genuinely interesting compact camera, and the Canon PowerShot G1 X Mark III is one such beast. We've pulled out the top features of the camera and tell you why they matter – and put the Mark III up against the competition.
Apple's HDR effect in the iPhone 8 Plus is on by default and more aggressive than in previous generations. It's also good enough to convince DPR contributor Jeff Carlson to leave it on all the time.
Canon's 28mm F2.8 IS USM may be small in size, but it's big on fun. We wrote about our experience using it as our only lens in Big Sur, California, but in case you missed out on our full gallery, take a look to see what this little lens can do.
Travel photographer Elia Locardi tells the story behind this gorgeous (and rare) panorama of the Dubai cityscape draped in fog.
Bison, drift cars, horseback riders, antelope – from the beach to the race track, the Sony 100-400mm G Master is one versatile piece of kit.
"Wildlife photography in Yellowstone National Park is an incredible opportunity, yet some bad photographers are giving all photographers a bad name by not following the rules."
Casio's bionic-looking new action camera, the GZE-1, is built with extreme sports in mind. The little camera is drop-proof, freeze-proof, dust-proof, and waterproof to 50 meters.
Yashica recently released the digiFilm Y35: a camera that tries to simulate the "experience" of shooting film... and it's just the worst.
Western Digital has revealed some interesting new technology that, it claims, will allow them to develop 40TB hard drives by the year 2025.
Photographer Micael Widell wanted to see just how affordable it could possibly be to get into digital photography—so he bought a full DSLR kit with battery grip and 50mm lens on eBay for just $80.