Dynamic range and the various ways of trying to capture and represent it are the topic of many a heated discussion on the forums. We spoke to Apical, a company working on this challenge whose technologies are incorporated in cameras from the biggest brands, to find out what it is doing to address the matter. We think this interview with managing director Michael Tusch will help shine a little light on this shadowy corner of image processing.
Out of the shadows
You may not have heard of the British imaging technology company Apical but, if you've used a camera made in the last couple of years, there's every chance you've used technology it has developed. This is because a wide variety of cameras, from compacts through to pro-level DSLRs incorporate its processing algorithms. You may know it as D-Lighting, Shadow Adjustment Technology or Dynamic Range Optimization, but the underlying technology starts with Apical.
We visited Apical's Headquarters and spoke to its Managing Director, Michael Tusch, to find out what the company is trying to do to improve the dynamic range capabilities of digital cameras.
Dynamic range has become a hot-topic amongst the camera-owning cognoscenti, who often worry that their camera's sensor cannot capture the full range of tones from the deepest shadows to the brightest highlights in a scene. But the use of simple, whole-image, tone curves often fails to convey all of the captured dynamic range into the final image, with important detail disappearing in the shadows.
'At its most simple, what our algorithms do is called dynamic range compression - trying to render extremes of light and dark in the way that the human eye would interpret them,' he explains. As it turns out, the company's starting point was human vision, rather than digital imaging: it was originally spun-out from a research group working on modeling biological imaging systems. 'The human eye is highly adaptive to light, and is able to interpret great extremes of light and dark,' says Tusch: 'The main thrust of that work was developing algorithms that could model the human visual system and the researchers realized that some aspects of that could be applied to digital image processing.'
'Our aim is to enable digital cameras to produce the most natural image in the most natural way,' he says. 'Other people were trying to do this at the time but all the existing tools either required manual intervention or had processing demands that were unsuitable for cameras. We created a model that achieved this, was suitable for use in a digital camera and could be included in the image processing pipeline. And it did this in a highly adaptive manner, so it's not something the user had to adjust or worry about.'
From small beginnings...
Given that its system was an adaptive one, that required no intervention, it probably shouldn't come as a surprise to find that the first application of Apical's technology first appeared in compact cameras. Nikon was the first digicam customer, building its D-Lighting system on the technology, in its Coolpix range. 'By 2004 all of the Coolpix range included D-Lighting and later Olympus's Mju series started to incorporate our technologies - with their implementation called Shadow Adjustment Technology.'
'People started to realize there is more to creating a realistic-looking image than just tone-curves and demosaicing,' says Tusch. As anyone who has tried 'rescuing' an image in post-processing using curves will know; it's difficult (and often impossible), to preserve extremes of light and shade in the same image without the result looking 'flat' and unrealistic. The problem, Tusch says, is that steepening the tone curve to increase contrast in the dark part of the image means flattening the tone curve somewhere in the midtones or highlights, leading to a loss of contrast and color in those regions. 'Most tone mapping algorithms steadily reduce local contrast as the strength of dynamic range compression is increased.'
Apical attempts to get 'round this problem by assessing the local environment of each pixel and considering its relationship to its immediate neighbors as well as their context within the image as a whole. 'To give it its technical name, our product, Iridix, is a space-variant dynamic range compression algorithm. What the eye does, in camera language, is apply a different gain, based on the local environment of a pixel - for example, a pixel with a specific R,G,B value in a bright region would be interpreted very differently to a pixel with the same R,G,B value in the shadows.' Iridix aims to mimic this response: it assesses how each pixel relates to the ones around it, in order to work out the local contrast, while also working out how that region fits in with the rest of the image.
|Single adjustment curve applied||Iridix result|
|Show adjustment curve||Show Iridix local adjustments|
|Using a single, homogenous, curves adjustment to try to correct the entire image results in a slightly flat, washed-out looking image. Iridix calculates a different tone curve adjustment for each part of the image (varying slightly between each pixel), in an attempt to preserve local contrast all the way across the image, lifting the detail in the shadow regions without the whole image looking washed-out.|
'To achieve this, and ensure the image looks natural, there are four non-trivial factors that need to be considered,' explains Tusch:
- The preservation of the black and white points of the image (to prevent color clipping and avoid true blacks becoming gray)
- The preservation of true color
- The exact preservation of local contrast.
- The complete elimination of any spatial artifacts, such as halos
'Getting any of these four wrong results in a unnatural looking image. For example, if you look at tone mapping algorithms for high dynamic range imagery, they often produce rather un-natural, "painterly" images, this is simply the result of an inappropriate algorithm - the results should look completely natural.'
...to the hands of the professionals
The technology is no longer confined to compact cameras, however. 'We had faith that it would be a very useful tool for professional photographers,' says Tusch, ' if well implemented and well explained.' And to illustrate his point, he points out that the company's technology has become wide-spread in the DSLR sector, appearing in products from Sony and Olympus, amongst others. 'We've built an image engine that produces image quality suitable for professional photographers. However, we wouldn't advocate this always being enabled because you may not always want the photograph to represent the scene the way it appeared - you may wish to present a more creative interpretation.
We simply aim to achieve pictures which look as close as possible to what you see with your eyes when you take the shot. And, of course, studio photographers simply don't need such a feature because they have complete control over the lighting of their scenes. But for photographers outside or, for instance, at weddings in which not all the lighting can be controlled, we think it can be useful.'
'And we've had a very strong positive response. That's because we think the manufacturers have worked hard to work out how to apply it for a professional audience. I think [the professional photographers] realize it's not a touch-up, it's a scientifically-backed quantitative way of improving image quality and getting the result you want.'
Unsurprisingly, Tusch says there is a philosophical distinction between the two sectors: 'In compact cameras, the expectation is that the camera will capture the scene as you saw it, without you having to think about it, so it tends to be an on/off feature. I think with DSLRs there's a lot more interest in being able to control this technology in a quantitative way (although it still has a self-adapting element to it). That way, it can become a tool that, once understood, can be used by photographers to optimize their image, just as they would with any other setting.' In the same way that photographers have demanded that ISO be as easy to access and change as shutter speed or aperture, Tusch says he hopes that in the future, dynamic range compression will be a turn of a thumb-wheel away.
He also believes the technology will improve: 'We're on version 6 of our product now but we're always trying to raise the technical bar - as the processing gets faster we want to get more sophisticated in terms of the algorithms we can use. But it's not just the processing that prevents the use of more complex algorithms - there are also huge technical challenges relating to how data gets moved around inside the camera, especially as you get more megapixels.' But Tusch is confident that the manufacturers share his company's ambitions to keep improving the final results: 'We're a technology provider, we work in many different areas of imaging. It's up to the manufacturers how they want to apply our technologies but the thing we love about working with DSLR companies is that, although (like everyone else) they have strong cost pressures, they will absolutely not compromise on image quality.'
Interview by Richard Butler
Mar 15, 2012
Feb 10, 2012
Feb 25, 2012
Feb 6, 2012
|scrum break away by al booth|
from Sport competition
|Parking Deck by Olaf R|
from Your City - Parking Garage
|Communication Tech by alberto_b|
|With & without by OBellini|
from Empty - Full
A recent vacation gave Richard a chance to think about the needs of travel photography – and how our reviews might recognize the perfect travel camera.
Need more evidence that 2017 is the year analog begins its comeback? Well, welcome another new film stock to the world.
The winners of the 10th annual iPhone Photography Awards have been announced, and they're striking.
If you were disappointed by reports that the Sony a9 struggles with adapted Canon glass, you might be able to take some comfort from Metabones' latest update.
Blackmagic Design has dropped the prices of its Video Assist external monitor/recorders for a limited time. Prices of the SD card-based recorders will be reduced in all markets, while supplies last.
Instagram has started testing a new feature called 'favorites' that enables users to share photos with only certain people. Only a small number of users have access to the feature at this time, though it may roll out to everyone in the future.
Lensbaby has announced the Velvet 85 F1.8 for interchangeable lens cameras. The lens is available in Canon, Nikon, Sony E, Sony A, Pentax K, Samsung NX, Fuji X and Micro 4/3 mounts.
It's the end of an era. Parent company Micron has announced that they are discontinuing the Lexar retail brand. This includes 'memory cards, USB flash drives, readers, and storage drives.'
Youthful trainspotter turned adult photographer, John Sanderson has traveled across the United States, documenting the country's railroads. But you won't find any trains in his pictures.
Sony's new CMOS sensor is backside-illuminated and offers an all-pixel global reset function which should drastically reduce rolling shutter effect when panning.
Shoulderpod has converted its offerings into a lego-like modular system by offering all individual parts of existing products separately, allowing users to build exactly the rig they need for a specific project or simply replace a damaged part.
Photographer Felix AAA has spent the past ten years touring the world with a variety of musicians, capturing behind the scenes shots and portraits. He talks about some of his favorite images on the FujiFilm Blog.
A roll of film discovered in an Argus C2 from an Oregon Goodwill turned out to contain some incredible images – and has been re-united with the original owner's family.
Nikon's 28mm F1.4E ED appears to roundly complete the company's updated lineup of fast, professional prime lenses. We've already seen some initial images from a Nikon ambassador, but we've worked through a gallery of our own, with a lens of our own over the past week. Take a look.
Google is holding a competition that could see your Pixel photos gracing millions of screens.
Nikon's 100th birthday party continues worldwide as a distributor in Italy organized a one-of-a-kind feat: assembling the world's largest 'human camera' from over a thousand volunteers.
Ricoh has dropped the price of its Theta SC 360 spherical camera by to $199, a reduction of roughly $50. The camera features two 12MP sensors and can record Full HD video in addition to stills.
Photojournalist Pete Souza served as the presidential photographer for both Ronald Reagan and Barack Obama. In an interview with fellow photographer Marcia Nighswander, he discusses several of his most noteworthy images.
Photographer Michael Wolf has been documenting the crowded conditions of Tokyo's subway trains since the 1990s. The photos have gone viral regularly in the years since he started the project, and he just published the final edition in the series.
The just-launched OnePlus 5 is getting a minor update that should improve camera function.
A Belgian camera shop is showing off an extremely rare, limited 'Rex Edition' Nikon D500. The cosmetic alterations were provided by a customer's German Shepherd Rex, who got ahold of the camera within a day of its purchase.
Adobe says that many of its users have been relying on SkyBox for VR editing and it therefore made sense to make the plug-ins available to all subscribers through Creative Cloud.
The Pictar grip provides a number of customizable physical controls for your iPhone camera, but at its price point we would like to see better materials and build quality.
Peak Design's 'consider every detail' approach shines in the Everyday Backpack. While expensive, it's one of the best options out there for a photographer who needs to pack a lot of stuff in addition to gear.
If you're thinking of using Canon's sports glass on the Sony a9, think again. The ultra-fast camera slows way down when you attach off-brand glass.
The Polish town of Katowice is not famed as an area of beauty, but as all photographers know, that doesn't mean that beauty can't be found if you look in the right places. Mariusz Pietranek used a drone to look down on the colorful sedimentation tanks at an ironworks.
New York Times video journalist Ben Solomon spent a harrowing three weeks accompanying Iraqi Major Sajjad al-Hour as he and his men fought to retake Mosul from I.S. forces.
The 3D VR camera launched through a crowdfunding campaign in 2015 goes on sale beginning June 26.
Noctilucent clouds, a crescent moon and Venus were visible in the pre-dawn sky over Budapest yesterday. Photographer György Soponyai captured NASA's astronomy picture of the day.
Squirming pets won't sit still for photos? A Kickstarter campaign is looking to help.