Dynamic range and the various ways of trying to capture and represent it are the topic of many a heated discussion on the forums. We spoke to Apical, a company working on this challenge whose technologies are incorporated in cameras from the biggest brands, to find out what it is doing to address the matter. We think this interview with managing director Michael Tusch will help shine a little light on this shadowy corner of image processing.
Out of the shadows
You may not have heard of the British imaging technology company Apical but, if you've used a camera made in the last couple of years, there's every chance you've used technology it has developed. This is because a wide variety of cameras, from compacts through to pro-level DSLRs incorporate its processing algorithms. You may know it as D-Lighting, Shadow Adjustment Technology or Dynamic Range Optimization, but the underlying technology starts with Apical.
We visited Apical's Headquarters and spoke to its Managing Director, Michael Tusch, to find out what the company is trying to do to improve the dynamic range capabilities of digital cameras.
Dynamic range has become a hot-topic amongst the camera-owning cognoscenti, who often worry that their camera's sensor cannot capture the full range of tones from the deepest shadows to the brightest highlights in a scene. But the use of simple, whole-image, tone curves often fails to convey all of the captured dynamic range into the final image, with important detail disappearing in the shadows.
'At its most simple, what our algorithms do is called dynamic range compression - trying to render extremes of light and dark in the way that the human eye would interpret them,' he explains. As it turns out, the company's starting point was human vision, rather than digital imaging: it was originally spun-out from a research group working on modeling biological imaging systems. 'The human eye is highly adaptive to light, and is able to interpret great extremes of light and dark,' says Tusch: 'The main thrust of that work was developing algorithms that could model the human visual system and the researchers realized that some aspects of that could be applied to digital image processing.'
'Our aim is to enable digital cameras to produce the most natural image in the most natural way,' he says. 'Other people were trying to do this at the time but all the existing tools either required manual intervention or had processing demands that were unsuitable for cameras. We created a model that achieved this, was suitable for use in a digital camera and could be included in the image processing pipeline. And it did this in a highly adaptive manner, so it's not something the user had to adjust or worry about.'
From small beginnings...
Given that its system was an adaptive one, that required no intervention, it probably shouldn't come as a surprise to find that the first application of Apical's technology first appeared in compact cameras. Nikon was the first digicam customer, building its D-Lighting system on the technology, in its Coolpix range. 'By 2004 all of the Coolpix range included D-Lighting and later Olympus's Mju series started to incorporate our technologies - with their implementation called Shadow Adjustment Technology.'
'People started to realize there is more to creating a realistic-looking image than just tone-curves and demosaicing,' says Tusch. As anyone who has tried 'rescuing' an image in post-processing using curves will know; it's difficult (and often impossible), to preserve extremes of light and shade in the same image without the result looking 'flat' and unrealistic. The problem, Tusch says, is that steepening the tone curve to increase contrast in the dark part of the image means flattening the tone curve somewhere in the midtones or highlights, leading to a loss of contrast and color in those regions. 'Most tone mapping algorithms steadily reduce local contrast as the strength of dynamic range compression is increased.'
Apical attempts to get 'round this problem by assessing the local environment of each pixel and considering its relationship to its immediate neighbors as well as their context within the image as a whole. 'To give it its technical name, our product, Iridix, is a space-variant dynamic range compression algorithm. What the eye does, in camera language, is apply a different gain, based on the local environment of a pixel - for example, a pixel with a specific R,G,B value in a bright region would be interpreted very differently to a pixel with the same R,G,B value in the shadows.' Iridix aims to mimic this response: it assesses how each pixel relates to the ones around it, in order to work out the local contrast, while also working out how that region fits in with the rest of the image.
|Single adjustment curve applied||Iridix result|
|Show adjustment curve||Show Iridix local adjustments|
|Using a single, homogenous, curves adjustment to try to correct the entire image results in a slightly flat, washed-out looking image. Iridix calculates a different tone curve adjustment for each part of the image (varying slightly between each pixel), in an attempt to preserve local contrast all the way across the image, lifting the detail in the shadow regions without the whole image looking washed-out.|
'To achieve this, and ensure the image looks natural, there are four non-trivial factors that need to be considered,' explains Tusch:
- The preservation of the black and white points of the image (to prevent color clipping and avoid true blacks becoming gray)
- The preservation of true color
- The exact preservation of local contrast.
- The complete elimination of any spatial artifacts, such as halos
'Getting any of these four wrong results in a unnatural looking image. For example, if you look at tone mapping algorithms for high dynamic range imagery, they often produce rather un-natural, "painterly" images, this is simply the result of an inappropriate algorithm - the results should look completely natural.'
...to the hands of the professionals
The technology is no longer confined to compact cameras, however. 'We had faith that it would be a very useful tool for professional photographers,' says Tusch, ' if well implemented and well explained.' And to illustrate his point, he points out that the company's technology has become wide-spread in the DSLR sector, appearing in products from Sony and Olympus, amongst others. 'We've built an image engine that produces image quality suitable for professional photographers. However, we wouldn't advocate this always being enabled because you may not always want the photograph to represent the scene the way it appeared - you may wish to present a more creative interpretation.
We simply aim to achieve pictures which look as close as possible to what you see with your eyes when you take the shot. And, of course, studio photographers simply don't need such a feature because they have complete control over the lighting of their scenes. But for photographers outside or, for instance, at weddings in which not all the lighting can be controlled, we think it can be useful.'
'And we've had a very strong positive response. That's because we think the manufacturers have worked hard to work out how to apply it for a professional audience. I think [the professional photographers] realize it's not a touch-up, it's a scientifically-backed quantitative way of improving image quality and getting the result you want.'
Unsurprisingly, Tusch says there is a philosophical distinction between the two sectors: 'In compact cameras, the expectation is that the camera will capture the scene as you saw it, without you having to think about it, so it tends to be an on/off feature. I think with DSLRs there's a lot more interest in being able to control this technology in a quantitative way (although it still has a self-adapting element to it). That way, it can become a tool that, once understood, can be used by photographers to optimize their image, just as they would with any other setting.' In the same way that photographers have demanded that ISO be as easy to access and change as shutter speed or aperture, Tusch says he hopes that in the future, dynamic range compression will be a turn of a thumb-wheel away.
He also believes the technology will improve: 'We're on version 6 of our product now but we're always trying to raise the technical bar - as the processing gets faster we want to get more sophisticated in terms of the algorithms we can use. But it's not just the processing that prevents the use of more complex algorithms - there are also huge technical challenges relating to how data gets moved around inside the camera, especially as you get more megapixels.' But Tusch is confident that the manufacturers share his company's ambitions to keep improving the final results: 'We're a technology provider, we work in many different areas of imaging. It's up to the manufacturers how they want to apply our technologies but the thing we love about working with DSLR companies is that, although (like everyone else) they have strong cost pressures, they will absolutely not compromise on image quality.'
Interview by Richard Butler
Mar 15, 2012
Feb 10, 2012
Feb 25, 2012
Feb 6, 2012
|Fascia walkie talkie building London by ian herridge|
from Abstract Architecture
|Global Reach by cjf2|
Joey L, Dani Diamond, Brandon Woelfel and Jessica Kobeissi go head-to-head in an episode of "4 photographers shoot the same model."
The latest flagship phone from Asus combines a 12MP 1/2.55" Sony IMX362 main sensor with a smaller Sony IMX351 chip for 2x zoom and a background-blurring portrait mode.
The company behind popular photo editor Picktorial 3 just released the X-Pack: a preset package that allows you to add Fuji's in-camera film simulation profiles to your RAF files in post.
Photoshop. GoPro. Every once in a while a product emerges that defines a category. And sometimes, it vanishes just as quickly as it arrived on the scene. This week's Throwback Thursday remembers the Flip, the pocket camcorder everyone had – until they didn't.
The Nokia 8's dual-cam combines the image data from a 13MP RGB sensor and a 13 monochrome chip for better detail, improved dynamic range and lower noise levels.
The company behind retail giant B&H Photo has agreed to pay out $3.2 million in monetary relief and back wages to settle a discrimination and harassment case from 2016.
After a popular Facebook teaser and some studio portrait samples, Godox has finally officially released the Godox A1 smartphone flash and flash trigger. Cheap, versatile and innovative, color us intrigued.
Canon’s EOS 5D Mk IV has won the European Imaging and Sound Association’s Professional DSLR of the Year award, making this the third year in a row that the brand has beaten Nikon to the top spot in the professional camera category.
A photograph and quote tweeted out by former president Barack Obama has officially become the most popular tweet of all time, receiving over 1.3 million retweets and 3.4 million likes.
Edward Weston was one of the most influential photographers of the 20th century, and in this episode of Advancing Your Photography we learn the extreme technique he used to capture one of his most famous still life photos.
Instagram just released a small update that will make a huge difference if you're active on the photo sharing app: threaded comment replies.
Venus Optics has announced the price and delivery date of the second lens to join its Zero-D line up: the 15mm F2 for Sony’s E mount. A lens they've dubbed, "the world's fastest 15mm rectilinear lens for full-frame."
Cinnac is a new social network for photographers that will help you separate your good photos from your great ones through a Tinder-like community-based rating system.
The Canon EF 35mm F2 IS USM is an understated jewel of a lens, and one that we've enjoyed on a variety of cameras since its release almost five years ago. Its relatively small size and image stabilization make it a versatile tool for a variety of photography - check out our sample gallery.
You don't need a fancy studio or tons of gear to capture the kind of classic product photography you see in magazines. In this video, Dustin Dolby shows you how to do it with just a couple of speedlights and some know-how.
The life-logging camera is trying to make a comeback. Say hello to FrontRow, a live-streaming enabled life-logging camera from Ubiquiti that hangs on a necklace like a pendant.
When a prospective client approaches you, don't just say "yes" right away. Here's a useful list of questions you should be asking before you decide to take the job and name your price.
Samsung just revealed a blazing-fast new Solid State Drive capable of data transfer speeds of up to 540MB/s.
DJI has developed a 'Local Data Mode' that lets pilots fly without being connected to the Internet. The mode should calm recent fears over data privacy and security when flying DJI drones.
After 1.7 million downloads on Apple computers since the launch in November 2015, Aurora HDR will be available for Windows PCs for the first time with the 2018 release.
The company behind the new Meyer Optik Goerlitz lens manufacturing business has formed a new brand to bring back the Biotar 75mm F1.5 that was made by Carl Zeiss Jena in the 1940s and 50s.
The updated Qualcomm Spectra system is a dual-camera setup that is capable of sensing depth and motion in real time.
A sizable swath of the United States will be treated to a total eclipse of the heart – er, sun – in just under a week. Here are a few excellent guides to help you photograph this rare occasion.
f11 Magazine—an ad-supported, free magazine for 'photographers and aficionados' that focused on photos rather than gear—is suspending publication due to financial troubles.
The Minolta MC Rokkor-X 40-80mm F2.8 is unlike any zoom lens you've probably ever seen. Instead of a helicoid, it uses a gearbox, and because of this it's still one of the sharpest zoom lenses out there.
If you're looking to switch to Sony, the company's new limited-time "α trade up" promotion can snag you up to $500 + trade-in value towards a brand new a9, a7 II, a7R II, or a7S II when you hand over your DSLR or mirrorless camera.
The Google Camera app exclusive to the company's own Pixel phone has been unofficially ported to other Android devices. If you're willing to take the risk of installing, you can now use features like HDR+ on the Galaxy S8, LG G6, OnePlus 5, and more.
49-year-old David Hilos is known by the Singapore photography community as the 'camera whisperer.' When a service center says a camera is beyond repair, Hilos can usually coax it back to life.
Photographer Ryan Kelly captured one of the most viral and graphic images of the horrifying events in Charlottesville, VA this weekend. This is the harrowing story behind that photograph.
Data storage manufacturer Synology has added a new, lower-cost NAS to its DiskStation j line that has a maximum capacity of 40TB, and which is aimed at home users and photography enthusiasts.