Olympus patent hints at selective exposure in 'Live Time' mode
Earlier this week, Japanese patent blog Egami reported that Olympus has patented a technology that would allow the photographer to selectively adjust exposure of different scene areas during an exposure. This might allow for a more balanced exposure of scenes where cameras might normally struggle (and the photographer might have to resort to high dynamic range or multiple exposure techniques).
In scenes like the one pictured below, it's hard to avoid overexposure of bright areas or underexposure of dark areas in a single exposure, due to the limited dynamic range of current imaging sensors. Selectively controlling the exposure of dark and bright objects at the time of capture is one way to deal with dynamic range limitations of current hardware, and could be of huge interest to those interested in high dynamic range (HDR) photography. We've had some time to sit down and look at the original patent to read between the lines and conjecture about what the actual implementation might be.
|Sunset at Deception Pass, WA. This was a high dynamic range scene that required multiple exposures (1s, 4s, 15s) to composite a final image in Adobe Photoshop. This sort of scene could benefit from Olympus' technology that allows for selective exposure times for various scene elements. [Photo: Rishi Sanyal]|
The patent appears to be a natural extension of Olympus' current 'Live Time' (or 'Live Bulb') feature, where the camera reads the sensor at set intervals (0.5, 1, 2, 4, 8, 15, 30, or 60s), continuously adding the exposures until the photographer stops the process with a press of the shutter. This mode is quite useful for, say, landscape photographers who are photographing a scene requiring long exposures but who might not know the ideal exposure time beforehand. In such cases, Olympus's 'Live Time' feature allows the camera to continue accruing exposure until the photographer decides, via the LCD display or histogram, that a good exposure has been achieved.
The problem is that neither 'Live Time', nor any other traditional exposure mode in today's cameras, can do much in the way of holding back the exposure of, say, the sun in the photo of Deception Pass above. It's just too bright compared to the rest of the scene. So as we accrue a 4s exposure for the clouds and a 15s exposure for the trees in the photo above, the sun and surrounding areas would almost certainly clip to white. This sort of scenario - where there is a huge difference in brightness between important areas of a scene - is exactly what we believe this new patent from Olympus is designed to address.
The technology outlined in the patent appears to use a form of multi-exposure technique to control the exposure of objects in a scene. The user selects, via a touch screen, which objects receive how much exposure. This can effectively balance the exposure of objects in a scene that might otherwise be rendered as having extremely different brightnesses using traditional methods. The 'problematic' scenario is shown in the uppermost image below, while Olympus' 'fix' is shown in the image below it:
|Image from the Olympus patent that shows a scenario where buildings in the foreground are in danger of being overexposed if the shutter is left open long enough to capture interesting fireworks. [Source: Egami]|
|An overall schematic of Olympus' technology to selectively control exposure of scene elements using a touchscreen interface. The user paints in the portions of the image (buildings) in danger of being overexposed, while the rest of the scene accrues exposure until an optimal image is achieved (the balanced exposure on the right). [Source: Egami]|
We had a look at the original patent (translated by Google) and, while there is mention of varying the photoelectric conversion sensitivity, of more interest is the repeated use of the phrase ‘[reading the] image sensor sequentially’ in the patent. We think this suggests that a final image is assembled from many images read sequentially off the sensor. This would be a logical extension of Olympus' current 'Live Time' implementation where, instead of allowing pixels to accrue exposure over a number of intervals (nondestructively reading the sensor after each interval to display the accumulated exposure), the sensor is destructively read (or reset) after each interval. The exposures from each interval could then be added together selectively; that is, with the input of the photographer as to what scene elements require more, or less, exposure. You might think of it as a way to take 'Live Time' and add user input into the process to imbue some 'intelligence' into the synthesis of the final image. That's incredibly exciting.
Patent images (see below) suggest that this 'user input' - the process of selecting which scene elements receive longer or shorter exposures - is done via some interaction with the histogram (a graph that essentially represents pixels based on brightness value). We imagine that these sorts of operations could be performed via a connected smartphone or tablet to avoid camera shake during exposure.
|This image from the patent suggests that the photographer selects regions of the histogram - which represents scene elements based on brightness - that should receive more, or less, exposure. [Source: Egami]|
To more specifically visualize how a photographer might benefit from this technology, let's return to our shot of sunset at Deception Pass and imagine how we might use the technology suggested in the patent. Using 'Live Time', we set up intervals of 1s exposures to be sequentially read off the sensor and added (digitally) to form the final image. We use the touchscreen to indicate that the sun, or any bright regions on the histogram, should only receive one interval of exposure. Meanwhile, the rest of the scene should receive 10 intervals, or, should simply continue accruing exposure until we feel a balanced exposure has been achieved. All of this seems feasible without significant technological breakthroughs in sensor design if the image were to be built up digitally. That is, from the, say, 10 exposures: add together signals from pixels that require longer exposures, while averaging signals from pixels requiring shorter exposures. This (digital) method would circumvent the need to actually expose different pixels for different amounts of time at the hardware level (something that, while theoretically possible, is extremely difficult to do).
At this point, we're being very speculative about the actual implementation of the patent (assuming it is ever implemented at all); nonetheless, the implications are exciting, as this technology might allow for photographers using 'Live Time' to capture high dynamic range scenes the luxury of getting a proper exposure in-camera as opposed to manually assembling HDR images from multiple shots in post-processing. In the end, any technology that allows for selective exposure of scene elements at the time of capture has the potential to provide better image quality in scenes containing subjects of significantly varying brightnesses.
What might it mean?
Looking to the future, the utility of this technology could increase further with faster sensor reading rates and higher processing power of future generations of cameras. Improvements in these areas would make this system more robust - for scenes requiring shorter overall exposures, for example. However, it would be hard to utilize this technique for moving subjects, as well as handheld shots without proper image alignment. Even so, we think the implications are intriguing.
What do you think? Let us know in the comments section below.
|DSC_9643 by NOWHITELENS|
from Best Photo of the Week
|Thailand Sunrise by ozziebadger|
from Ships and Boats
Sigma is discounting 13 different high-performance 'Art' series lenses from today until November 30th. The company is calling it an 'unprecedented' sale.
See DJI's 'AeroScope' drone-tracking technology in action. This is the system that DJI says can help law enforcement and airport (among others) track and identify rogue drones.
iPhone X owners can already accessorize their new phone with high-quality smartphone photography lenses courtesy of Moment's new lineup.
Considering buying Sigma's exciting new 16mm F1.4 DC DN Contemporary lens for crop-sensor E-Mount and M43? Check out these official full-res samples first!
Vimeo has just added support for 8K HDR 10-bit content, making it possible to show up to 75% of the colors the human eye can perceive vs the usual 35%. Take THAT YouTube.
The holidays are coming, but your gear ain't fly? You gotta hit us up and read our treat yo' self guide.
We're counting down our top 10 most popular sample galleries of 2017, and sitting pretty at #5 is the Fujifilm X-T20.
See some of the most iconic black-and-white photographs throughout history brought to life by a community of colorization enthusiasts and professional retouchers in the new book Retrographic.
Shopping for a photographer? Whether you are one yourself or not, chances are you could use some ideas. From stocking stuffers on up, we've got some photography gift suggestions for every budget.
We're counting down our top 10 most popular sample galleries of 2017. Drum roll please... the #6 spot belongs to none other than the Sigma 85mm F1.4 DH HSM Art.
Read the story behind this gorgeous wedding photo captured at Trolltunga in Norway by husband and wife duo Priscila Valentina Photography. The 14 hour hike in the rain that preceded this shot was TOTALLY worth it.
Go behind the scenes with filmmaker Nick Arcivos, who recently created a beautiful cinematic short film in Paris using only the iPhone X, a couple of gimbals, and a few lights. The results are very impressive.
A Bay Area startup offering a pay-by-the-photo camera service cleverly addresses the pain points photographers experience when they pick up their first DSLR. But can it survive the smartphone?
It's been a big year for software innovations, dual cameras and huge displays. Take a look at our picks for the top smartphone cameras and why we think they stand out.
We're counting down our top 10 most popular sample galleries of 2017. At the #7 spot is the ready-for-any-weather Olympus Tough TG-5.
By combining his skills as a time-lapse filmmaker and an engineer, Julian Tryba created this out-of-this-world creative 'layer-lapse' of New York City that alternates between night and day in time with the music.
Canon Japan's new lineup of novelty camera-themed gifts was just revealed online, including a lens mug and lens thermos, two retro camera-themed USB drives, and a picnic mat.
The Profoto A1 most certainly isn’t for everyone [...] But for those who are used to using the Profoto systems, and want something that pairs seamlessly with the strobes you already have, there is no better companion.
Fujifilm has asked a US district court to clear it of any wrongdoing, after allegedly being threatened with trademark litigation by Polaroid.
While a couple of our reviewers are out testing the Sony a7R III in Arizona, back in Seattle we slapped the camera in front of our studio scene to get a close look at its image quality. See how it stacks up against the competition.
We're counting down our top 10 most popular sample galleries of 2017, and the #8 ranking belongs to the Nikon D7500.
B+W has announced a new aluminum filter holder that offers three slots so users can use multiple filters at the same time. The holder goes with the 2mm thick 100mm square filters it launched earlier this year.
8K video is coming a lot faster than you think, and Blackmagic is ready for it. Meet the DeckLink 8K Pro, a new high performance PCI-E capture and playback card built to handle 'real time high resolution 8K workflows.'
"Glass is everywhere in photography. From Eugène Atget’s reflective vitrines to Lee Friedlander’s sly self-portraiture, photographers have long been in thrall to the visual complications glass can inject into a composition."
Former Apple Aperture lead developer Nik Bhatt has designed an iOS app called RAW Power that lets you edit raw photos from your professional camera using your phone and tablet.... color us intrigued.
Advertising photographer Blair Bunting got his hands on the new Microsoft Surface Book 2, and it blew him away. Bye bye MacBook Pro...
The OnePlus 5T retains many of the 5's features and specs, but comes with an edge-to-edge display and a dual-camera that is optimized for low light.
Sony's recently announced IMX461 backside illuminated medium format sensor will bring 100MP resolution and almost 2x the speed to the next-gen Fuji GFX and Hasselblad X1D.
With the ‘Rent a Hasselblad’ camera equipment renting program, the camera makers is aiming to give enthusiast and professional photographers easier access to its medium-format photography products.
They say seeing is believing, and that's exactly what happened when one DPR staffer took the Google Pixel 2 out for an afternoon shooting under challenging conditions.