Olympus patent hints at selective exposure in 'Live Time' mode
Earlier this week, Japanese patent blog Egami reported that Olympus has patented a technology that would allow the photographer to selectively adjust exposure of different scene areas during an exposure. This might allow for a more balanced exposure of scenes where cameras might normally struggle (and the photographer might have to resort to high dynamic range or multiple exposure techniques).
In scenes like the one pictured below, it's hard to avoid overexposure of bright areas or underexposure of dark areas in a single exposure, due to the limited dynamic range of current imaging sensors. Selectively controlling the exposure of dark and bright objects at the time of capture is one way to deal with dynamic range limitations of current hardware, and could be of huge interest to those interested in high dynamic range (HDR) photography. We've had some time to sit down and look at the original patent to read between the lines and conjecture about what the actual implementation might be.
|Sunset at Deception Pass, WA. This was a high dynamic range scene that required multiple exposures (1s, 4s, 15s) to composite a final image in Adobe Photoshop. This sort of scene could benefit from Olympus' technology that allows for selective exposure times for various scene elements. [Photo: Rishi Sanyal]|
The patent appears to be a natural extension of Olympus' current 'Live Time' (or 'Live Bulb') feature, where the camera reads the sensor at set intervals (0.5, 1, 2, 4, 8, 15, 30, or 60s), continuously adding the exposures until the photographer stops the process with a press of the shutter. This mode is quite useful for, say, landscape photographers who are photographing a scene requiring long exposures but who might not know the ideal exposure time beforehand. In such cases, Olympus's 'Live Time' feature allows the camera to continue accruing exposure until the photographer decides, via the LCD display or histogram, that a good exposure has been achieved.
The problem is that neither 'Live Time', nor any other traditional exposure mode in today's cameras, can do much in the way of holding back the exposure of, say, the sun in the photo of Deception Pass above. It's just too bright compared to the rest of the scene. So as we accrue a 4s exposure for the clouds and a 15s exposure for the trees in the photo above, the sun and surrounding areas would almost certainly clip to white. This sort of scenario - where there is a huge difference in brightness between important areas of a scene - is exactly what we believe this new patent from Olympus is designed to address.
The technology outlined in the patent appears to use a form of multi-exposure technique to control the exposure of objects in a scene. The user selects, via a touch screen, which objects receive how much exposure. This can effectively balance the exposure of objects in a scene that might otherwise be rendered as having extremely different brightnesses using traditional methods. The 'problematic' scenario is shown in the uppermost image below, while Olympus' 'fix' is shown in the image below it:
|Image from the Olympus patent that shows a scenario where buildings in the foreground are in danger of being overexposed if the shutter is left open long enough to capture interesting fireworks. [Source: Egami]|
|An overall schematic of Olympus' technology to selectively control exposure of scene elements using a touchscreen interface. The user paints in the portions of the image (buildings) in danger of being overexposed, while the rest of the scene accrues exposure until an optimal image is achieved (the balanced exposure on the right). [Source: Egami]|
We had a look at the original patent (translated by Google) and, while there is mention of varying the photoelectric conversion sensitivity, of more interest is the repeated use of the phrase ‘[reading the] image sensor sequentially’ in the patent. We think this suggests that a final image is assembled from many images read sequentially off the sensor. This would be a logical extension of Olympus' current 'Live Time' implementation where, instead of allowing pixels to accrue exposure over a number of intervals (nondestructively reading the sensor after each interval to display the accumulated exposure), the sensor is destructively read (or reset) after each interval. The exposures from each interval could then be added together selectively; that is, with the input of the photographer as to what scene elements require more, or less, exposure. You might think of it as a way to take 'Live Time' and add user input into the process to imbue some 'intelligence' into the synthesis of the final image. That's incredibly exciting.
Patent images (see below) suggest that this 'user input' - the process of selecting which scene elements receive longer or shorter exposures - is done via some interaction with the histogram (a graph that essentially represents pixels based on brightness value). We imagine that these sorts of operations could be performed via a connected smartphone or tablet to avoid camera shake during exposure.
|This image from the patent suggests that the photographer selects regions of the histogram - which represents scene elements based on brightness - that should receive more, or less, exposure. [Source: Egami]|
To more specifically visualize how a photographer might benefit from this technology, let's return to our shot of sunset at Deception Pass and imagine how we might use the technology suggested in the patent. Using 'Live Time', we set up intervals of 1s exposures to be sequentially read off the sensor and added (digitally) to form the final image. We use the touchscreen to indicate that the sun, or any bright regions on the histogram, should only receive one interval of exposure. Meanwhile, the rest of the scene should receive 10 intervals, or, should simply continue accruing exposure until we feel a balanced exposure has been achieved. All of this seems feasible without significant technological breakthroughs in sensor design if the image were to be built up digitally. That is, from the, say, 10 exposures: add together signals from pixels that require longer exposures, while averaging signals from pixels requiring shorter exposures. This (digital) method would circumvent the need to actually expose different pixels for different amounts of time at the hardware level (something that, while theoretically possible, is extremely difficult to do).
At this point, we're being very speculative about the actual implementation of the patent (assuming it is ever implemented at all); nonetheless, the implications are exciting, as this technology might allow for photographers using 'Live Time' to capture high dynamic range scenes the luxury of getting a proper exposure in-camera as opposed to manually assembling HDR images from multiple shots in post-processing. In the end, any technology that allows for selective exposure of scene elements at the time of capture has the potential to provide better image quality in scenes containing subjects of significantly varying brightnesses.
What might it mean?
Looking to the future, the utility of this technology could increase further with faster sensor reading rates and higher processing power of future generations of cameras. Improvements in these areas would make this system more robust - for scenes requiring shorter overall exposures, for example. However, it would be hard to utilize this technique for moving subjects, as well as handheld shots without proper image alignment. Even so, we think the implications are intriguing.
What do you think? Let us know in the comments section below.
|Hot Air Balloons Over Bagan by User9320321874|
|Blue mood by darub|
from Fixed lens shootout.
|Yellow Warbler by LeeS|
from A Big Year - birds
|Waiting for the Parade by tcoker1103|
from - La Vida Loca - (Black and White Street Photography+ A Border)
The Pictar grip provides a number of customizable physical controls for your iPhone camera, but at its price point we would like to see better materials and build quality.
Peak Design's 'consider every detail' approach shines in the Everyday Backpack. While expensive, it's one of the best options out there for a photographer who needs to pack a lot of stuff in addition to gear.
If you're thinking of using Canon's sports glass on the Sony a9, think again. The ultra-fast camera slows way down when you attach off-brand glass.
The Polish town of Katowice is not known as an area of beauty, but as all photographers know, that doesn't mean that beauty can't be found if you know where to look. Mariusz Pietranek used a drone to look down on the colorful sedimentation tanks at an ironworks.
New York Times video journalist Ben Solomon spent a harrowing three weeks accompanying Iraqi Major Sajjad al-Hour as he and his men fought to retake Mosul from I.S. forces.
The 3D VR camera launched through a crowdfunding campaign in 2015 goes on sale beginning June 26.
Noctilucent clouds, a crescent moon and Venus were visible in the pre-dawn sky over Budapest yesterday. Photographer György Soponyai captured NASA's astronomy picture of the day.
Squirming pets won't sit still for photos? A Kickstarter campaign is looking to help.
Find out how Chris Burkard shifted from editorial photography to his true passions: landscapes, conservation and, of course, surfing.
The updated EyeEm app scans your camera roll and picks images that are composed particularly well, have the best quality, or highest chance of selling on EyeEm Market.
It's three years old but still a solid option for a Micro Four Thirds shooter looking for a high-quality, fast, wide-angle prime. Take a look at how we got along with it.
Tamron has announced the longest all-in-one zoom lens currently available, the 18-400mm F3.5-6.3 Di II VC HLD. Designed for Canon and Nikon crop-sensor cameras, the lens will be available in July.
When you're ready to step-up to full-frame from an entry-level or midrange camera, the choices can be overwhelming. Find out which models came out on top in our $1200-2000 enthusiast ILC roundup.
Just a guy wearing a VR headset, smashing invisible Goombas in Central Park.
NASA's Mars Reconnaissance Orbiter captured this gorgeous aerial photo of the Martian landscape. And if you look really close, you can actually see the Mars Curiosity rover in the very middle.
The city of Laguna Beach, California has provided some clarification around the kinds of photography permits it offers.
Later this year, a VR180 camera will be Joining Yi's Halo and 360 VR cameras, which will offer stereo 3D capture, yet be as easy to use and compact as a 2D camera.
Caltech researchers have developed an 'optical phased array' chip that uses time delays instead of a lens to focus the incoming light.
Pricing and shipping have finally been revealed for two highly anticipated lenses from Sigma, announced in February.
These macro photos of clouds of paint billowing through clear water might look like high-quality CGI, but they're real photographs. And photographer Alberto Seveso told us how they were made.
Facebook is testing a feature that prevents people from saving, sharing, or even taking a screenshot of your profile picture.
We've reshot the Sony a9 in our studio. The short story: it's sharper! The long story... well you can read it all here.
The collection will be officially launched during the Europeana Transcribathon Campus Berlin 2017 crowdsourcing event which will be held on 22 and 23 June at the Berlin State Library.
Light gives us some insight into the preparations for the launch of the pre-order shipments of its much anticipated L16 multi-lens camera.
OnePlus co-founder Carl Pei has confirmed in a tweet that the second lens on the back of the OnePlus 5 uses a 1.6x optical zoom and that digital zoom is used to reach the claimed 2x zoom factor.
Fujifilm recently unveiled the second in its series of affordable cine lenses, the MK50-135mm T2.9. We got our hands on it for a couple days and took it for a spin.
Leica's first attempt at an M-series digital rangefinder was rough around the edges, but set a pattern for all of the cameras that came after it. In this week's Throwback Thursday article, Barney remembers the M8.
No stranger to extreme situations, legendary climber and filmmaker Jimmy Chin talks to Outside Magazine about his career, and the challenge of filming Alex Honnold's rope-free solo climb of El Capitain.
A company backed by Android co-founder Andy Rubin is attempting to make video conferencing less terrible.
Rangefinder magazine asked five professional portrait and wedding photographers about posting on Instagram; no surprise, they got five different answers.