Olympus patent hints at selective exposure in 'Live Time' mode
Earlier this week, Japanese patent blog Egami reported that Olympus has patented a technology that would allow the photographer to selectively adjust exposure of different scene areas during an exposure. This might allow for a more balanced exposure of scenes where cameras might normally struggle (and the photographer might have to resort to high dynamic range or multiple exposure techniques).
In scenes like the one pictured below, it's hard to avoid overexposure of bright areas or underexposure of dark areas in a single exposure, due to the limited dynamic range of current imaging sensors. Selectively controlling the exposure of dark and bright objects at the time of capture is one way to deal with dynamic range limitations of current hardware, and could be of huge interest to those interested in high dynamic range (HDR) photography. We've had some time to sit down and look at the original patent to read between the lines and conjecture about what the actual implementation might be.
|Sunset at Deception Pass, WA. This was a high dynamic range scene that required multiple exposures (1s, 4s, 15s) to composite a final image in Adobe Photoshop. This sort of scene could benefit from Olympus' technology that allows for selective exposure times for various scene elements. [Photo: Rishi Sanyal]|
The patent appears to be a natural extension of Olympus' current 'Live Time' (or 'Live Bulb') feature, where the camera reads the sensor at set intervals (0.5, 1, 2, 4, 8, 15, 30, or 60s), continuously adding the exposures until the photographer stops the process with a press of the shutter. This mode is quite useful for, say, landscape photographers who are photographing a scene requiring long exposures but who might not know the ideal exposure time beforehand. In such cases, Olympus's 'Live Time' feature allows the camera to continue accruing exposure until the photographer decides, via the LCD display or histogram, that a good exposure has been achieved.
The problem is that neither 'Live Time', nor any other traditional exposure mode in today's cameras, can do much in the way of holding back the exposure of, say, the sun in the photo of Deception Pass above. It's just too bright compared to the rest of the scene. So as we accrue a 4s exposure for the clouds and a 15s exposure for the trees in the photo above, the sun and surrounding areas would almost certainly clip to white. This sort of scenario - where there is a huge difference in brightness between important areas of a scene - is exactly what we believe this new patent from Olympus is designed to address.
The technology outlined in the patent appears to use a form of multi-exposure technique to control the exposure of objects in a scene. The user selects, via a touch screen, which objects receive how much exposure. This can effectively balance the exposure of objects in a scene that might otherwise be rendered as having extremely different brightnesses using traditional methods. The 'problematic' scenario is shown in the uppermost image below, while Olympus' 'fix' is shown in the image below it:
|Image from the Olympus patent that shows a scenario where buildings in the foreground are in danger of being overexposed if the shutter is left open long enough to capture interesting fireworks. [Source: Egami]|
|An overall schematic of Olympus' technology to selectively control exposure of scene elements using a touchscreen interface. The user paints in the portions of the image (buildings) in danger of being overexposed, while the rest of the scene accrues exposure until an optimal image is achieved (the balanced exposure on the right). [Source: Egami]|
We had a look at the original patent (translated by Google) and, while there is mention of varying the photoelectric conversion sensitivity, of more interest is the repeated use of the phrase ‘[reading the] image sensor sequentially’ in the patent. We think this suggests that a final image is assembled from many images read sequentially off the sensor. This would be a logical extension of Olympus' current 'Live Time' implementation where, instead of allowing pixels to accrue exposure over a number of intervals (nondestructively reading the sensor after each interval to display the accumulated exposure), the sensor is destructively read (or reset) after each interval. The exposures from each interval could then be added together selectively; that is, with the input of the photographer as to what scene elements require more, or less, exposure. You might think of it as a way to take 'Live Time' and add user input into the process to imbue some 'intelligence' into the synthesis of the final image. That's incredibly exciting.
Patent images (see below) suggest that this 'user input' - the process of selecting which scene elements receive longer or shorter exposures - is done via some interaction with the histogram (a graph that essentially represents pixels based on brightness value). We imagine that these sorts of operations could be performed via a connected smartphone or tablet to avoid camera shake during exposure.
|This image from the patent suggests that the photographer selects regions of the histogram - which represents scene elements based on brightness - that should receive more, or less, exposure. [Source: Egami]|
To more specifically visualize how a photographer might benefit from this technology, let's return to our shot of sunset at Deception Pass and imagine how we might use the technology suggested in the patent. Using 'Live Time', we set up intervals of 1s exposures to be sequentially read off the sensor and added (digitally) to form the final image. We use the touchscreen to indicate that the sun, or any bright regions on the histogram, should only receive one interval of exposure. Meanwhile, the rest of the scene should receive 10 intervals, or, should simply continue accruing exposure until we feel a balanced exposure has been achieved. All of this seems feasible without significant technological breakthroughs in sensor design if the image were to be built up digitally. That is, from the, say, 10 exposures: add together signals from pixels that require longer exposures, while averaging signals from pixels requiring shorter exposures. This (digital) method would circumvent the need to actually expose different pixels for different amounts of time at the hardware level (something that, while theoretically possible, is extremely difficult to do).
At this point, we're being very speculative about the actual implementation of the patent (assuming it is ever implemented at all); nonetheless, the implications are exciting, as this technology might allow for photographers using 'Live Time' to capture high dynamic range scenes the luxury of getting a proper exposure in-camera as opposed to manually assembling HDR images from multiple shots in post-processing. In the end, any technology that allows for selective exposure of scene elements at the time of capture has the potential to provide better image quality in scenes containing subjects of significantly varying brightnesses.
What might it mean?
Looking to the future, the utility of this technology could increase further with faster sensor reading rates and higher processing power of future generations of cameras. Improvements in these areas would make this system more robust - for scenes requiring shorter overall exposures, for example. However, it would be hard to utilize this technique for moving subjects, as well as handheld shots without proper image alignment. Even so, we think the implications are intriguing.
What do you think? Let us know in the comments section below.
|Brown Crown by Nilesh Trivedi|
from brown challenge
|D72_4852_DxO Smug by richpics|
from Aviation Legends: X-Planes
|Everyone look at the camera by cjf2|
from Looking down the lens.
|Ancient Bristlecone Pine by ed rader|
from My Best Picture of the Week
The six prize-winning photographs and four honorable mentions were narrowed down from more than 6,000 entries captured across North America.
Though Thunderbolt 4 remains at 40Gb/s, its minimum requirements include dual 4K monitor support, faster external drive speeds and more.
You can now use compatible Fujifilm cameras with video conferencing software on macOS hardware without the need of a dedicated capture card.
The Epson V600 remains one of the most popular flatbed film scanners on the market. Revisit our review of this affordable and (mostly) easy-to-use option and see how its output compares to local lab scans.
Canon's mirrorless EOS R5 comes with a ton of features and capability stemming from its design inside and out. Come along with us on a guided tour of Canon's new high-end, high-megapixel camera and check it out for yourself.
Announced alongside the EOS R5, the R6 offers a lot of the same technology but in a more affordable, slightly more enthusiast-focused model. Take a closer look.
Alongside the EOS R5 and R6, Canon has announced a brace of lenses, all in the short to long telephoto range. Filling out the 'long' end are one L-series zoom, and two innovative primes.
Alongside a trio of telephoto lenses, Canon also announced a new 85mm this week. The RF 85mm F2 Macro IS STM is a compact, affordable alternative to the pro-oriented 85mm F1.2L.
The EOS R5 has been a long time coming – we knew it had 8K and we knew it had an AF joystick. But now that's it's here, what is it really like to use? Find out in our initial review based on hands-on time with the camera.
The R6 doesn't promise quite such headline-grabbing specs as its big brother, but it still packs a punch, whether you shoot stills, video or both.
Think you've read everything there is to know about the new Canon cameras? Chris and Jordan share eight important things you may have missed from today's Canon EOS R5 and R6 announcements.
We've been shooting around with the new Canon EOS R6. Initial impressions of image quality are positive, and out-of-camera JPEGs appear similar to that of the gold award-winning Canon EOS-1D X III. Have a look for yourself.
Canon has officially released the long-awaited EOS R5, the company's top-end full-frame mirrorless camera. Featuring a new 45MP CMOS sensor, Dual Pixel AF II system, 8K video capture and 20 fps bursts, this is the RF-mount camera we've been waiting for.
Although the Canon EOS R6 doesn't have the 45MP sensor and 8K video capture of the higher-end R5, it's still an incredibly capable camera with specs that outshine similarly priced peers.
The Canon RF 100-500mm F4.5-7.1L IS USM is the company's first super-zoom lens for RF-mount. Despite a relatively slow aperture range, it's very versatile, offering five stops of stabilization, weather-sealing and compatibility with Canon's new teleconverters.
Canon's RF 85mm F2 Macro IS STM is an inexpensive telephoto prime lens with a minimum focus distance of just 0.35m (14") and a 0.5x magnification. When attached to the new R5 and R6, it offers a whopping eight stops of shake reduction.
Canon has announced a pair of super-telephoto fixed-aperture primes. The 600mm and 800mm use diffractive optics to keep their size and weight down. They'll also be compatible with new 1.4x and 2x RF teleconverters.
Canon has announced a new small-footprint inkjet photo printer, the imageProGraf Pro-300. it will produce prints up to 13 x 19" and it goes on sale later this month for $900. A new textured photo paper will also arrive in July.
The new compression standard is set to reduce video file sizes by half to save space and speed-up transmission, paving the way for more portable 8K footage.
Sony recently confirmed plans to launch a successor to the video-centric a7S II. We don't even know the name of the camera, but Jordan already has a feature wish list for the new 'a7S III' – and it doesn't include 8K.
The Profot B10 is the first studio flash system that can be used when shooting with an iPhone camera.
The Pixii camera is an interesting little rangefinder camera that features a 12MP APS-C sensor and lacks a rear LCD display, opting instead to pair with your mobile device, which can be used to view and transfer images.
Sirui is launching an Indiegogo campaign for a wide-angle answer to its existing 50mm F1.8 anamorphic lens. The 35mm APS-C lens will come in a Micro Four Thirds mount with adapters for other systems.
Sony has added a 12-24mm F2.8 to its top-shelf 'G Master' series of lenses. It's the widest constant F2.8 zoom currently offered for full-frame, with a hefty price tag to match: it will sell for $3000 when it ships in mid-August.
Take a look at the view from Sony's new ultra-wide F2.8 zoom – we paired it with the a7R IV for some initial shooting.
Canon's EOS-1D X Mark III is one of the best DSLRs ever made. With fast burst speeds, great video quality and impressive autofocus, the 1D X III is equal parts cinema rig and sports shooter. Find out how it fares against steep competition in our full review.
Nikon Rumors is reporting that Nikon will announce successors to its Z6 and Z7 camera systems by the end of the calendar year.
Canon says the event, set to take place at 14:00 CEST in two days on July 9, will be its 'biggest product launch yet.'
The Verge Video Director, Becca Farsace, shows how she built a custom Raspberry Pi camera with effectively zero coding knowledge over the course of just three days.
The EOS R5 has been in the works for some time, and Canon has published a handful of specifications, but there's still plenty we don't know. What are you hoping to see from Canon's forthcoming flagship camera?