Two professors at the University of Rochester in New York have designed a prototype CMOS chip that uses a fraction of the energy used today, captures better images and can run for years on a single battery. Mark Bocko, professor of electrical and computer engineering and assistant professor Zeljko Ignjatovic, are also working to incorporate further technology that will compress the image with far fewer computations than current compression techniques. It's likely that the technology will be tested first in wireless security cameras, and, Bocko says, as the chips are developed further, they will look into using them in consumer cameras and cell phones.
Breakthrough chip delivers better digital pictures for less power
Tiny cameras could run for years
The next advance in cameras is becoming a reality at the University of Rochester. Imaging chips revolutionized the photography industry, and now the chips themselves are being revolutionized. A pair of newly patented technologies may soon enable power-hungry imaging chips to use just a fraction of the energy used today and capture better images to boot - all the while enabling cameras to shrink to the size of a shirt button and run for years on a single battery. Placed in a home, they could wirelessly provide images to a security company when an alarm is tripped, or even allow mapping software like Google's to zoom in to real-time images at street level. The enormous reduction in power consumption and increase in computing power can also bring cell-phone video calls closer to fruition.
The team of Mark Bocko, professor of electrical and computer engineering, and Zeljko Ignjatovic, assistant professor of electrical and computer engineering, has designed a prototype chip that can digitize an image right at each pixel, and they are working now to incorporate a second technology that will compress the image with far fewer computations than the best current compression techniques.
"These two technologies may work together or separately to greatly reduce the energy cost of capturing a digital image," says Bocko. "One is evolutionary in that it pushes current technology further. The second may prove to be revolutionary because it's an entirely new way of thinking about capturing an image in the first place."
The first technology being developed integrates an oversampling "sigma-delta" analog-to-digital converter at each pixel location in a CMOS sensor. "CMOS" is a common semiconductor fabrication process used in most chips manufactured today. Previous attempts to do this on-pixel conversion have required far too many transistors, leaving too little area to collect light. The new designs use as few as three transistors per pixel, reserving nearly half of the pixel area for light collection. First tests on the chip show that at video rates of 30 frames per second it uses just 0.88 nanowatts per pixel--50 times less than the industry's previous best. It also trounces conventional chips in dynamic range, which is the difference between the dimmest and brightest light it can record. Existing CMOS sensors can record light 1,000 times brighter than their dimmest detectable light, a dynamic range of 1:1,000, while the Rochester technology already demonstrates a dynamic range of 1:100,000.
Traditional image sensors use an array of light-sensitive diodes to detect incoming light, and transistors located at each photodiode to amplify and transmit the signal to an analog-to-digital converter located outside of the photodiode array. Other designs can convert the signal to digital at the pixel site, but require high precision transistors, which take up considerable chip space at each pixel and reduce the amount of surface area on the chip devoted to receiving light. The new design not only uses smaller transistors at each pixel, and thus can allow more light to be detected, but the transistors can be scaled down in size without diminishing the sensor performance as advances in semiconductor fabrication technologies allow the size of transistors to shrink. This means that much denser, higher-resolution chips can be developed without the prohibitive problems of the existing sensor designs. When transistors are reduced in size, they also become faster, allowing incoming light to be sampled more frequently and accurately.
What makes Bocko and Ignjatovic's method work so elegantly is its feedback design. Traditional CMOS image detectors apply a voltage to charge up a photodiode, and incoming light triggers a release of some of that charge. An amplifying transistor then checks the remaining voltage on the diode, and the diode is recharged again. Bocko and Ignjatovic's design also begins with a charged photodiode that discharges when light reaches it, but the discharge is then measured against a one/zero threshold and the resulting bit is delivered off the chip. If the result of a measurement is a one, then a packet of charge is fed back to the diode, effectively recharging it. The design also uses significantly less power than existing sensor designs, which is especially important in smaller devices like cell phones and digital cameras where battery size is restricted.
The second advance has taken many researchers by surprise. Called "Focal Plane Image Compression," Bocko and Ignjatovic have figured out a way to arrange photodiodes on an imaging chip so that compressing the resulting image demands as little as 1 percent of the computing power usually needed.
Normally, the light-detecting diodes on a chip are arranged in a regular grid--say 1,000 pixels by 1,000 pixels. A picture is snapped and each diode records the light hitting it. A computer in the camera then runs complex computations to compress the image so that instead of taking up 10 hefty megabytes, it might only take up 100 kilobytes. The common picture type "JPEG," used on the Web and on many cameras and phones, is an example of this. This compression, unfortunately, takes a tremendous amount of computing power, and hence battery power.
Ignjatovic and Bocko of the Department of Electrical and Computer Engineering, came up with a way to make the physical layout of the light-sensitive diodes simplify the computation. The normal way to perform compression includes a computation called the discrete cosine transform, which checks how much a segment of an image resembles a series of cosine waves. Both the image and the cosine waves are sampled at regular intervals and the transform requires that the image and cosine wave samples be multiplied together and added. Since the cosine wave samples can have a value anywhere between -1and +1, the computation requires multiplication by non-integers, which demands the bulk of the computing power.
But Ignjatovic and Bocko have laid out the pixels to lie at the peaks of cosine waves resulting in a non-uniformly distributed array, instead of an evenly spaced one. By using this trick, the amount of computation required to compress the image is slashed by nearly five-fold. Since each pixel is positioned exactly where each cosine wave has a peak where the cosine value is "one," multiplying by one is unnecessary. With no multiplication and only a little addition, the processor uses less power.
The team members are now looking to build a prototype chip that incorporates both technologies into a single unit to see how much real-world processing power the designs will save. They plan to integrate the technology into wireless security cameras at first.
"Wireless security cameras offer the perfect proving ground for these technologies," says Bocko. "These cameras need to capture, compress, and transmit high quality images as quickly as they can without consuming precious battery power. As we develop the chips further, we'll look more into consumer cameras and cell phones to see how much battery and processing power we can save them as well."
Dec 2, 2008
Dec 2, 2008
Dec 1, 2008
Nov 25, 2008
TIME Magazine has named the Sony a7R III one of its top 10 gadgets of 2017. It was the only camera that made the illustrious list this year, receiving high praise from TIME, who dubbed it "one of the best mirrorless cameras ever made."
Thanks to Google Assistant integration, the Pixel 2's AI-powered 'Google Lens' camera feature will soon be easier and quicker to use.
Photographer Jenna Martin and her model friend Rachelle Kathleen set themselves a challenge: could they create beautiful portraits in an 'ugly' location? So they went to a local Lowe's hardware store and gave it a go!
The LG V30 differentiates itself from the competition with an expansive video feature set and a secondary wide angle camera, making it something of a Swiss Army knife for content creators.
We're counting down our top 10 most popular sample galleries of 2017. Holding down the top position is none other than the Nikon D850 – by a landslide.
It's been twenty years since Jeff Keller founded the Digital Camera Resource Page, one of the first websites dedicated to digital photography. Jeff, who has been at DPReview for nearly five years, looks back at the rise and fall of consumer digital cameras and his website.
We're counting down our top 10 most popular sample galleries of 2017. At #2 we have another staff favorite – the Sony Alpha a9.
Rotolight has released the Anova Pro 2 circular LED for stills and video, boasting a 70% increase in brightness and what the company describes as "unrivaled battery performance."
Designer Vinicius Araújo has imagined what he believes the perfect Adobe software keyboard might look like. From customizable touch pads, to a scroll wheel, to a little display that shows the tool in use, his design is pretty compelling.
Peak Design has teamed up with Leica to release a limited-edition backpack made special for fans of the Red Dot.
A portrait of an android woman has beaten over 5,700 pictures of humans to take third place in this year’s prestigious Taylor Wessing Portrait Prize. The judges were not told the subject was an 'android' until after the winning images were chosen.
Hauling around C-Stands just got a whole lot less annoying thanks to these new Matthews shoulder and roller bags, which can hold two or three C-stand (respectively) plus accessories.
Neal Preston has shot timeless photos of everyone from Led Zeppelin, to Whitney Houston, to Michael Jackson. In this interview, he offers insights into his craft to up-and-comer Elijah Dominique.
Future prosumer Canon DSLRs might feature light-up buttons, if this newly published patent is any indication of the camera company's plans.
Sony's a7R Mark III shoots 42.4MP files at 10fps and incorporates a robust video feature set, large battery, refined ergonomics and more. It certainly looks impressive, but what is it like to use, and how does it stack up against the rest of the market? Find out in our full review.
We're counting down our top 10 most popular sample galleries of 2017 – the Fujifilm X100F takes the bronze and the #3 spot.
There's never been a better time to shop for a new camera, but the number of options available can be overwhelming. In this series of buying guides we've provided customized recommendations for several use cases, from shooting landscapes to buying a first camera for a student photographer.
Shopping for a camera with a set budget? No problem! We've rounded up our favorite cameras, broken them into price brackets and picked the best of the bunch.
Looking for a lightweight compact camera that's easy to bring with you anywhere? Or maybe you're smartphone-shopping and want the one that takes the best picture. And what if you want to shoot from above? In these buyers guides we have recommendations for the best compact cameras, smartphones and drones.
Despite reports to the contrary, analysis of DPReview images by our friend Jim Kasson confirms a disappointing fact: Sony a7R III is still a Star Eater. But there may be some improvements.
As the saying goes: A photo is worth a thousand words. And if you're sending that photo through Facebook Messenger, your thousand words now look twice as nice after today's update to 4K resolution.
Get to know the new Leica CL in short order by giving our 90 second 'First look' video a watch.
Leica has just released the CL, the forth in its series of APS-C L-mount cameras. Despite sharing a name with a camera released in the mid-70s, the new CL is a thoroughly modern ILC, with a 24MP sensor and built-in electronic viewfinder.
The Leica CL is a 24MP rangefinder-style mirrorless camera, which sits alongside the TL2 in the company's APS-C lineup. We've been using one for a few days – check out our gallery of images.
While it shares a name with one of Leica's most popular and affordable cameras of the 1970s, the new CL is separated from its namesake by more than just years. We've been using one for a few days - click through for a detailed first-impressions report.
We're counting down our top 10 most popular sample galleries of 2017, and the #4 ranking goes to the Leica M10.
Sigma is discounting 13 different high-performance 'Art' series lenses from today until November 30th. The company is calling it an 'unprecedented' sale.
See DJI's 'AeroScope' drone-tracking technology in action. This is the system that DJI says can help law enforcement and airport (among others) track and identify rogue drones.
iPhone X owners can already accessorize their new phone with high-quality smartphone photography lenses courtesy of Moment's new lineup.
Considering buying Sigma's exciting new 16mm F1.4 DC DN Contemporary lens for crop-sensor E-Mount and M43? Check out these official full-res samples first!