Two professors at the University of Rochester in New York have designed a prototype CMOS chip that uses a fraction of the energy used today, captures better images and can run for years on a single battery. Mark Bocko, professor of electrical and computer engineering and assistant professor Zeljko Ignjatovic, are also working to incorporate further technology that will compress the image with far fewer computations than current compression techniques. It's likely that the technology will be tested first in wireless security cameras, and, Bocko says, as the chips are developed further, they will look into using them in consumer cameras and cell phones.
Breakthrough chip delivers better digital pictures for less power
Tiny cameras could run for years
The next advance in cameras is becoming a reality at the University of Rochester. Imaging chips revolutionized the photography industry, and now the chips themselves are being revolutionized. A pair of newly patented technologies may soon enable power-hungry imaging chips to use just a fraction of the energy used today and capture better images to boot - all the while enabling cameras to shrink to the size of a shirt button and run for years on a single battery. Placed in a home, they could wirelessly provide images to a security company when an alarm is tripped, or even allow mapping software like Google's to zoom in to real-time images at street level. The enormous reduction in power consumption and increase in computing power can also bring cell-phone video calls closer to fruition.
The team of Mark Bocko, professor of electrical and computer engineering, and Zeljko Ignjatovic, assistant professor of electrical and computer engineering, has designed a prototype chip that can digitize an image right at each pixel, and they are working now to incorporate a second technology that will compress the image with far fewer computations than the best current compression techniques.
"These two technologies may work together or separately to greatly reduce the energy cost of capturing a digital image," says Bocko. "One is evolutionary in that it pushes current technology further. The second may prove to be revolutionary because it's an entirely new way of thinking about capturing an image in the first place."
The first technology being developed integrates an oversampling "sigma-delta" analog-to-digital converter at each pixel location in a CMOS sensor. "CMOS" is a common semiconductor fabrication process used in most chips manufactured today. Previous attempts to do this on-pixel conversion have required far too many transistors, leaving too little area to collect light. The new designs use as few as three transistors per pixel, reserving nearly half of the pixel area for light collection. First tests on the chip show that at video rates of 30 frames per second it uses just 0.88 nanowatts per pixel--50 times less than the industry's previous best. It also trounces conventional chips in dynamic range, which is the difference between the dimmest and brightest light it can record. Existing CMOS sensors can record light 1,000 times brighter than their dimmest detectable light, a dynamic range of 1:1,000, while the Rochester technology already demonstrates a dynamic range of 1:100,000.
Traditional image sensors use an array of light-sensitive diodes to detect incoming light, and transistors located at each photodiode to amplify and transmit the signal to an analog-to-digital converter located outside of the photodiode array. Other designs can convert the signal to digital at the pixel site, but require high precision transistors, which take up considerable chip space at each pixel and reduce the amount of surface area on the chip devoted to receiving light. The new design not only uses smaller transistors at each pixel, and thus can allow more light to be detected, but the transistors can be scaled down in size without diminishing the sensor performance as advances in semiconductor fabrication technologies allow the size of transistors to shrink. This means that much denser, higher-resolution chips can be developed without the prohibitive problems of the existing sensor designs. When transistors are reduced in size, they also become faster, allowing incoming light to be sampled more frequently and accurately.
What makes Bocko and Ignjatovic's method work so elegantly is its feedback design. Traditional CMOS image detectors apply a voltage to charge up a photodiode, and incoming light triggers a release of some of that charge. An amplifying transistor then checks the remaining voltage on the diode, and the diode is recharged again. Bocko and Ignjatovic's design also begins with a charged photodiode that discharges when light reaches it, but the discharge is then measured against a one/zero threshold and the resulting bit is delivered off the chip. If the result of a measurement is a one, then a packet of charge is fed back to the diode, effectively recharging it. The design also uses significantly less power than existing sensor designs, which is especially important in smaller devices like cell phones and digital cameras where battery size is restricted.
The second advance has taken many researchers by surprise. Called "Focal Plane Image Compression," Bocko and Ignjatovic have figured out a way to arrange photodiodes on an imaging chip so that compressing the resulting image demands as little as 1 percent of the computing power usually needed.
Normally, the light-detecting diodes on a chip are arranged in a regular grid--say 1,000 pixels by 1,000 pixels. A picture is snapped and each diode records the light hitting it. A computer in the camera then runs complex computations to compress the image so that instead of taking up 10 hefty megabytes, it might only take up 100 kilobytes. The common picture type "JPEG," used on the Web and on many cameras and phones, is an example of this. This compression, unfortunately, takes a tremendous amount of computing power, and hence battery power.
Ignjatovic and Bocko of the Department of Electrical and Computer Engineering, came up with a way to make the physical layout of the light-sensitive diodes simplify the computation. The normal way to perform compression includes a computation called the discrete cosine transform, which checks how much a segment of an image resembles a series of cosine waves. Both the image and the cosine waves are sampled at regular intervals and the transform requires that the image and cosine wave samples be multiplied together and added. Since the cosine wave samples can have a value anywhere between -1and +1, the computation requires multiplication by non-integers, which demands the bulk of the computing power.
But Ignjatovic and Bocko have laid out the pixels to lie at the peaks of cosine waves resulting in a non-uniformly distributed array, instead of an evenly spaced one. By using this trick, the amount of computation required to compress the image is slashed by nearly five-fold. Since each pixel is positioned exactly where each cosine wave has a peak where the cosine value is "one," multiplying by one is unnecessary. With no multiplication and only a little addition, the processor uses less power.
The team members are now looking to build a prototype chip that incorporates both technologies into a single unit to see how much real-world processing power the designs will save. They plan to integrate the technology into wireless security cameras at first.
"Wireless security cameras offer the perfect proving ground for these technologies," says Bocko. "These cameras need to capture, compress, and transmit high quality images as quickly as they can without consuming precious battery power. As we develop the chips further, we'll look more into consumer cameras and cell phones to see how much battery and processing power we can save them as well."
Dec 2, 2008
Dec 2, 2008
Dec 1, 2008
Nov 25, 2008
|Christine by JP Zanotti|
from Car wreck
|Fangorn Forest by cand1d|
|Yosemite Falls with Moonbow by Jonathan Shapiro|
from Best Landscape of the Week 4
Not everyone wants to pay a premium for a long zoom camera. Thankfully, there are many reasonably priced cameras available, though they won't offer the same image quality as enthusiast models. In this updated roundup we look at big zoom cameras with more consumer-friendly price tags. Read more
Think Tank Photo has updated two of its popular bag lines with improvements to functionality. Read more
We’ve all seen Bob Jackson’s Pulitzer Prize winning photo, but there's another.
The sample footage looks good.
It will automatically pick the best camera settings depending on shooting conditions. It even promises enhanced functionality for your camera, like exposure and focus stacking. It already supports many cameras from Canon, Fuji, Nikon and Sony. Read more
As if $13,950 wasn’t enough to pay for a special edition lens, the Leica Store in San Francisco is offering a prototype of said lens for $24,995. Read more
Make those old photos disappear without deleting them forever.
Firmware updates enable 10 fps shooting with adapted A-mount lenses, and faster startup times and better compatibility for 20 fps shooting when using native lenses on the a9.
Fujifilm has released firmware updates for its camera models X-T2, X-Pro2, GFX 50s, X-T20, X100F and X-T1 and updates to three of its software products.
A 22 year-old Romanian photographer uses his DJI Phantom 4 drone to capture unique perspectives of the city where he now lives.
What's it like to ride the waves with champion surfer Kelly Slater? This VR video from Teton Gravity Research gives you a taste.
When Nikon released the full-frame D3 in 2007, it changed the professional photography industry. In this week's Throwback Thursday, Barney remembers a legend. Read more
The new stuff should have better red hues, improved sensitivity and finer grain - but don't worry - will still shift blues to green, greens to purple and yellows to pink.
Ricoh has introduced a new rugged compact camera with a 16MP CMOS sensor, 28-140mm lens, 2.7" LCD and built-in LED macro lights. Read more
This compact drone can shoot HD video using a 2-axis stabilized 12MP camera. Read more
The new Prynt Pocket can print a photo directly from their iPhone simply by inserting the phone into the printer, then snapping a photo. Each print will cost about 50 cents. Read more
Updates for Adobe Camera Raw and Lightroom CC bring support for the Sony A9 and Panasonic ZS70/TZ90, along with bug fixes.
The Triggertrap remote camera control system is no longer sold due to the company folding, but now users will be able to build their own. Read more
The Magic Format Converter comes with internal optics that expand the image circle of full-frame DSLR lenses for use on the Fuji medium format camera. Read more
The usually Apple-exclusive MacPhun software developer has announced that it will introduce PC versions of two of its most popular applications. Both Aurora HDR and Luminar should be available for the Windows operating system by the autumn of this year. Read more
Sony's newest G Master telephoto zoom, announced alongside the a9, is the first of the company's FE lenses to reach 400mm natively. We had one in California and photographed horses, portraits, and landscapes - check out how it did. Read more
Garmin has entered the 360-camera market with the VIRB, which captures 5.7K video at 30p as well as 15MP stills. Read more
German media reports that the founders of the company behind the Panono 360-degree ball camera have filed for bankruptcy at a court in Berlin. Read more
With a claimed 800 new custom parts, Microsoft's updated Surface Pro comes with the latest Kaby Lake processors, better battery life, a new hinge, plus the Surface Pen is updated as well. Read more
DW Photo is attempting to resurrect the Hy6 medium format camera, though the legal tangles of its development may stop it being branded Rolleiflex.
The Kodak EKTRA, the company's 'camera first' smartphone, is now available to purchase in the United States. Read more
Apple and Nokia have settled their years-old patent dispute. Apple will make an undisclosed payment to Nokia and sign a licensing agreement related to digital health products with the Finnish company.
David Gibson, one of Britain's best known street shooters, shares all.
Photographers from the SKYGLOW project travelled 150k miles and took 3 million photos in increasingly rare locations: those without light pollution.
The world's fastest 200mm was produced for 16 years. In that time, only 8000 were made.