Two professors at the University of Rochester in New York have designed a prototype CMOS chip that uses a fraction of the energy used today, captures better images and can run for years on a single battery. Mark Bocko, professor of electrical and computer engineering and assistant professor Zeljko Ignjatovic, are also working to incorporate further technology that will compress the image with far fewer computations than current compression techniques. It's likely that the technology will be tested first in wireless security cameras, and, Bocko says, as the chips are developed further, they will look into using them in consumer cameras and cell phones.
Breakthrough chip delivers better digital pictures for less power
Tiny cameras could run for years
The next advance in cameras is becoming a reality at the University of Rochester. Imaging chips revolutionized the photography industry, and now the chips themselves are being revolutionized. A pair of newly patented technologies may soon enable power-hungry imaging chips to use just a fraction of the energy used today and capture better images to boot - all the while enabling cameras to shrink to the size of a shirt button and run for years on a single battery. Placed in a home, they could wirelessly provide images to a security company when an alarm is tripped, or even allow mapping software like Google's to zoom in to real-time images at street level. The enormous reduction in power consumption and increase in computing power can also bring cell-phone video calls closer to fruition.
The team of Mark Bocko, professor of electrical and computer engineering, and Zeljko Ignjatovic, assistant professor of electrical and computer engineering, has designed a prototype chip that can digitize an image right at each pixel, and they are working now to incorporate a second technology that will compress the image with far fewer computations than the best current compression techniques.
"These two technologies may work together or separately to greatly reduce the energy cost of capturing a digital image," says Bocko. "One is evolutionary in that it pushes current technology further. The second may prove to be revolutionary because it's an entirely new way of thinking about capturing an image in the first place."
The first technology being developed integrates an oversampling "sigma-delta" analog-to-digital converter at each pixel location in a CMOS sensor. "CMOS" is a common semiconductor fabrication process used in most chips manufactured today. Previous attempts to do this on-pixel conversion have required far too many transistors, leaving too little area to collect light. The new designs use as few as three transistors per pixel, reserving nearly half of the pixel area for light collection. First tests on the chip show that at video rates of 30 frames per second it uses just 0.88 nanowatts per pixel--50 times less than the industry's previous best. It also trounces conventional chips in dynamic range, which is the difference between the dimmest and brightest light it can record. Existing CMOS sensors can record light 1,000 times brighter than their dimmest detectable light, a dynamic range of 1:1,000, while the Rochester technology already demonstrates a dynamic range of 1:100,000.
Traditional image sensors use an array of light-sensitive diodes to detect incoming light, and transistors located at each photodiode to amplify and transmit the signal to an analog-to-digital converter located outside of the photodiode array. Other designs can convert the signal to digital at the pixel site, but require high precision transistors, which take up considerable chip space at each pixel and reduce the amount of surface area on the chip devoted to receiving light. The new design not only uses smaller transistors at each pixel, and thus can allow more light to be detected, but the transistors can be scaled down in size without diminishing the sensor performance as advances in semiconductor fabrication technologies allow the size of transistors to shrink. This means that much denser, higher-resolution chips can be developed without the prohibitive problems of the existing sensor designs. When transistors are reduced in size, they also become faster, allowing incoming light to be sampled more frequently and accurately.
What makes Bocko and Ignjatovic's method work so elegantly is its feedback design. Traditional CMOS image detectors apply a voltage to charge up a photodiode, and incoming light triggers a release of some of that charge. An amplifying transistor then checks the remaining voltage on the diode, and the diode is recharged again. Bocko and Ignjatovic's design also begins with a charged photodiode that discharges when light reaches it, but the discharge is then measured against a one/zero threshold and the resulting bit is delivered off the chip. If the result of a measurement is a one, then a packet of charge is fed back to the diode, effectively recharging it. The design also uses significantly less power than existing sensor designs, which is especially important in smaller devices like cell phones and digital cameras where battery size is restricted.
The second advance has taken many researchers by surprise. Called "Focal Plane Image Compression," Bocko and Ignjatovic have figured out a way to arrange photodiodes on an imaging chip so that compressing the resulting image demands as little as 1 percent of the computing power usually needed.
Normally, the light-detecting diodes on a chip are arranged in a regular grid--say 1,000 pixels by 1,000 pixels. A picture is snapped and each diode records the light hitting it. A computer in the camera then runs complex computations to compress the image so that instead of taking up 10 hefty megabytes, it might only take up 100 kilobytes. The common picture type "JPEG," used on the Web and on many cameras and phones, is an example of this. This compression, unfortunately, takes a tremendous amount of computing power, and hence battery power.
Ignjatovic and Bocko of the Department of Electrical and Computer Engineering, came up with a way to make the physical layout of the light-sensitive diodes simplify the computation. The normal way to perform compression includes a computation called the discrete cosine transform, which checks how much a segment of an image resembles a series of cosine waves. Both the image and the cosine waves are sampled at regular intervals and the transform requires that the image and cosine wave samples be multiplied together and added. Since the cosine wave samples can have a value anywhere between -1and +1, the computation requires multiplication by non-integers, which demands the bulk of the computing power.
But Ignjatovic and Bocko have laid out the pixels to lie at the peaks of cosine waves resulting in a non-uniformly distributed array, instead of an evenly spaced one. By using this trick, the amount of computation required to compress the image is slashed by nearly five-fold. Since each pixel is positioned exactly where each cosine wave has a peak where the cosine value is "one," multiplying by one is unnecessary. With no multiplication and only a little addition, the processor uses less power.
The team members are now looking to build a prototype chip that incorporates both technologies into a single unit to see how much real-world processing power the designs will save. They plan to integrate the technology into wireless security cameras at first.
"Wireless security cameras offer the perfect proving ground for these technologies," says Bocko. "These cameras need to capture, compress, and transmit high quality images as quickly as they can without consuming precious battery power. As we develop the chips further, we'll look more into consumer cameras and cell phones to see how much battery and processing power we can save them as well."
Dec 2, 2008
Dec 2, 2008
Dec 1, 2008
Nov 25, 2008
|Fascia walkie talkie building London by ian herridge|
from Abstract Architecture
|Global Reach by cjf2|
Joey L, Dani Diamond, Brandon Woelfel and Jessica Kobeissi go head-to-head in an episode of "4 photographers shoot the same model."
The latest flagship phone from Asus combines a 12MP 1/2.55" Sony IMX362 main sensor with a smaller Sony IMX351 chip for 2x zoom and a background-blurring portrait mode.
The company behind popular photo editor Picktorial 3 just released the X-Pack: a preset package that allows you to add Fuji's in-camera film simulation profiles to your RAF files in post.
Photoshop. GoPro. Every once in a while a product emerges that defines a category. And sometimes, it vanishes just as quickly as it arrived on the scene. This week's Throwback Thursday remembers the Flip, the pocket camcorder everyone had – until they didn't.
The Nokia 8's dual-cam combines the image data from a 13MP RGB sensor and a 13 monochrome chip for better detail, improved dynamic range and lower noise levels.
The company behind retail giant B&H Photo has agreed to pay out $3.2 million in monetary relief and back wages to settle a discrimination and harassment case from 2016.
After a popular Facebook teaser and some studio portrait samples, Godox has finally officially released the Godox A1 smartphone flash and flash trigger. Cheap, versatile and innovative, color us intrigued.
Canon’s EOS 5D Mk IV has won the European Imaging and Sound Association’s Professional DSLR of the Year award, making this the third year in a row that the brand has beaten Nikon to the top spot in the professional camera category.
A photograph and quote tweeted out by former president Barack Obama has officially become the most popular tweet of all time, receiving over 1.3 million retweets and 3.4 million likes.
Edward Weston was one of the most influential photographers of the 20th century, and in this episode of Advancing Your Photography we learn the extreme technique he used to capture one of his most famous still life photos.
Instagram just released a small update that will make a huge difference if you're active on the photo sharing app: threaded comment replies.
Venus Optics has announced the price and delivery date of the second lens to join its Zero-D line up: the 15mm F2 for Sony’s E mount. A lens they've dubbed, "the world's fastest 15mm rectilinear lens for full-frame."
Cinnac is a new social network for photographers that will help you separate your good photos from your great ones through a Tinder-like community-based rating system.
The Canon EF 35mm F2 IS USM is an understated jewel of a lens, and one that we've enjoyed on a variety of cameras since its release almost five years ago. Its relatively small size and image stabilization make it a versatile tool for a variety of photography - check out our sample gallery.
You don't need a fancy studio or tons of gear to capture the kind of classic product photography you see in magazines. In this video, Dustin Dolby shows you how to do it with just a couple of speedlights and some know-how.
The life-logging camera is trying to make a comeback. Say hello to FrontRow, a live-streaming enabled life-logging camera from Ubiquiti that hangs on a necklace like a pendant.
When a prospective client approaches you, don't just say "yes" right away. Here's a useful list of questions you should be asking before you decide to take the job and name your price.
Samsung just revealed a blazing-fast new Solid State Drive capable of data transfer speeds of up to 540MB/s.
DJI has developed a 'Local Data Mode' that lets pilots fly without being connected to the Internet. The mode should calm recent fears over data privacy and security when flying DJI drones.
After 1.7 million downloads on Apple computers since the launch in November 2015, Aurora HDR will be available for Windows PCs for the first time with the 2018 release.
The company behind the new Meyer Optik Goerlitz lens manufacturing business has formed a new brand to bring back the Biotar 75mm F1.5 that was made by Carl Zeiss Jena in the 1940s and 50s.
The updated Qualcomm Spectra system is a dual-camera setup that is capable of sensing depth and motion in real time.
A sizable swath of the United States will be treated to a total eclipse of the heart – er, sun – in just under a week. Here are a few excellent guides to help you photograph this rare occasion.
f11 Magazine—an ad-supported, free magazine for 'photographers and aficionados' that focused on photos rather than gear—is suspending publication due to financial troubles.
The Minolta MC Rokkor-X 40-80mm F2.8 is unlike any zoom lens you've probably ever seen. Instead of a helicoid, it uses a gearbox, and because of this it's still one of the sharpest zoom lenses out there.
If you're looking to switch to Sony, the company's new limited-time "α trade up" promotion can snag you up to $500 + trade-in value towards a brand new a9, a7 II, a7R II, or a7S II when you hand over your DSLR or mirrorless camera.
The Google Camera app exclusive to the company's own Pixel phone has been unofficially ported to other Android devices. If you're willing to take the risk of installing, you can now use features like HDR+ on the Galaxy S8, LG G6, OnePlus 5, and more.
49-year-old David Hilos is known by the Singapore photography community as the 'camera whisperer.' When a service center says a camera is beyond repair, Hilos can usually coax it back to life.
Photographer Ryan Kelly captured one of the most viral and graphic images of the horrifying events in Charlottesville, VA this weekend. This is the harrowing story behind that photograph.
Data storage manufacturer Synology has added a new, lower-cost NAS to its DiskStation j line that has a maximum capacity of 40TB, and which is aimed at home users and photography enthusiasts.