Two professors at the University of Rochester in New York have designed a prototype CMOS chip that uses a fraction of the energy used today, captures better images and can run for years on a single battery. Mark Bocko, professor of electrical and computer engineering and assistant professor Zeljko Ignjatovic, are also working to incorporate further technology that will compress the image with far fewer computations than current compression techniques. It's likely that the technology will be tested first in wireless security cameras, and, Bocko says, as the chips are developed further, they will look into using them in consumer cameras and cell phones.
Breakthrough chip delivers better digital pictures for less power
Tiny cameras could run for years
The next advance in cameras is becoming a reality at the University of Rochester. Imaging chips revolutionized the photography industry, and now the chips themselves are being revolutionized. A pair of newly patented technologies may soon enable power-hungry imaging chips to use just a fraction of the energy used today and capture better images to boot - all the while enabling cameras to shrink to the size of a shirt button and run for years on a single battery. Placed in a home, they could wirelessly provide images to a security company when an alarm is tripped, or even allow mapping software like Google's to zoom in to real-time images at street level. The enormous reduction in power consumption and increase in computing power can also bring cell-phone video calls closer to fruition.
The team of Mark Bocko, professor of electrical and computer engineering, and Zeljko Ignjatovic, assistant professor of electrical and computer engineering, has designed a prototype chip that can digitize an image right at each pixel, and they are working now to incorporate a second technology that will compress the image with far fewer computations than the best current compression techniques.
"These two technologies may work together or separately to greatly reduce the energy cost of capturing a digital image," says Bocko. "One is evolutionary in that it pushes current technology further. The second may prove to be revolutionary because it's an entirely new way of thinking about capturing an image in the first place."
The first technology being developed integrates an oversampling "sigma-delta" analog-to-digital converter at each pixel location in a CMOS sensor. "CMOS" is a common semiconductor fabrication process used in most chips manufactured today. Previous attempts to do this on-pixel conversion have required far too many transistors, leaving too little area to collect light. The new designs use as few as three transistors per pixel, reserving nearly half of the pixel area for light collection. First tests on the chip show that at video rates of 30 frames per second it uses just 0.88 nanowatts per pixel--50 times less than the industry's previous best. It also trounces conventional chips in dynamic range, which is the difference between the dimmest and brightest light it can record. Existing CMOS sensors can record light 1,000 times brighter than their dimmest detectable light, a dynamic range of 1:1,000, while the Rochester technology already demonstrates a dynamic range of 1:100,000.
Traditional image sensors use an array of light-sensitive diodes to detect incoming light, and transistors located at each photodiode to amplify and transmit the signal to an analog-to-digital converter located outside of the photodiode array. Other designs can convert the signal to digital at the pixel site, but require high precision transistors, which take up considerable chip space at each pixel and reduce the amount of surface area on the chip devoted to receiving light. The new design not only uses smaller transistors at each pixel, and thus can allow more light to be detected, but the transistors can be scaled down in size without diminishing the sensor performance as advances in semiconductor fabrication technologies allow the size of transistors to shrink. This means that much denser, higher-resolution chips can be developed without the prohibitive problems of the existing sensor designs. When transistors are reduced in size, they also become faster, allowing incoming light to be sampled more frequently and accurately.
What makes Bocko and Ignjatovic's method work so elegantly is its feedback design. Traditional CMOS image detectors apply a voltage to charge up a photodiode, and incoming light triggers a release of some of that charge. An amplifying transistor then checks the remaining voltage on the diode, and the diode is recharged again. Bocko and Ignjatovic's design also begins with a charged photodiode that discharges when light reaches it, but the discharge is then measured against a one/zero threshold and the resulting bit is delivered off the chip. If the result of a measurement is a one, then a packet of charge is fed back to the diode, effectively recharging it. The design also uses significantly less power than existing sensor designs, which is especially important in smaller devices like cell phones and digital cameras where battery size is restricted.
The second advance has taken many researchers by surprise. Called "Focal Plane Image Compression," Bocko and Ignjatovic have figured out a way to arrange photodiodes on an imaging chip so that compressing the resulting image demands as little as 1 percent of the computing power usually needed.
Normally, the light-detecting diodes on a chip are arranged in a regular grid--say 1,000 pixels by 1,000 pixels. A picture is snapped and each diode records the light hitting it. A computer in the camera then runs complex computations to compress the image so that instead of taking up 10 hefty megabytes, it might only take up 100 kilobytes. The common picture type "JPEG," used on the Web and on many cameras and phones, is an example of this. This compression, unfortunately, takes a tremendous amount of computing power, and hence battery power.
Ignjatovic and Bocko of the Department of Electrical and Computer Engineering, came up with a way to make the physical layout of the light-sensitive diodes simplify the computation. The normal way to perform compression includes a computation called the discrete cosine transform, which checks how much a segment of an image resembles a series of cosine waves. Both the image and the cosine waves are sampled at regular intervals and the transform requires that the image and cosine wave samples be multiplied together and added. Since the cosine wave samples can have a value anywhere between -1and +1, the computation requires multiplication by non-integers, which demands the bulk of the computing power.
But Ignjatovic and Bocko have laid out the pixels to lie at the peaks of cosine waves resulting in a non-uniformly distributed array, instead of an evenly spaced one. By using this trick, the amount of computation required to compress the image is slashed by nearly five-fold. Since each pixel is positioned exactly where each cosine wave has a peak where the cosine value is "one," multiplying by one is unnecessary. With no multiplication and only a little addition, the processor uses less power.
The team members are now looking to build a prototype chip that incorporates both technologies into a single unit to see how much real-world processing power the designs will save. They plan to integrate the technology into wireless security cameras at first.
"Wireless security cameras offer the perfect proving ground for these technologies," says Bocko. "These cameras need to capture, compress, and transmit high quality images as quickly as they can without consuming precious battery power. As we develop the chips further, we'll look more into consumer cameras and cell phones to see how much battery and processing power we can save them as well."
Dec 2, 2008
Dec 2, 2008
Dec 1, 2008
Nov 25, 2008
|I see you by Phocal|
from Animal eye reflection
|Apocalyptic Sunset by Impact Photo|
from A wheel good photo!
The announcement of a more cloud-integrated Lightroom product sees the death of the company's standalone version. This need to make payments in perpetuity (whether you choose Lightroom Classic or CC), chips away at the idea that your Lightroom library is a long-term solution, argues Richard Butler.
Like it or not, Adobe is embracing a cloud-centric, AI-rich future with the introduction of Lightroom CC. And that's a great thing, though you may not see it now, argues Rishi Sanyal.
The XPro-C 2.4GHz wireless flash trigger that Godox released for Canon users last month now has a Nikon equivalent—the aptly named XPro-N. Sony, Fujifilm and MFT versions are in the works.
In the aftermath of hurricanes Harvey, Irma and Maria, camera and lens maker Sigma is extending its standard product warranty to cover damage caused by these three natural disasters.
The F4 Plus can can capture 360° stills, videos and broadcast livestream footage at 8K resolution... that's 7680 x 3840 pixels!
Lightroom is hogging the spotlight at Adobe MAX, but Photoshop CC got some substantial improvements as well. Find out what's new in the latest version of Photoshop CC.
The aptly-named 'Nude' app automatically detects NSFW images on your iPhone, moves them to a protected vault and deletes the original files in the camera roll and on iCloud.
The Zeiss Milvus family of manual-focus full-frame lenses just gained a new member. Meet the Zeiss Milvus 24mm F1.4: a fast, rugged new lens designed primarily for landscape and architecture photography.
Lightroom has built a brand new Lightroom CC from the ground up to be faster, easier to use, and cloud-based. The application formerly known as Lightroom CC will continue to exist, and will go by "Lightroom Classic CC."
Google Research did a deep dive on the Pixel 2 smartphone's background-blurring portrait mode that uses neural networking and dual-pixel technology instead of a dual-camera setup.
With the arrival of the PowerShot G1 X III, there are now seven Canon cameras built around the 24MP Dual Pixel sensor and Digic 7 processor. We take a look at the differences and what might prompt you to choose one over the others.
Meet the HP ZBook x2. The so-called 'world's most powerful and first detachable PC workstation,' it was built with creative professionals in mind, and is being debuted at Adobe MAX.
PDN sat down with Ahmed Fakhr, director of photography at RollingStone.com, to talk about how the famed publication is adapting to the changing photo and video needs of the modern era and how he 'evaluates the skills of potential contributors.'
Kudos to Canon. Earlier today, the camera giant announced that it had produced its 90 millionth EOS camera and 130 millionth EF-series lens.
The ROV Slider is a portable, motorized slider that promises to bring 'beautiful cinematic video and time-lapse' shooting to anybody with a smartphone, GoPro or DSLR that weighs less than 5lbs.
The new Surface Book 2 laptops come with Intel's 8th generation quad-core processors and NVIDIA GeForce GTX 1050 and 1060 GPUs. In other words: they pack a serious punch.
Leica is resurrecting a portrait lens from the 1930s: the Thambar-M 1:2.2/90. This lens features just 4 lens elements, and was famous for its spherical aberration that creates extremely soft images.
Google's Visual Core is an Image Signal Processor designed to power and accelerate HDR+ processing and other imaging tasks in the new Pixel 2 devices (and beyond).
The Google Pixel's camera is among the best we've reviewed, and its successor has already been hailed as class-leading. With expectations set high, the Pixel 2 has nonetheless left a very good first impression on us as we shot some initial sample images.
Leica is one of the oldest names in photography, and has long been one of the most prestigious. Recently, we had the opportunity to visit Wetzlar, to see for ourselves how Leica's lenses are put together.
Canon went and put an APS-C sensor in a G series compact. The result is a mighty tempting camera for travel.
Google Photos is adding a few pet-friendly features that will make it easier to find photos of your favorite pooch. Now, you can organize your pet photos by facial recognition, and you can even search your library by breed.
Colorful tripod maker MeFOTO has launched a new tripod... and a whole new brand name. Meet the GlobeTrotter travel video tripod, the first product to be released under the MeVIDEO brand.
If you own a Moto Z, you'll soon be able to attach a Polaroid instant printer to it. Check out the unreleased Moto Mod, which was leaked earlier today.
DJI has developed a technology called AeroScope that allows law enforcement to identify and track airborne drones that are breaking UAV regulations, while simultaneously addressing privacy concerns.
The Nikon D850 is a 45.7MP full-frame DSLR with an autofocus system lifted wholesale from the pro-sports focused D5. 4K capture, continuous shooting at 7 or 9 frames per second make it sound like the ultimate all rounder. Is it all that these specs suggest?
The Mate 10's Kirin 970 chipset with integrated AI processing allows for object recognition, motion detection and automatic scene selection in the camera app.
DxO has announced version 3.0 of the iOS app for its 'One' connected camera. It adds support for multi-camera Facebook Live broadcasting and both time-lapse still and video capture. Android users will be pleased to hear that a One for their platform is on the way, as well. Several new accessories are available, including a battery pack.
Canon has introduced the PowerShot G1 X Mark III, which borrows the 24MP APS-C sensor and Dual Pixel AF system from the company's recent mirrorless and DSLR cameras, adds a 24-72mm equiv., F2.8-5.6 lens and puts them into a lightweight body – but it'll cost you quite a bit.
It's not often that we see a genuinely interesting compact camera, and the Canon PowerShot G1 X Mark III is one such beast. We've pulled out the top features of the camera and tell you why they matter – and put the Mark III up against the competition.