Previous news story    Next news story

Sony redesigns back-lit CMOS for improved smartphone cameras

By dpreview staff on Jan 23, 2012 at 23:59 GMT

Sony has developed CMOS designs to offer improved performance on small sensors and is planning three such sensors for smartphones and similar devices. The 'Stacked CMOS' design builds on the backlit CMOS idea by building the light-sensitive photo element on top of the processing circuitry, rather than combining them in a single layer. This creates a greater light-sensitive area while also making more space for processing circuitry. The company has also demonstrated two feaures that use the extra circuitry space of the design.

The first of these features is what Sony is calling RGBW Coding, which appears to be another attempt at including clear (white) pixels in the sensor's color filter array. Sony has already used the idea to create brighter LCD panels and Kodak had previously promoted it for use in sensors (though we don't remember seeing it used).

The concept is to have some photosites featuring no color filter in front of them, so that they are exposed to more light (and therefore are less prone to noise), but lose the ability to distinguish between colors. This promises to improve low light performance but at the theoretical cost of some color resolution.

The HDR Video feature, meanwhile, attempts to boost dynamic range during video capture. Details from Sony are limited, beyond saying that the sensor works by 'setting two different exposure conditions within a single screen shooting' and then processing the different regions accordingly. We have requested more information.

Examples of an 8MP, 1/4" type sensor without either RGBW Coding or HDR video will become available from March 2012 with a larger, 13MP 1/3.06" type sensor following in June and a 8MP 1/4" sensor with both features arriving in August.

Jump to:

CMOS Technology Press release

Sony Develops Next-generation Back-Illuminated CMOS Image Sensor which Embodies the Continuous Evolution of the Camera

Tokyo, Japan - January 23, 2012 - Sony Corporation (“Sony”) today announced that it has developed a new next-generation back-illuminated CMOS image sensor which embodies the continuous evolution of the camera. This image sensor layers the pixel section containing formations of back-illuminated structure pixels onto chips containing the circuit section for signal processing, which is in place of supporting substrates for conventional back-illuminated CMOS image sensors. This structure achieves further enhancement in image quality, superior functionalities and a more compact size that will lead to enhanced camera evolution.

Hereafter, Sony will position it as the next generation back-illuminated CMOS image sensors, and unwaveringly strive to further develop this image sensor and expand its product lineup, thereby contributing to the further development of user-friendly cameras and to shooting enjoyment.

Features of stacked CMOS image sensor

  • Large-scale signal processing circuits required for higher image quality and better functionality are built-in
  • More compact image sensor chip size
  • Even higher image quality of the pixel section by adopting manufacturing processes specialized for superior image quality
  • Faster speeds and lower power consumption by adopting the leading process for the circuit section

Background of development

The popularization of smartphones and other devices in recent years has been accompanied by an increasingly diverse use of camera functionality. This has brought heightened demand for more sophisticated cameras, to ensure adaptability to a wider range of scenes and Sony developed this stacked CMOS image sensor to meet such demand. In addition to the higher pixel numbers, superior image quality and faster speeds which conventional image sensors pursued, the newly-developed image sensors further achieve more highly-advanced functionalities and a more compact size, thus paving the way for enhanced camera evolution.

As the first step towards the commercialization of its new CMOS image sensors, Sony has developed a model with built-in signal processing functionality, an element that usually requires external embedment. Samples will be shipped from March, 2012. Accordingly, models have been developed with Sony’s unique “RGBW Coding” function, which facilitates low noise, high quality image capture even in low light condition, and the proprietary “HDR (High Dynamic Range) Movie” function, which achieves brilliant color even when taking pictures against bright light.

About stacked CMOS image sensors

Conventional CMOS image sensors mount the pixel section and analog logic circuit on top of the same chip, which require numerous constraints when wishing to mount the large-scale circuits such as measures to counter the circuit scale and chip size, measures to suppress noise caused by the layout of the pixel and circuit sections, and optimizing the characteristics of pixels and circuit transistors.

Sony has succeeded in establishing a structure that layers the pixel section containing formations of back-illuminated structure pixels over the chip affixed with mounted circuits for signal processing, which is in place of supporting substrates used for conventional back-illuminated CMOS image sensors. By this stacked structure, large-scale circuits can now be mounted keeping small chip size. Furthermore, as the pixel section and circuit section are formed as independent chips, a manufacturing process can be adopted, enabling the pixel section to be specialized for higher image quality while the circuit section can be specialized for higher functionality, thus simultaneously achieving higher image quality, superior functionality and a more compact size. In addition, faster signal processing and lower power consumption can also be achieved through the use of leading process for the chip containing the circuits.


Feature press release:

Sony Develops New “RGBW Coding” and “HDR Movie” Functions

Tokyo, Japan - January 23, 2012 - Sony Corporation (“Sony”) today announced the development of two CMOS image sensor models designed for use in smartphones and other devices. They are equipped with Sony's unique “RGBW Coding” function which allows images to be captured with low noise and high picture quality even in low-light conditions. They also contain Sony's “HDR (High Dynamic Range) Movie” function which allows brilliant color to be captured even in bright settings. Sony has also developed a model with built-in signal processing functionality, an element that usually requires external embedment.

Sony has successfully developed new stacked CMOS image sensor technology that realizes higher image quality and superior functionality in a more compact size. The three newly developed next-generation back-illuminated CMOS image sensor models will be the first to utilize this technology. Samples will begin to successively ship starting March 2012.

Background of development (new functions)

The recent proliferation of smartphones and other devices has increased casual shooting opportunities and there is demand for the evolution of cameras to be able to shoot in a diverse range of settings. In particular, consumers want to easily take pictures in low light conditions or those with both low and bright lights. Sony has incorporated its two newly developed models with its unique “RGBW Coding” function which enables high-sensitivity shooting even in low-light conditions and its “HDR Movie” function which can capture images or video across a broad dynamic range of low-light to bright-light conditions.

About the key functions incorporated in the new CMOS image sensors

1. Sony's unique “RGBW Coding” function enabling clear shooting in dark rooms or at night

The built-in “RGBW Coding” function which adds W (White) pixels to the conventional range of RGB (Red-Green-Blue) pixels has realized higher sensitivity, enabling high-quality shooting with low noise even in dark indoor or night settings.

While the addition of W (White) pixels improves sensitivity, it has the problem of degrading image quality. However, Sony's own device technology and signal processing realizes superior sensitivity without hurting image quality. Furthermore, while the individual pixels of the newly developed models are extremely minute at 1.12μm, the incorporation of the “RBGW Coding” function has realized a SN ratio (signal-to-noise ratio) equivalent to that of a unit pixel size of 1.4μm under conventional methods, which in turn has enables the image sensors to achieve a higher resolution at a more compact size.

The new models are also able to output signals through the conventional RGB method, thus there is no need to change the signal processing adopted in existing devices.

2. “HDR (High Dynamic Range) Movie” function which enables brilliant colors to be captured even in bright settings

The built-in “HDR Movie” function enables brilliant colors to be captured even in settings with a wide range of light including bright light.

Typically, when shooting with differing light levels, such as an indoor setting against a bright outdoor background, there can easily be blocked up shadows for dark areas or blown out highlights for bright areas. Such phenomena are a result of the combination of low-light and bright-light which have different optimal exposure conditions in the same shot. This function reduces this by setting two different exposure conditions within a single screen shooting and conducts the appropriate signal processing for the captured image information under each optimal exposure condition. This process generates an image with a broad dynamic range and enables shooting of both the background and subject matter with brilliant colors even in a bright environment.

Upcoming product launches (plan)

  • Type 1/4 Stacked CMOS Image Sensor with approx. 8.0 effective megapixels
    (equipped with camera signal processing function*1)
    Sample shipments planned for March, 2012
  • Type 1/3.06 Stacked CMOS Image Sensor with approx. 13.0 effective megapixels
    (equipped with “RGBW Coding” and “HDR Movie” functions)
    Sample shipments planned for June, 2012
  • Type 1/4 Stacked CMOS Image Sensor with approx. 8.0 effective megapixels
    (equipped with “RGBW Coding” and “HDR Movie” functions)
    Sample shipments planned for August, 2012

*1 Not equipped with “RGBW Coding” or “HDR Movie” functions

Comments

Total comments: 15
Charrick
By Charrick (Jun 23, 2012)

Our rods and cones make our eyes RGBW...although they aren't back-illuminated.

0 upvotes
Lan
By Lan (Jan 26, 2012)

The Kodak RGBW filter array did appear in at least one shipped product; the Motorola ZN5 cameraphone. Which I happen to have.

The ZN5 was formed out of a co-operation between Kodak and Motorola using a 5MP RGBW Kodak sensor with what they called a Clearview CFA (i.e. RGBW).

At the time it was probably the best cameraphone on the market, but that was a while ago now!

A few shots from it can be found in my gallery:
http://www.dpreview.com/galleries/7552041385/albums/cameraphone-motorola-zn5

Comment edited 3 times, last edit 3 minutes after posting
0 upvotes
Cy Cheze
By Cy Cheze (Jan 25, 2012)

Does this mean that cameras that feature the new sensors may not appear until third quarter, 2012, or perhaps not until later? Will it be another year before hands-on reviews corroborate the actual performance?

Does it apply to 1/2.3" sensors typical of P&S, or only to 1/3.5" or smaller ones used in phones or tiny devices?

Would the new sensors, whatever their size, beat the results from Sony's existing back-lit 1/2.3" sensors?

Is the technology irrelevant to larger sensors?

0 upvotes
bushi
By bushi (Jan 24, 2012)

...I remember a while ago, when I was arguing with the supporters of the "more megapixels=better" school, I have been told, that all my arguments regarding the total size of the photosensitive area of the sensor shrinking, when increasing MP count (assuming the same technology) are negligible, because of a... and a..., and whatever else.

Funnny to see, how all my concerns are being CONSTANTLY addressed in the next generations of sensors :)

I wonder when they get back to sanity, and start offering us consumers cameras, in 5-10MP range max, and start addressing some REALLY interesting and valuable developments - like the above, and maybe the auto color balance, or instant AF, or zero-lag shutters, or zero-lag startup time, or fast processing, or...

2 upvotes
migus
By migus (Jan 24, 2012)

1/4 sensor has 3.6x2.7mm: 13Mpix is BIG, and likely noisy (1.12um pix pitch) despite RGBW coding...
Sony, pls. think uploading 13Mpix files over 3G networks at current/future Bw prices. Or displaying them, when 99% of the monitors, tablets and TVs still struggle in the 1-2Mpix range. Printing your phone pics larger than postcards? Ask your local printer service what's the size of 99.99% of their print orders...

What's the sweetspot resolution for phonecam sensors (considering area, power, noise, and essentially, optical issues)? Probably 3-5Mpix. So please curb the Mpix race, while improving DR, noise and optics.

6 upvotes
zodiacfml
By zodiacfml (Jan 24, 2012)

Additionally, everyone would want faster shutter speeds against blurry pics especially at social gatherings or capturing kids. I can't believe the MP race is still alive.

4 upvotes
jmaxx30
By jmaxx30 (Jan 24, 2012)

I'm of the same opinion. At this point 12 mp is about my limit on a DSLR/point and shoot. 8 mp seems to be a good compromise on cell phones; i.e., the iPHone 4s. Anything bigger and "moving" and storing those files is too cumberson.

I would much prefer they stop worrying about resoution, and start worrying about image quality and light sensing ability at the photosite level.

1 upvote
Sprexumn
By Sprexumn (Jan 27, 2012)

It's amazing how many iterations of the technology are required to approach 100% interstitial coverage. And then once we get to 100% what's next? Aren't we reaching the quantum level limits of these sensors yet?

0 upvotes
MadsR
By MadsR (Jan 24, 2012)

I really hope they put this to good use... And by good use I don't consider putting a 500 fantazillion giggy pixel sensor in my mobile phone, to take extra detailed pictures of the inside of my pocket while walking...

I would rather see this in large scale to have a 15-16MP ultra clear noiseless image from a camera...

Knowing Sony however, I think we will see 20mp mobile phone cameras in the near future...

4 upvotes
tkpenalty
By tkpenalty (Jan 24, 2012)

i hope thats not an excuse to jack up the pixel count. The cameras are so far beyond the diffraction limit its not funny....

5 upvotes
slncezgsi
By slncezgsi (Jan 24, 2012)

Completely agree. Who actually prints 16x20" from a smartphone? It would be so great to just get 3-6 Mpix that look decent on a 21" monitor - most users don't even go that far. Oh well.

2 upvotes
bushi
By bushi (Jan 24, 2012)

...of course it is being used precisely for that - see the sensor sizes from the article above? 1/4" @8MP, 1/3" @13MP...

Pixel sizes - beyond ridiculous... But they will be able to crank more sensors from the same silicon wafer, and market them at the quoted resolutions.

1 upvote
GURL
By GURL (Jan 24, 2012)

At first, when very expensive cameras with less than 1 MP were the rule, this was a useful race .

Now this is a race nobody can leave without offering two versions of the same camera, for example one with 6 MP and the other one with12 MP (same price, same body, same lens, same processor.)

1 upvote
jmaxx30
By jmaxx30 (Jan 24, 2012)

Agreed. My 8 year old Nikon D50 with a 6 mp sensor takes as good if not better pictures than a bunch of these 14 and 16 mp beasts that are out now. I don't care about pixel count I want seriously good pictures from an 8 to 10 mp sensor.

1 upvote
spoorthy
By spoorthy (Jan 26, 2012)

naw, these newer 16mp slr's ar MUCH better than the d50. But imagine how much better they woudl be if they 8mp

1 upvote
Total comments: 15