Google's Night Sight allows for photography in near darkness
Google's latest Pixel 3 smartphone generation comes with the company's new Night Sight feature that allows for the capture of well-exposed and clean images in near darkness, without using a tripod or flash. Today Google published a post on its Research Blog, explaining in detail the computational photography and machine learning techniques used by the feature and describing the challenges the development team had to overcome in order to capture the desired image results.
Night Sight builds on Google's multi-frame-merging HDR+ mode that was first introduced in 2014, but takes things a few steps further, merging a larger number of frames and aiming to improve image quality in extremely low light levels between 3 lux and 0.3 lux.
One key difference between HDR+ and Night Sight are longer exposure times for individual frames, allowing for lower noise levels. HDR+ uses short exposures to provide a minimum frame rate in the viewfinder image and instant image capture using zero-shutter-lag technology. Night Sight waits until after you press the shutter button before capturing images which means users need to hold still for a short time after pressing the shutter but achieve much cleaner images.
The longer per-frame exposure times could also result in motion blur caused by handshake or moving objects in the scene. This problem is solved by measuring motion in a scene and setting an exposure time that minimizes blur. Exposure times also vary based on a number of other factors, including whether the camera features OIS and the device motion detected by the gyroscope. In addition to varying per-frame exposure, Night Sight also varies the number of frames that are captured and merged, 6 if the phone is on a tripod and up to 15 if it is handheld.
An interesting problem with very dim scenes is how to properly white balance them, given the often dim or strongly colored light sources present in dark scenes. To solve this, Google took a learning-based approach to white balance, training their AWB algorithm to discriminate between poor and well-white balanced images. They did this by hand-correcting images from the Pixel 3 camera using its traditional AWB and using these corrected images to train the algorithm to suggest appropriate color shifts to achieve a more neutral output. The results are impressive (see below).
|Google's learning-based white balance approach yields pleasing colors in this nighttime cityscape, more pleasing than this same shot taken without Night Sight. Photo: Rishi Sanyal|
Frame alignment and merging are additional challenges that you can read all about in detail on the Google Research Blog. Of particular importance: Night Sight feeds the 15 frames into its 'Super Res' pipeline, which means you won't just get low noise images, you'll also get far more detail thanks to the ability to resolve inter-pixel detail and forego demosaicing altogether (which also means far less aliasing and moiré). Not just in nighttime shots but even in the daytime, if you enable Night Sight.
Our science editor Rishi Sanyal also had a closer look at Night Sight and the Pixel 3's other computational imaging features in this article.
|Intrepid View-072500 by vbuhay|
|Jazz Hands_ by Imagemi|
from Musical instruments
|Fire Urchin by sgitlin|
from Ricoh Challenge
The adapter plugs into the Osmo Pocket's USB Type-C port and features a 3.5mm TRS jack to plug in various external microphones.
Checkout allows Instagram users to select products for purchase and make payments directly in the app.
GauGAN as it's known, can create photorealistic images from basic drawings using the power of artificial intelligence.
The EOS RP is Canon's latest full-frame mirrorless camera, with diminutive dimensions and a diminutive price. Find out how it stacks up and get our thoughts in our early review.
Montana judge Dana L. Christensen has ruled the Republican National Committee did not infringe upon the copyright of photographer Erika Peterman after they took a photo from a Democratic candidate's Facebook page without permission and altered it to use in a derogatory promotional mailer.
Nikon has launched updates for three of its programs to address various bugs and glitches that could cause crashes and unwanted results.
LEE Filters has launched the LEE100, its next-generation filter holder that improves the design and looks in all the right places.
With the arrival of some much-needed sunshine and final production firmware for the Panasonic S1, we've been able to get outside and really start putting the camera through its paces.
Importing, culling and tagging photos is about to get a whole lot faster and look a whole lot better with the impending arrival of Photo Mechanic 6.
On its own, the FTZ adapter retails for $250 and when bundled it dropped the cost to just $150. Now, Nikon is offering it for free with all Z6, Z7 purchases in the United States.
Profoto said it spoke with Godox back at Photokina 2018 and continues to contact Godox in an effort to stop it from marketing its V1 light.
Product renders in Italian publication Notebook Italia show an unusual design that conceals all cameras with the help of a slider mechanism.
Canon says its new EF 400mm F2.8L IS III and EF 600mm F4L IS III lenses can suffer from an intermittent flickering when shooting video in M or Av modes with certain cameras.
Leica recently announced the Q2, a digital rangefinder with a fixed 28mm F1.7 lens. It's a heck of a lot of fun to shoot with, but is it right for you? Based on our time with the camera, and its specifications, we've examined how well-suited it is for common photography use-cases.
Now that our Panasonic Lumix S1R has final firmware, we couldn't wait to get out shooting with it - and we also tried the high-res mode, which combines files to get 187 megapixel images. Because sometimes, 47 megapixels just isn't enough.
In this article, travel and landscape photographer Mitch Green encourages us to spend more time in the the field.
the lens lacks any electronics whatsoever and is constructed entirely of glass and metal. Of course, that comes at the expense of weight — this thing weighs in at 1.1kg / 2.43lbs.
Drones can be useful tools in urban areas, where they're utilized for everything from news reporting to building inspections, but flying in these areas requires careful preparation. Here's what you need to know to do so safely.
Hasselblad has released a new cable release and USB double battery charger for its X1D medium format camera .
After a report published by NBC News, Flickr has taken heat for allegedly letting IBM 'scrape' photos for use in its facial recognition datasets. But the problem isn't what it seems on the surface.
Samyang has announced the impending arrival of the AF 85mm F1.4 FE lens for full-frame Sony cameras.
Some Photoshop shortcuts are simple and obvious. Others, not so much. Here are 15 shortcuts that are actually useful.
Twitter has redesigned its in-app camera for easier access from the timeline screen.
Independent cinema lens manufacturer SLR Magic has announced it will offer all of its existing MicroPrime range in the Fujifilm X mount and has even created a Fuji-specific 12mm lens.
We've updated our buying guides with three more cameras: the Canon EOS RP, Nikon Z6 and Olympus E-M1X.
CFexpress 2.0 cards will come in three different form factors, each of which will offer different maximum speeds.
Lensbaby has added a third tilt lens to its Optic Swap system, this time a 35mm lens, adding to the existing 50mm and 80mm options.
Sigma has released firmware updates for a number of its lenses as well as its EF-E adapter to address various errors and features with Canon, Nikon and Sony cameras.
We've added the Fujifilm X-T30 and Sony a6400 to our 'Best Cameras under $1000' buying guide. These two mirrorless models pack in a lot of features for just $900 body only.
Instagram, Facebook and other Facebook-owned services are down for users around the world.