What's that noise? Part one: Shedding some light on the sources of noise
How would you react if I told you that the aperture and shutter speed you choose make more difference to image noise than the ISO setting? You might be surprised to discover that a lot of the noise in your images doesn't come from your camera at all: it comes from the light you're capturing.
To really understand what's going on in your camera and, hence, how to get the best results out of it, it helps to understand a little bit about where noise comes from. Noise is widely misunderstood and yet it lies at the heart of most technical assessments of image quality and camera capability.
In simple terms, noise is any variation from the true 'signal' that you're trying to capture. Visually it's immediately recognizable as pixels of unexpected brightness or color, most easily seen in areas where you might otherwise expect a smooth result. The first thing to realize is that there are several mechanisms that contribute towards noise and that all of them can play a different role, even within a single image.
In this multi-part article, we're going to look at two major sources of noise: shot noise and electronic noise, and what they mean for the way you shoot. And because this first source of noise is so significant, we're not going to talk about electronic noise at all in this first part. By the end of both parts you should understand where noise comes from, where the strengths of your camera lie, and hence how to get the best out of it (and when it's likely to let you down).
Probably the most significant and certainly least recognized source of noise is what we call 'shot noise' or 'photon shot noise'. In the simplest terms, this is you being able to see the impact of light's inherent randomness.
You might remember talk of photons from science classes, and the key thing to remember is that, although we perceive light as being pretty uniform, it actually travels as a series of packets. That is: light is quantized. These packets (photons) arrive at your eye or your camera sensor at random intervals. Because of the way the eye and the brain work, you don't notice this, but when you look at a scene, you're being bombarded by little packets of randomly occurring light from every part of that scene.
'So what?' you might say. Well, let's try a little thought experiment. Rain is also a series of discrete packets, that fall randomly over time, so it makes a fairly robust metaphor for the way light behaves. So let's see what happens if we imagine trying to measure rain, using a series of test tubes.
Stand outside in the rain, with your group of test tubes covered with a plastic card. Remove the card for a fraction of a second, then quickly put it back over the tubes. You probably wouldn't be at all surprised to find no raindrops in one tube, two in another and one in the other two tubes because, just like light, raindrops occur randomly. Try the experiment again and leave the tubes exposed for a longer period of time: now you'll find all your test tubes are nearly full. If you tried measuring in detail, you might find that you had 420 drops in one tube, 380 in another and 400 in the other two tubes, but generally, you'd probably look at them and conclude they're all pretty much the same.*1
|Short exposure||Long exposure|
This randomness, even though it's raining similarly hard over all the test tubes, is noise: it's variation from the underlying signal.
An important thing to know is that, although the absolute differences in raindrops collected are larger for the longer exposure (it's a difference of 20 raindrops!), it only accounts for a small proportion of the total number (+/- 5%). With the very short exposure to the rain, the differences were only +/- 1 raindrop between test tubes, but proportionately it made a huge difference (+/- 100%). Or, to use the correct terminology, the signal you captured in the short exposure was small, relative to the amount of noise you experienced: you had much lower signal-to-noise ratio.
This is exactly how shot noise contributes to your photographs. A darker exposure gives you less chance to catch photons, so you're more likely to be able to see the random nature of them hitting your pixels. And this doesn't just apply to bright or dark exposures, it also applies to bright and dark areas within the same image. Bright parts of the image are made up from more photons hitting them during the exposure, so it's harder to perceive any variance between neighboring pixels whereas, in the darker parts of the image, fewer photons hit your sensor, so you're more likely to be able to see the underlying randomness.
The important thing to realize is that this type of noise is present whenever you try to capture light. Whether you use film or digital, medium format or a smartphone, all of the light you're capturing has shot noise built into it. And the solution is always the same: the more light you are able to capture, the less you'll be able to see that noise.
The effect of exposure on noise
Understanding the sources and effects of noise in your final image requires a good understanding of the process of capturing light and the steps it passes through on the way to your final image. The diagrams below show an image of a scene you might want to photograph, with the stripe just below the image showing the scene brightness. The light blue dots within this stripe represent the shot noise that you might experience: there are fewer of them at the dark end of the wedge, but they're more visible.
A key thing to note is that: once captured, the signal-to-noise ratio of any tone can't be improved upon.*2 It can get worse as electronic noise is added, but if you try boosting or pushing the signal, you end up boosting the noise by the same amount and the ratio stays the same. This is why your initial exposure is so important.
The diagram then shows how the exposure you choose maps the brightness of the scene to tones captured by your sensor. Because the image at the top of the diagram represents the scene, its brightness doesn't change even the exposure is changed:
This information captured by the sensor then passes through an amplifier before being converted to digital values and written into the Raw file (in this case we're showing base ISO with minimal amplification, so the brightest tone from the sensor is being mapped to roughly the highest value in the Raw file):
Then, finally, a tone curve is applied, to map this Raw data into a final image. This can be a standard tone curve applied by your camera's JPEG engine or the result of manual Raw conversion and the adjustments made in processing software.
We'll add the contribution from electronic noise in the next article. For now, though, let's look at how noise is affected by exposure:
|Initial Exposure, showing how the highlights, midtones and shadows in the scene are mapped all the way through to the JPEG.
||-1EV Exposure. The camera now captures its highlight, midtone and shadows from brighter parts of the scene.
First, let's look at what happens when you, without making any other changes. The darker exposure captures extra highlight information and you collect each output tone from a brighter point in the scene. Shot noise remains the same if you look at any given brightness level in the final image...
...however, since you captured less light,And, because each part of the scene is made up from less signal, it will have a worse signal-to-noise ratio and so will appear noisier.
This becomes apparent if you try increasing the ISO to match the original image brightness using this reduced exposure...
Combine this reduced exposure with increased ISO sensitivity (so that we get the same final image brightness) and the following happens:
||1EV ISO increase
Just as in the example above, the reduced exposure means any point in the scene appears darker on the sensor (you've captured less signal at every point in the scene). However, the camera is then applying additional amplification to make up for this, pulling the brightness back up again. And, as mentioned earlier, these amplified tones maintain their signal-to-noise ratios, which we've already seen are lower, compared to our original exposure. This result should be immediately familiar: turn the ISO up on your camera and you get the same image brightness from less exposure but at the cost of noisier images. Electronic noise can play a role in this, but the key lesson from this article is that a lot of the noise you see isn't coming from your sensor or your camera: it's inherent in the randomness of the light you captured and it's primarily dependent on the exposure you chose.
Take a look atand it explains a lot of why your high-ISO images are noisy: most of your image is being made up from the shadow regions of your Raw file (that was captured with poor signal-to-noise ratios), amplified to be brighter.
Another interesting thing to note is that, at least initially,. However, increasing the amplification meant they no longer fit in the Raw file, so they 'clipped' to white. This is also why higher ISO images have increasingly little dynamic range: you're amplifying-away a large chunk of the information your sensor captured. This will become relevant when we discuss some camera's dynamic range modes and when we discuss our ISO Invariance test, in the next article.
The effect of sensor size
There are three factors that affect how much light is available for your sensor to capture: your shutter speed, f-number and the size of your sensor.
As we showed in our equivalence article, a full frame camera shot at 85mm F5.6 and a Four Thirds camera at 42.5mm F2.8 will have the same angle of view and the same aperture size (15.2mm diameter) and hence will be exposed to the same amount of light if exposed for the same amount of time. Or, put another way, at the same f-number (both cameras set to F2.8), the full frame camera will see four times as much light as a camera with a Four Thirds sensor, since it is exposed to the same light-per-unit-area but has a sensor with four times the area.
As a result, when you shoot two different sized sensors with the same shutter speed, f-number and ISO, the camera with the smaller sensor has to produce the same final image brightness (which the ISO standard demands) from less total light. And, since we've established that capturing more light improves your signal-to-noise ratio, this means every output tone from the larger sensor will have a better signal-to-noise ratio, so will look cleaner. Click here if you want to see an example.
On a bright day, you're unlikely to notice any significant difference in the highlights and midtones since, even on very small sensors, you're usually capturing enough light to give a good signal-to-noise ratio such that the noise isn't particularly visible. However, in shadow regions, which are made up of less and less signal and, therefore, lower and lower signal-to-noise ratio, the differences will become apparent. And in lower light, an increasing part of the image will be made from tones captured with low signal-to-noise ratios and the noise will start to become obvious. This is the reason smaller sensor cameras tend to produce noisier images.
In turn, this is why we talk about different sensor sizes representing an image quality/size/price balance: because, so long as the sensor's electronic performance is similar, the effect of shot noise means that sensor size is the major determinant of image quality. Yes, pixel count can make some difference, but shot noise tends to play a much bigger role, if you compare images at the same output size.
How does this affect my photography? Exposing to the right
Whatever your sensor size, the most effective way of achieving the best results is to 'expose to the right.' It's a phrase you may have seen used, either in full or as the abbreviation ETTR. In the most simple terms, it means using the brightest exposure you can possibly get away with, without information you care about clipping to white (at which point it's impossible to recover with any color accuracy). The name comes from the appearance of the camera's histogram (the graph showing the distribution of image brightness in the image), where the right-hand side represents bright tones: you're trying to expose so your image data is as far to the right as possible without too much clipping.
This technique only really works with Raw files, since you're setting your exposure based on the brightest point in the scene, not on whether anything in the image is the 'correct' brightness. This means that you'll have to process the Raw file afterwards to adjust the image brightness the way you want it.
The other downside is that, because your camera's exposure meter and exposure guides are all based around putting scene midtones at the correct JPEG brightness level, they're not as helpful as they could be for assessing when you your Raw file has been correctly exposed to the right.
However, the benefit of this approach is that you get your sensor to capture as much light as possible without important tones clipping. This ensures that every tone you want to capture in the scene is made up of as much signal, and the least amount of shot noise contribution, as possible, and hence has the best possible signal-to-noise-ratio. This will get you the best possible noise performance and the most flexible Raw file.*3
Of course there will be situations in which there isn't enough light to expose all the way to the right (or your subject is moving so fast that you need a really fast shutter speed). In this situation you have two choices: to raise the amplification or to under-expose a lower ISO and push the Raw file later. The option you choose should depend on the specific behavior of your camera's sensor, and that's something we'll look at in more detail in part 2.
*1: The figures we've used in this example are deliberate: shot noise contributes a variation of +/- the square root of the signal. [Jump back to text]
*2: Technically speaking, you can improve the signal-to-noise ratio with noise reduction, which attempts to remove noise while preserving the signal. However, this typically comes at the cost of detail retention. [Jump back to text]
*3: There's a misconception that you ETTR so as to make use of 'more available levels' at the higher end of the Raw file, since the greater number of levels there should record finer tonal transitions. The reality, though, is that shot noise dithers these finer transition, so all those 'extra bits' at the upper end of the Raw file go towards just more finely representing noise. Some of the smarter Raw compression systems take advantage of this principle to more efficiently encode a wide dynamic range into a lower bit-depth Raw file in a visually lossless manner.
Acknowledgements: Thanks to Rishi Sanyal for the extensive input into this article and the many discussions it builds upon, and to Simon Joinson for prettifying the tone flow diagrams.
Oct 16, 2017
Oct 11, 2017
Sep 25, 2017
Sep 8, 2017
|Hook Head Lighthouse by kroker|
from Best Photo of the Week
|Green turtle in the shallows by gcachon|
Canon went and put an APS-C sensor in a G series compact. The result is a mighty tempting camera for travel.
Google Photos is adding a few pet-friendly features that will make it easier to find photos of your favorite pooch. Now, you can organize your pet photos by facial recognition, and you can even search your library by breed.
Colorful tripod maker MeFOTO has launched a new tripod... and a whole new brand name. Meet the GlobeTrotter travel video tripod, the first product to be released under the MeVIDEO brand.
If you own a Moto Z, you'll soon be able to attach a Polaroid instant printer to it. Check out the unreleased Moto Mod, which was leaked earlier today.
DJI has developed a technology called AeroScope that allows law enforcement to identify and track airborne drones that are breaking UAV regulations, while simultaneously addressing privacy concerns.
The Nikon D850 is a 45.7MP full-frame DSLR with an autofocus system lifted wholesale from the pro-sports focused D5. 4K capture, continuous shooting at 7 or 9 frames per second make it sound like the ultimate all rounder. Is it all that these specs suggest?
The Mate 10's Kirin 970 chipset with integrated AI processing allows for object recognition, motion detection and automatic scene selection in the camera app.
DxO has announced version 3.0 of the iOS app for its 'One' connected camera. It adds support for multi-camera Facebook Live broadcasting and both time-lapse still and video capture. Android users will be pleased to hear that a One for their platform is on the way, as well. Several new accessories are available, including a battery pack.
Canon has introduced the PowerShot G1 X Mark III, which borrows the 24MP APS-C sensor and Dual Pixel AF system from the company's recent mirrorless and DSLR cameras, adds a 24-72mm equiv., F2.8-5.6 lens and puts them into a lightweight body – but it'll cost you quite a bit.
It's not often that we see a genuinely interesting compact camera, and the Canon PowerShot G1 X Mark III is one such beast. We've pulled out the top features of the camera and tell you why they matter – and put the Mark III up against the competition.
Apple's HDR effect in the iPhone 8 Plus is on by default and more aggressive than in previous generations. It's also good enough to convince DPR contributor Jeff Carlson to leave it on all the time.
Canon's 28mm F2.8 IS USM may be small in size, but it's big on fun. We wrote about our experience using it as our only lens in Big Sur, California, but in case you missed out on our full gallery, take a look to see what this little lens can do.
Travel photographer Elia Locardi tells the story behind this gorgeous (and rare) panorama of the Dubai cityscape draped in fog.
Bison, drift cars, horseback riders, antelope – from the beach to the race track, the Sony 100-400mm G Master is one versatile piece of kit.
"Wildlife photography in Yellowstone National Park is an incredible opportunity, yet some bad photographers are giving all photographers a bad name by not following the rules."
Casio's bionic-looking new action camera, the GZE-1, is built with extreme sports in mind. The little camera is drop-proof, freeze-proof, dust-proof, and waterproof to 50 meters.
Yashica recently released the digiFilm Y35: a camera that tries to simulate the "experience" of shooting film... and it's just the worst.
Western Digital has revealed some interesting new technology that, it claims, will allow them to develop 40TB hard drives by the year 2025.
Photographer Micael Widell wanted to see just how affordable it could possibly be to get into digital photography—so he bought a full DSLR kit with battery grip and 50mm lens on eBay for just $80.
Confused about DxOMark's scoring system? This straightforward video by Marques Brownlee breaks down how DxO gets its scores, and why you should always look beyond that "overall" number.
It's not exactly a revolutionary device, but the iPhone 8 Plus does promise some evolutionary updates in the camera department. DPR contributor Jeff Carlson has been putting the 8 Plus to the test in some everyday shooting situations – take a look at how it fared.
This week in Hollywood, DJI introduced its new Zenmuse X7 camera, a Super 35 format cinema camera of its own design that can also capture 24MP still images in APS-C format. Is it time to start thinking of DJI as a camera company?
Landscape and astrophotographer Asif Islam shot a series of timelapses starting in Los Angeles and getting farther and farther away, showing how the Milky Way emerges as the light pollution fades.
Ultraviolet photography is something that relatively few photographers explore, but it’s a fascinating realm to explore with less of an investment in equipment than most people think.
After almost fifteen years of nearly buying one, Barney recently found a working Canon PowerShot G5 in his local thrift shop. It must be Throwback Thursday.
DJI has launched the Zenmuse X7, a Raw video capable Super 35 camera module. The camera/gimbal system which mounts to the company's drones features a new, proprietary lens mount.
Windowed is a free app that lets you upload photos to Instagram straight from your Mac or PC—no tablet, smartphone, or complicated workaround required.
Nikon has published a list lenses that it deems worthy of its newest DSLR: the 45.7MP Nikon D850.
The Nikon D850 isn't the first camera to hit triple digits on DxOMark; in fact, the Pentax 645Z was listed at 101 all the way back in 2015. So why was the full review never published? DxOMark explained earlier today.
Due to 'slower-than-expected development of the VR market,' Nokia has decided to pull the plug on its $25K Ozo VR camera while it restructures the company and sheds as many as 310 jobs.