Our test scene is at the core of our camera testing, designed to allow like-for-like comparisons between cameras. Here we explain how the tests are conducted and why we work this way. We will publish a video explaining what we look for in the scene and where we look, in the coming weeks.
Our studio test scene is used to give a consistent and reproducible means of comparing camera output. We have a well-established testing methodology designed to shed light on the performance differences of camera sensors and the results of their JPEG engines. All analyses are cross-checked against our real-world experiences.
To enable comparison between cameras with different pixel counts, we offer a 'Compare' mode that re-sizes all the cameras to the largest resolution shared by all the selected cameras.
Lenses and focal lengths
Interchangeable lens cameras are shot using prime lenses that offer around 85mm equivalent field-of-view – a decision that stems from our historical use of each brand's 50mm lenses on APS-C, which are generally very sharp and consistent across the frame when stopped down a little. The aim is to remove, as much as possible, the impact of the lens. Our testing has shown the use of dedicated own-brand primes to be more reliable than using multiple copies of third-party lenses.
Compact cameras are test-shot across a range of focal lengths and apertures. We then chose the focal length closest to 85mm equivalent that offers sharpness and across-frame consistency that fairly represents the lens performance as a whole. Unlike our ILC tests, any would-be buyer will be forced to use the built-in lens so we aim to include, rather than remove, the lens performance. As such, we do not cherry-pick the best performance if it's unrepresentative of the rest of the lens's performance, nor do we rigidly use the 85mm equivalent setting if it's uncharacteristically poor.
JPEG images are exposed assuming that most users will rely either on their camera's meter or on the histogram and, as such, are shot using whatever shutter speed is required to give correctly exposed middle grey values. White balance is set manually for the daylight scene, and low light is shot using the default Auto White Balance setting, to show the degree to which the camera tries to correct a very orange light source.
|Cameras are mounted securely on a macro rail on a heavily weighted-down tripod, to minimize external vibrations. Self timer and any available anti-shock modes are also employed to minimize the impact of shutter shock.|
Raw images are shot using set combinations of shutter speeds and apertures to allow the assessment of sensor performance on a equal terms (all cameras will receive the same amount of light at each ISO setting to ensure this). At higher ISOs, we reduce the illumination of the scene by up to two stops if a camera doesn't offer sufficiently fast shutter speeds to allow correct exposure. If this still isn't sufficient, we then stop down the camera's aperture, again ensuring that the net effect of illumination, shutter speed and aperture values are consistent across cameras.
These files are processed using the Adobe Camera Raw with noise reduction minimized and with shadows brightened to reveal the difference in shadow performance. All Raw images are white balanced during processing.
How can I check which settings you used?
All relevant shooting settings can be viewed by clicking the [i] icon at the lower right of each comparison window. If the [i] is illuminated in yellow, then some aspect of that particular shot is considered non-standard in such a way that it is not 100% comparable with other images. The cause of this inconsistency should be noted in the information tab if you click on the [i] icon.
We offer two lighting conditions, a 'Daylight' mode that is illuminated to 10EV using daylight-balanced Kino Flo RF55 lamps, and a low light mode lit by a 25W tungsten incandescent light bulb.
Like all processes there are sources of variation (error), including differences in chart alignment, focus and lens performance over time. While we have done everything possible to minimize the impact of these errors (including using a large, easy-to-align chart, careful manual focusing and selecting copies of lenses that are used only for studio testing), it is impossible to eliminate experimental error altogether.
Our comparison tool makes it possible to identify differences that are within the realms of well-controlled error, so we trust our readers not to read too much into very slight differences in apparent performance.
Overall, the aim of the test scene is to provide fair, consistent and comparable images across every camera that comes through our test studio. We endeavor to maintain the highest possible standards and are happy to discuss and investigate any apparent inconsistencies raised by personal message or feedback email.
Apple has updated its professional video editing app Final Cut Pro X to version 10.4.6. The update brings full 64-bit support, a new feature that helps convert older formats and much more.
Tonight's episode of NBC's Tonight Show, hosted by Jimmy Fallon, was filmed entirely on Samsung's flagship smartphone the Galaxy S10+.
Camera Bits has released the long-awaited update to its photo ingestion software in the form of Photo Mechanic 6.
SmugMug Films has shared its latest film, Streets in Mind, which takes a look at the life and work of London-based street photographer Alan Schaller.
We were in Japan earlier this month for the annual CP+ show in Yokohama, where we sat down with senior executives from several camera and lens manufacturers, among them Nikon.
Sony has released firmware version 5.0 for its flagship mirrorless camera, the a9. The update brings AI-driven autofocus modes, an improved menu structure and other updates.
Night Sight, Portrait Mode and (surprisingly) wide-angle selfie mode are features that we're currently loving about the Pixel 3's camera.
The Auschwitz Museum has asked visitors to be more respectful after an upsurge of pictures posted on social media showing people posing on the train tracks that lead to the main gate.
This week Chris and Jordan take the new Leica Q2 for a spin, and while most of us in the Northern Hemisphere are welcoming spring, they head even farther north than usual to visit ice castles. Because #Canada.
Harvard is facing a lawsuit over profiting from 19th century daguerreotypes that captured the portrait of a slave and his daughter on a South Carolina plantation.
From the detailed textures in rural landscapes to the incredible lighting inside futuristic buildings, the photorealism of Unreal Engine 4 is blurring the lines between fiction and reality...you know...aside from the spaceship.
Facebook has sent out emails to affected users requesting they change their passwords following a discovery that over 20K Facebook employees had access to 600 million passwords.
We've added Panasonic's new Lumix S1 and S1R full-frame mirrorless cameras to three of our buying guides. If you're looking for a quick summary of each model, then have a read.
YouTube channel Photoshop Cafe has shared a video detailing ten tips and tricks you can do to both fix and speed up Photoshop when it's running slow and sluggish.
It's not going to be the banger of the year, but it'll get a few laughs.
DJI has confirmed its drones won't be affected by the GPS 2019 week rollover.
Dogfish Head Craft Brewery has teamed up with Kodak to release a beer that's capable of doubling as a film developer.
The Diana Instant Square is a retro-inspired camera with manual controls that's fun to shoot in good light, but largely unpredictable in its operation.
Residents of a Paris street plagued by Instagrammers, selfie takers and music video crews are asking the city government for a weekend and evening ban to give them some peace.
The adapter plugs into the Osmo Pocket's USB Type-C port and features a 3.5mm TRS jack to plug in various external microphones.
Checkout allows Instagram users to select products for purchase and make payments directly in the app.
GauGAN as it's known, can create photorealistic images from basic drawings using the power of artificial intelligence.
The EOS RP is Canon's latest full-frame mirrorless camera, with diminutive dimensions and a diminutive price. Find out how it stacks up and get our thoughts in our early review.
Montana judge Dana L. Christensen has ruled the Republican National Committee did not infringe upon the copyright of photographer Erika Peterman after they took a photo from a Democratic candidate's Facebook page without permission and altered it to use in a derogatory promotional mailer.
Nikon has launched updates for three of its programs to address various bugs and glitches that could cause crashes and unwanted results.
LEE Filters has launched the LEE100, its next-generation filter holder that improves the design and looks in all the right places.
With the arrival of some much-needed sunshine and final production firmware for the Panasonic S1, we've been able to get outside and really start putting the camera through its paces.
Importing, culling and tagging photos is about to get a whole lot faster and look a whole lot better with the impending arrival of Photo Mechanic 6.
On its own, the FTZ adapter retails for $250 and when bundled it dropped the cost to just $150. Now, Nikon is offering it for free with all Z6, Z7 purchases in the United States.
Profoto said it spoke with Godox back at Photokina 2018 and continues to contact Godox in an effort to stop it from marketing its V1 light.