Pre-PMA 2008: Dpreview is pleased to announce the launch of a new section dedicated to testing and reviewing digital SLR lenses. Designed to offer the same class-leading testing standards as its legendary camera reviews, dpreview’s new lens reviews are the result of months of intense research, development and testing, including the development of new test charts and proprietary analysis software designed to overcome the limitations of existing systems.
Dpreview launches lens reviews
At the heart of the reviews is a unique interactive ‘widget’ has been designed to present the test results in a way that allows visitors to experiment visually with variables such as focal length and aperture and see immediately the effect such changes have on overall image quality, and to compare the performance of different lenses. The user-friendly presentation ensures that even those with limited technical knowledge of optics or digital imaging will be able to use the reviews.
The first four reviews are available to read now at www.dpreview.com/lensreviews/. Many more lenses are currently being tested and we expect this section to grow in a short time into a valuable and comprehensive resource for anyone looking to buy a lens for their digital SLR.
About the tests: in detail
The DPReview lens tests are the culmination of months of research and development by our imaging and programming team. Rather than use an off-the-shelf image analysis software package as a ‘black box’, we decided to develop our own custom test suite in-house, in accordance with our long-running philosophy of offering the best possible data to our readership. As always, we wanted the numbers to be backed up by real images, so you can view standardised samples from each lens across the full spectrum of focal lengths and apertures, and make your own assessment.
Our tests therefore have been designed from day one to describe and quantify the most important optical characteristics of any lens, specifically sharpness, chromatic aberration, distortion, and light falloff (also known as vignetting). In addition we test other key parameters, including macro performance and the effectiveness of optical image stabilization units. And last but by no means least, this is all placed in the context of the extensive amount of time we spend actually using the lens for real photography, backed up by galleries of sample photographs to help you judge its real-world performance for yourself.
How the tests are done
Our studio testing is carried out by photographing a set of sample images of our own in-house lens test charts under standardised conditions. Crucial factors such as lighting, exposure, focusing, and camera alignment are all strictly controlled, in order to ensure that our results are accurate and reproducible.
1) Sharpness/chromatic aberration
This is the most complex of the tests. Our chart is uniquely designed so it can be easily interpreted by computer, to generate numerical data, and also by our readers: for each measured data point, we also provide a checkerboard pattern so you can see how the numbers translate to real imaging performance. The MTF-50 sharpness data on the graph correlates directly with the perceived sharpness of the pattern, and the chromatic aberration data with both the colour and width of fringing. So rather than asking you to simply take our word for it that our data is correct, we allow you to check for yourself.
Shooting is very strictly controlled – the camera is aligned by laser precisely with the centre of the test chart, and the camera-chart distance kept between 2 and 4 meters to minimise any possible alignment errors and avoid introducing other subject distance related issues. To achieve this we use test charts of a range of sizes, the largest being 3 x 2 metres permanently fixed in our studio which is used for wideangle lenses. Focusing is critical, and we use live view with magnification wherever possible to ensure maximum accuracy.
We use black/white slant edge test targets across the entire frame to generate MTF and CA data, which is processed automatically by DPR-exclusive software routines. A checkerboard pattern is placed next to each test target, and 100% crops of these are automatically extracted and made available for you to view.
The data from the entire area of the frame is averaged to give the MTF and CA curves displayed on the graphs; we’ve found the lenses we have tested to date give generally symmetric data, with most variations in the extreme corners of the frame. We collect MTF data at each marked focal length on the lens’s zoom ring and each full aperture stop, plus at the maximum and minimum apertures when these do not coincide with full stops.
Results from this test are dependant upon the camera body and image processing used, which is why we explicitly identify the camera used for each review (note that real-life shooting with each lens, as reflected in the gallery pictures, use several different bodies to identify any specific issues). To provide a as level a playing field as possible between different camera platforms, all of the data is shot in RAW and processed using our standard converter, Adobe Camera Raw. Our processing workflow has been developed after consultation with Adobe, and the effects of software enhancement (sharpening etc) are as low - and as equal across brands - as they can possibly be.
Distortion data is generated by photographing our grid-array test chart, and analysed automatically using our own routines. Because distortion is effectively independant of aperture, we use F8 for each test. We report the type of distortion (barrel or pincushion) with percentages for each dimension of the frame; this is because distortion is often complex and uneven across the frame, for example from manufacturers re-correcting barrel distortion on wideangle zooms by ‘pinching’ towards the edge of the frame.
As for the MTF chart, the camera is precisely laser-aligned to minimise errors. It’s important to realise that distortion tends to be highly distance-dependant, and for some lens designs increases dramatically at closer focusing distances. Our chart is approximately 1.05 x 0.7 metres, and gives distortion figures perhaps slightly greater than when the lens is focused at infinity.
We measure light falloff by photographing an evenly-illuminated surface through a highly diffusing filter with the lens focused to infinity. We shoot at each marked focal focal length on the lens, and at 1/3 stops down to F11. The falloff patterns are then analysed, and compared to a pre-determined exposure curve for each camera body. This allows us to determine the falloff pattern in stops. For easier visualization we posterize the image in 1/3 stop increments for display; we also calculate the maximum falloff values at the extreme corners of the frame and report these.
We consider falloff below one stop to be essentially imperceptible, and certainly nothing to worry about. We therefore don’t show the first 1/3 stop on our charts at all, to simplify the display.
|Hot Air Balloons Over Bagan by User9320321874|
|Blue mood by darub|
from Fixed lens shootout.
|Yellow Warbler by LeeS|
from A Big Year - birds
|Waiting for the Parade by tcoker1103|
from - La Vida Loca - (Black and White Street Photography+ A Border)
Peak Design's 'consider every detail' approach shines in the Everyday Backpack. While expensive, it's one of the best options out there for a photographer who needs to pack a lot of stuff in addition to gear.
If you're thinking of using Canon's sports glass on the Sony a9, think again. The ultra-fast camera slows way down when you attach off-brand glass.
The Polish town of Katowice is not known as an area of beauty, but as all photographers know, that doesn't mean that beauty can't be found if you know where to look. Mariusz Pietranek used a drone to look down on the colorful sedimentation tanks at an ironworks.
New York Times video journalist Ben Solomon spent a harrowing three weeks accompanying Iraqi Major Sajjad al-Hour as he and his men fought to retake Mosul from I.S. forces.
The 3D VR camera launched through a crowdfunding campaign in 2015 goes on sale beginning June 26.
Noctilucent clouds, a crescent moon and Venus were visible in the pre-dawn sky over Budapest yesterday. Photographer György Soponyai captured NASA's astronomy picture of the day.
Squirming pets won't sit still for photos? A Kickstarter campaign is looking to help.
Find out how Chris Burkard shifted from editorial photography to his true passions: landscapes, conservation and, of course, surfing.
The updated EyeEm app scans your camera roll and picks images that are composed particularly well, have the best quality, or highest chance of selling on EyeEm Market.
It's three years old but still a solid option for a Micro Four Thirds shooter looking for a high-quality, fast, wide-angle prime. Take a look at how we got along with it.
Tamron has announced the longest all-in-one zoom lens currently available, the 18-400mm F3.5-6.3 Di II VC HLD. Designed for Canon and Nikon crop-sensor cameras, the lens will be available in July.
When you're ready to step-up to full-frame from an entry-level or midrange camera, the choices can be overwhelming. Find out which models came out on top in our $1200-2000 enthusiast ILC roundup.
Just a guy wearing a VR headset, smashing invisible Goombas in Central Park.
NASA's Mars Reconnaissance Orbiter captured this gorgeous aerial photo of the Martian landscape. And if you look really close, you can actually see the Mars Curiosity rover in the very middle.
The city of Laguna Beach, California has provided some clarification around the kinds of photography permits it offers.
Later this year, a VR180 camera will be Joining Yi's Halo and 360 VR cameras, which will offer stereo 3D capture, yet be as easy to use and compact as a 2D camera.
Caltech researchers have developed an 'optical phased array' chip that uses time delays instead of a lens to focus the incoming light.
Pricing and shipping have finally been revealed for two highly anticipated lenses from Sigma, announced in February.
These macro photos of clouds of paint billowing through clear water might look like high-quality CGI, but they're real photographs. And photographer Alberto Seveso told us how they were made.
Facebook is testing a feature that prevents people from saving, sharing, or even taking a screenshot of your profile picture.
We've reshot the Sony a9 in our studio. The short story: it's sharper! The long story... well you can read it all here.
The collection will be officially launched during the Europeana Transcribathon Campus Berlin 2017 crowdsourcing event which will be held on 22 and 23 June at the Berlin State Library.
Light gives us some insight into the preparations for the launch of the pre-order shipments of its much anticipated L16 multi-lens camera.
OnePlus co-founder Carl Pei has confirmed in a tweet that the second lens on the back of the OnePlus 5 uses a 1.6x optical zoom and that digital zoom is used to reach the claimed 2x zoom factor.
Fujifilm recently unveiled the second in its series of affordable cine lenses, the MK50-135mm T2.9. We got our hands on it for a couple days and took it for a spin.
Leica's first attempt at an M-series digital rangefinder was rough around the edges, but set a pattern for all of the cameras that came after it. In this week's Throwback Thursday article, Barney remembers the M8.
No stranger to extreme situations, legendary climber and filmmaker Jimmy Chin talks to Outside Magazine about his career, and the challenge of filming Alex Honnold's rope-free solo climb of El Capitain.
A company backed by Android co-founder Andy Rubin is attempting to make video conferencing less terrible.
Rangefinder magazine asked five professional portrait and wedding photographers about posting on Instagram; no surprise, they got five different answers.
This captivating stop motion film was created by stripping away one layer of wood at a time. It's hard to look away.