Nikon's 24-70s are substantially weaker than Canon's latest 24-70

mg428

Well-known member
Messages
184
Reaction score
21
Location
US
I know many people don't like DXO but this thread is not whether you agree with them and in particular with their sharpness score overall. (Also I know sharpness is not everything in a lens so no need to mention that too) Whether you like them or not or agree with their sharpness score or its methodology, their tests demonstrate a consistent pattern (and therefore constitute a fact for the pattern but perhaps not for the score itself) for their sharpness score, which they measure in terms of their so-called P-Mpix in the following respects:

1) As the Mpix of a sensor increases, depending on the quality of the lens, the P-Mpix of the lens increases with the combination of the lens with that sensor. E.g. the P-Mpix of 85mm 1.8G scores 20 with the 24 Mpix D600 but 22 with D800.

2) If the lens is not that good, for instance with most zooms, the P-Mpix score does not change at all. E.g. both the non-VR 24-70G and the new 24-70E VR scores the same with D600 and D800 (13 and 15, respectively)

3) In a given lens, regardless of the quality, the score also increases between the same sensors that has OLPF and not or cancelled out, as in D800 vs D800E/D810. However, if the lens is of better quality (such as the ones that falls under "1" above, the bump is more). E.g. 85mm 1.4.G's score of 20 with D800 increases to 30 with D810, whereas 24-70 and 24-70E's scores of 13 and 15 with D800 increase to 19 and 21. As you see in the case of 85mm 1.8G the bump is 10, whereas with 24-70 zooms the bump is 6 in terms of P-Mpix. (As a side note, it must be noted the difference is also dependent on how strong the AA filter is implemented. In D800, as far as I know, a rather weak AA filter has been implemented. If it were stronger, than the gap would be stronger in all combos. E.g. 85mm 1.4G might have scored 19 with D800 (instead of 20) but would still score 30 with D810, which would mean a bump of 11 instead of 10.)

So here is how Nikon's both 24-70s compare to the most recent Canon's offering:

Canon's latest 24-70 lens in combination with the 20.2 Mpix 6D and 22.3 Mpix 5D Mark III that both have an OLPF, and scores a P-Mpix of 17 and 18, respectively, which are higher that with the combo of either Nikon 24-70s with not only D600 but also D800 which shows no improvement. Whereas, as you see, even with 2.1 Mpix bump the P-mpix increased a point from 6D to 5D Mark III. Note that these Nikon and Canon sensors are from the same generation in 2012 which therefore obviates any argument that this is not a fair comparison. Also, Canon's lens score increases with 5DSR to 32 due to the higher Mpix of the sensor and cancelling out of OLPF thereof. All these indicate that Canon's latest 24-70, in my view, is a significantly better lens than even the latest 24-70E VR. Therefore, while its score with 5DS with OLPF is not currently available on DXO's website, if it were available, or if this lens could be tried on a D800, the score would have increased too, whereas both Nikon 24-70 stays the same despite the increase in Mpix of the sensor. To put in another way, both Nikon's 24-70s benefit from only the cancelling out or lack of OLPF, which is something very natural and applicable for even worst lenses (for the sake of the argument even the old generation and notoriously bad Nikon AF-S VR Zoom-Nikkor 24-120mm f/3.5-5.6G IF-ED's score increases a point with D810 compared to D600 and D800), whereas Canon's most recent 24-70 is up to par to some degree with prime lenses and therefore its sharpness increases not only with the cancelling out or lack of OLPF, but also with the increase of Mpix of the sensors, as in quality primes.

My conclusion is that Nikon's latest 24-70 VR offering, considering it was released after 3 years than that of Canon's, is a shame. While it seems Nikon tried to response Tamron's VR offering, it should have offered a lens like Canon's considering the higher resolution bodies of today and the questionable need for VR in the 24-70mm range. I think Sigma has a good opportunity here.

I would love to hear your comments on my analysis.
 
No disagreement from me; I shoot with both Canons and Nikons, and own a much-used, much-liked Nikkor 24-70/2.8G. Partly based upon some of the same information as your write-up, I very nearly just bought a Canon 24-70/2.8L II, during the January rebate period.

My 24-70/2.8L II purchase was postponed due to the fortuitous local availability of a pre-owned, like-new Zeiss 2/135 APO Sonnar ZE, that is perfectly calibrated to my 5Ds R's focusing system, enabling me to trust the focus confirmation to get sharp, in-focus images, without having to necessarily use magnified live view. I figured that it may be difficult to again find such a perfectly-compatible sample of the 2/135 in the future. (Lens test sites seem to universally praise the Zeiss 2/135 APO Sonnar, and now I have both the ZF.2 and ZE.)

It is virtually inevitable that I will add an EF 24-70/2.8L II, and unlikely that I will acquire a Nikkor 24-70/2.8E VR. Of course, feeling the competition from Nikon and Tamron, Canon may decide to release a 24-70/2.8L with Image Stabilization! :-)
 
How is a manual focus lens 'perfectly cailbrated' to your camera? How would it not be?
 
I have just one question: what is the point of this analysis? I read through the whole thing and while interesting I don't see what you're trying to get at. It's not like you're going to get Nikon to do another new 24-70 to suit your requirements.

My overall impression of Nikon's lens design philosophy is that they prioritize overall pleasing rendering and real world practicality over absolute performance. Canon tends to go the other direction and design for max performance first. All you have to do is decide which approach you prefer, and go with that brand. Job done.
 
I have just one question: what is the point of this analysis? I read through the whole thing and while interesting I don't see what you're trying to get at. It's not like you're going to get Nikon to do another new 24-70 to suit your requirements.

(Snipped)
Good point; Nikon is not going to recall its 24-70/E lenses, and then release a slightly sharper version.

Notably, for anyone considering switching to Canon to get a better 24-70/2.8 lens, the 24-70/2.9L II is a bit weak in the 50-70mm range, which is somewhat the inverse of the pre-II 24-70/2.8L, which was weaker at the wider end of the range, as I remember. Nothing in this world is perfect!
 
I have just one question: what is the point of this analysis? I read through the whole thing and while interesting I don't see what you're trying to get at. It's not like you're going to get Nikon to do another new 24-70 to suit your requirements.

My overall impression of Nikon's lens design philosophy is that they prioritize overall pleasing rendering and real world practicality over absolute performance. Canon tends to go the other direction and design for max performance first. All you have to do is decide which approach you prefer, and go with that brand. Job done.
Good question. 1) The increasing megapixels of all full-frame bodies -which now start with 24 Mpix-, requires lenses that can resolve the sensor, however the new 24-70 VR is counter-productive and future-proof in this regard; 2) To most 24-70 is perhaps the staple lens and arguably it deserves more than any other zoom lens to resolve more (save for its inherent limitation due to covering wide angle to short telephoto as opposed to sharper telephoto zooms by their nature, which would as a result resolve more). 3) Due to the foregoing, after waiting for 8 years for the update and assuming that Nikon would not introduce another update in the long-term, I do not think that Nikon had the luxury to introduce a more or less similarly sharp version of 24-70 by adding VR, which, unfortunately they did. Now we are stuck for a long, long time with a not-sufficiently-resolving lens that is therefore not future-proof for our high megapixel cameras which will have even more megapixels in the future.

As a side note, Nikon's both 24-70 VR lenses, in terms of sharpness, are not very different from current lenses in their lineup with similar focal length, i.e. the fixed aperture 24-120 f/4 and variable aperture 24-85 VR aperture lens, despite the huge price difference with them. This is not the case with Canon. Their 24-105 f/4 VR scores 15 with 5DMIII and 18 with 5DSR. However 24-70 2/8 MII scores 18 with 5DMIII and 32 with 5DSR. There you get what you pay for, with Nikon you don't.

As a matter of fact unlike you I do not appreciate and respect Nikon's design choice when it comes to this staple lens for which VR is arguably not necessary, but I won't be changing a system just for 1 lens, despite being staple.
 
Guess you missed the part that DXOmark uses a subjective evaluation of lens sharpness so comparing a Canon lens on a Canon camera to a Nikon lens on a Nikon camera is a fool's errand at best.
 
As a side note, Nikon's both 24-70 VR lenses, in terms of sharpness, are not very different from current lenses in their lineup with similar focal length, i.e. the fixed aperture 24-120 f/4 and variable aperture 24-85 VR aperture lens, despite the huge price difference with them. This is not the case with Canon. Their 24-105 f/4 VR scores 15 with 5DMIII and 18 with 5DSR. However 24-70 2/8 MII scores 18 with 5DMIII and 32 with 5DSR. There you get what you pay for, with Nikon you don't.
Only if resolution is all you're measuring a lens on.
As a matter of fact unlike you I do not appreciate and respect Nikon's design choice when it comes to this staple lens for which VR is arguably not necessary, but I won't be changing a system just for 1 lens, despite being staple.
I don't always agree with it. I couldn't make friends with the 58 1.4G, which was just too gentle for me. Others love it. I owned the 'old' 24-70 for a while and I really liked its rendering. I personally don't think that a midrange zoom needs to have the ultimate resolution in the lineup. It's an all-rounder lens that needs to produce pleasing results in the majority of situations. For ultimate resolution there are primes for the middle and UWA and tele zooms for the ends of the range, all of which Nikon does extremely well.
 
Last edited:
There's one HUGE glaring problem with your thoughts right now - you're relying on DXO to be the proper and correct source of information on the lens. And that's where you went wrong. There is absolutely NO way you can grade a lens with this perceptual mp nonsense, or a single grade at all. None. Since they don't disclose the method they arrive at this mythical number, it's of little use and therefore can NOT be used to prove an argument or start a discussion such as you have attempted.The input data ain't no good.

And then of course there's the other thing - it's only a close range test. What about longer range distances? Only one source out there tests on a proper MTF bench at infinity, and that's the testing arm related to lens rentals dot com. Note that an MTF bench is the gold standard. No manufacturer is using DXO or imatest to measure their lenses during design - they're going to be using an optical bench. So if we can find a site that tests using an optical bench, we're going to find a site where you actually CAN use that information properly to infer some things about the lens. Having accurate data is *critical* to making ANY sort of educated guess/decision at relative quality. DXO is not that - so your whole original post was, frankly, a waste of your time. You need to find data that actually will let you know what's gong on, not some conjured magical number that mysteriously comes out of a sorcerers apparent hat.

So, take a gander at this - lens rentals MTF comparison wide open of the new Nikon vs the old Nikon 24-70's in terms of MTF on the optical bench,,and also the new Nikon 24-70 against the other competitors, including the Canon. Oh boy, you might actually learn something from this - like, for example, how the 24-70 VR *schools* the competition at 70mm - the MTF doesn't lie here. Pay particularly attention to the 10 and 20 (and to some extent the 30) lp/mm traces - they actually matter some of the most in real world shooting. If you take the time to educate yourself on what you're seeing here, you'll be much better able to figure out designer intentions, lens performance, and of course, most importantly, whether te lens will actually be the right lens for you (it may, it may not). Go ahead, give it a read and learn something today...


-m
 
My 2 cents, as I own this lens and once owned the original.

Wide end considerably sharper at the edges, like WOW on my D810. Center as others have noted maybe not as sharp.

Focus great as is VR, allowed me to score some pictures in low light at lower ISO than I would have with version 1.

There are sharper lens out there I'm sure, but they don't fit my Nikon. I hear great things about the canon, but I ain't changing systems as the whole system works, works better with this in my stable.

What are your thoughts about that, one lens don't make a system or make one change systems ;-)
 
Stop reading websites and start taking pictures. You'll be surprised looking back how often your images/image quality disagrees with DXO.
 
I own the new Nikon 24-70 VR and have yet to sell the old one.

I ignore sites which give a "single number result" because I want to know if the what and why behind the score is similar to the way I shoot.

The VR version has 4 stops VR (which is why I bought it), faster AF than the previously legendary AF speed of the old 24-70, and seems better built.

I expected and get more corner darkening near wide open, probably a design decision to keep the VR weight down to get 4 rather than 3 stops VR.

I can debate whether the VR 24 mm distortion is nearly as bad or slightly worse than the 24-120 at 24mm - but it is not as good as the original 24-70.

Press photographers (the probable target market) will often rate VR and AF speed as important plusses.
 
Exactly, lensrentals tests are clearly better and more reliable. The most important bit being that they test several copies, 10 in this case. Any review site just testing one single copy simply cannot make absolute statements about sharpness.

Everyone can have their opinion of course, but in my mind dxomark is completely useless in every way, especially for comparing across systems. Their approach isn't based on science.

Anyway, about lens rentals test, it's interesting to see that the new Nikon is just as good as the Canon, maybe a bit more astigmatism, but instead it's very even across the frame.
 
There's one HUGE glaring problem with your thoughts right now - you're relying on DXO to be the proper and correct source of information on the lens. And that's where you went wrong. There is absolutely NO way you can grade a lens with this perceptual mp nonsense, or a single grade at all. None. Since they don't disclose the method they arrive at this mythical number, it's of little use and therefore can NOT be used to prove an argument or start a discussion such as you have attempted.The input data ain't no good.

And then of course there's the other thing - it's only a close range test. What about longer range distances? Only one source out there tests on a proper MTF bench at infinity, and that's the testing arm related to lens rentals dot com. Note that an MTF bench is the gold standard. No manufacturer is using DXO or imatest to measure their lenses during design - they're going to be using an optical bench. So if we can find a site that tests using an optical bench, we're going to find a site where you actually CAN use that information properly to infer some things about the lens. Having accurate data is *critical* to making ANY sort of educated guess/decision at relative quality. DXO is not that - so your whole original post was, frankly, a waste of your time. You need to find data that actually will let you know what's gong on, not some conjured magical number that mysteriously comes out of a sorcerers apparent hat.

So, take a gander at this - lens rentals MTF comparison wide open of the new Nikon vs the old Nikon 24-70's in terms of MTF on the optical bench,,and also the new Nikon 24-70 against the other competitors, including the Canon. Oh boy, you might actually learn something from this - like, for example, how the 24-70 VR *schools* the competition at 70mm - the MTF doesn't lie here. Pay particularly attention to the 10 and 20 (and to some extent the 30) lp/mm traces - they actually matter some of the most in real world shooting. If you take the time to educate yourself on what you're seeing here, you'll be much better able to figure out designer intentions, lens performance, and of course, most importantly, whether te lens will actually be the right lens for you (it may, it may not). Go ahead, give it a read and learn something today...

http://www.lensrentals.com/blog/201...-8-ed-af-s-vr-sharpness-optical-bench-testing

-m
I am not saying their scores are reflecting a fact or their methodology is accurate. However, regardless of what methodology they implement, their results constitutes a meaningful "pattern". The content of the pattern may not be a fact, but the pattern seems to constitute a fact. To put in another way, for the sake of the argument if we assume that their methodology was wrong, when the correct methodology is applied (whatever that is), the pattern will be either exactly the same or very similar. To exemplify, under their current methodology, the P-Mpix of 85mm 1.4G is 18 on D600, 20 on D800 and 30 on D810. Even if this methodology is wrong and when the proper methodology (whatever that is) is implemented, the score might be, say, 16, 18, 28, respectively, where the increments from D600 to D800 and from D800 to D810 would be 2 and 10 respectively under both methodologies.

Second, when DXO's close range test and Lensrental's bench test are taken into account together, don't they demonstrate that Canon performs -in terms of sharpness only-, very good both in close range and longer distance, whereas the Nikon does not perform good in close range and decent but still not very good in longer distance, perhaps with the exception of 70mm? I don't have a problem with Nikon sacrificing some sharpness in 24mm and 50mm for longer range in order to get similar performance across the board (focal length and edge and corners), but I don't think that it was a good decision to sacrifice close range performance, even for centre, this much, in an era where lenses need to be capable of resolving increasingly higher megapixel sensors. Considering that there are photographers out there who shoot both close and long distance, that sensors are having increasingly more Mpix, that Nikon would not likely introduce a new 24-70 in the long term, I think it was a poor choice. Don't you agree?
 
There's one HUGE glaring problem with your thoughts right now - you're relying on DXO to be the proper and correct source of information on the lens. And that's where you went wrong. There is absolutely NO way you can grade a lens with this perceptual mp nonsense, or a single grade at all. None. Since they don't disclose the method they arrive at this mythical number, it's of little use and therefore can NOT be used to prove an argument or start a discussion such as you have attempted.The input data ain't no good.

And then of course there's the other thing - it's only a close range test. What about longer range distances? Only one source out there tests on a proper MTF bench at infinity, and that's the testing arm related to lens rentals dot com. Note that an MTF bench is the gold standard. No manufacturer is using DXO or imatest to measure their lenses during design - they're going to be using an optical bench. So if we can find a site that tests using an optical bench, we're going to find a site where you actually CAN use that information properly to infer some things about the lens. Having accurate data is *critical* to making ANY sort of educated guess/decision at relative quality. DXO is not that - so your whole original post was, frankly, a waste of your time. You need to find data that actually will let you know what's gong on, not some conjured magical number that mysteriously comes out of a sorcerers apparent hat.

So, take a gander at this - lens rentals MTF comparison wide open of the new Nikon vs the old Nikon 24-70's in terms of MTF on the optical bench,,and also the new Nikon 24-70 against the other competitors, including the Canon. Oh boy, you might actually learn something from this - like, for example, how the 24-70 VR *schools* the competition at 70mm - the MTF doesn't lie here. Pay particularly attention to the 10 and 20 (and to some extent the 30) lp/mm traces - they actually matter some of the most in real world shooting. If you take the time to educate yourself on what you're seeing here, you'll be much better able to figure out designer intentions, lens performance, and of course, most importantly, whether te lens will actually be the right lens for you (it may, it may not). Go ahead, give it a read and learn something today...

http://www.lensrentals.com/blog/201...-8-ed-af-s-vr-sharpness-optical-bench-testing

-m
I am not saying their scores are reflecting a fact or their methodology is accurate. However, regardless of what methodology they implement, their results constitutes a meaningful "pattern". The content of the pattern may not be a fact, but the pattern seems to constitute a fact. To put in another way, for the sake of the argument if we assume that their methodology was wrong, when the correct methodology is applied (whatever that is), the pattern will be either exactly the same or very similar. To exemplify, under their current methodology, the P-Mpix of 85mm 1.4G is 18 on D600, 20 on D800 and 30 on D810. Even if this methodology is wrong and when the proper methodology (whatever that is) is implemented, the score might be, say, 16, 18, 28, respectively, where the increments from D600 to D800 and from D800 to D810 would be 2 and 10 respectively under both methodologies.

Second, when DXO's close range test and Lensrental's bench test are taken into account together, don't they demonstrate that Canon performs -in terms of sharpness only-, very good both in close range and longer distance, whereas the Nikon does not perform good in close range and decent but still not very good in longer distance, perhaps with the exception of 70mm? I don't have a problem with Nikon sacrificing some sharpness in 24mm and 50mm for longer range in order to get similar performance across the board (focal length and edge and corners), but I don't think that it was a good decision to sacrifice close range performance, even for centre, this much, in an era where lenses need to be capable of resolving increasingly higher megapixel sensors. Considering that there are photographers out there who shoot both close and long distance, that sensors are having increasingly more Mpix, that Nikon would not likely introduce a new 24-70 in the long term, I think it was a poor choice. Don't you agree?
If dxomark's test was even remotely accurate, then the trend you are talking about would be apparent in lensrentals test too. But it isn't.

I just hope that people reading this start thinking a bit critically about the numbers presented on these online lens test sites, look into their methods and how they reach their conclusions.

In the end of course, it's up to you if you believe in the results of these tests.
 
I am not saying their scores are reflecting a fact or their methodology is accurate. However, regardless of what methodology they implement, their results constitutes a meaningful "pattern".
Well, if it's not accurate and it's not "factual," then who gives a rat's ass what "pattern" it represents?

I mean, seriously, your posts are so full of digressions and qualifiers and lame justifications for the horrible DxO methodology (re-read you're original post; you can't go more than 6 words without stopping to qualify your assertions in an attempt to side-step the deficiency of the DxO methodology upon which you base your argument) that the only pattern I see emerging from your discourse is that DxO's findings should be wholly disregarded.
 
I generally like the DxO database and refer to it regularly. There are a couple of flaws there, however. One has to do with their testing methodology and sample variations. Thus, I disagree with their sharpness rating of 24-120/4 on D750. They rate it at 14, almost as a 70-300 VR (13), which is a much inferior product. I would place the 24-120/4 somewhere between 16 and 18, based on other lenses that I have and agree with their respective DxO scores. The second issue is a more fundamental one and has to do with the fact that humans' perception is very very cursory. We can detect doubling an effect relatively easily, but can hardly detect a 50% change, be it a visual or a sound effect, for example. (What is the size difference of the letters in the optometrist table? I am guessing, it is about 50% increment between the lines, which is approximately our visual detection ability resolution.) Therefore, we can easily tell the difference between lenses with DxO scores of 24 and 12, but will be hard pressed to tell apart lenses with scores of 13 and 18, for example. Once you account for these two issues, the database is quite useful and helpful in navigating the products.
 
E.g. 85mm 1.4.G's score of 20 with D800 increases to 30 with D810, whereas 24-70 and 24-70E's scores of 13 and 15 with D800 increase to 19 and 21.
It is exactly the same increase on a log scale, which is how these parameters have to be compared.
 
I find it somewhat paradoxical that I don't use DxO's website for lens analysis (I don't use any site that tests just one lens) but love their lens correction tool available in their editing program. Maybe the programmers and the reviewers don't communicate :-).

If I am interested in a new lens I check to see if Roger Cicala has done any testing. Lensrentals has become a well respected site for in depth testing and Roger's caveats as to the limits of what can be expected from any lens/camera/AF system bring me to one conclusion:

Take pictures, take pictures, take pictures. If the lens does the job for you it is the right lens. If it doesn't, and others that you possess do (this takes technique out of the equation), get a different lens. As others have said, there is no perfect lens for every occasion. You are the ultimate reviewer for your equipment,
 

Keyboard shortcuts

Back
Top