Bhima78
•
Senior Member
•
Posts: 2,850
DXO numbers do not work cross platform
6
Nirurin wrote:
So at the moment I have my toe dipped into the sony APSC ecosystem, with an a6000 and the kit lens + the 55-210 zoom. I've had a few issues with it though, and I have the opportunity to sell it all and exchange for another system.
Figured it would be better to do it now, before I buy any more lenses!
One issue I had with the sony system is that there are very few lenses, and a lot of the ones I like have compromises. For example, they have some fairly decent zooms, but they're all pretty slow in aperture. And the only macro is 30mm, though it's also very cheap.
I had been under the impression that micro 4:3 had more lenses at better prices, with the downside being the smaller sensor size. However today I spent some time on DXOMark to look through the 'best' lenses... Here are some of the scores -
Sony 55-210 = 13
Sony 18-200 = 13
Panasonic 14-140 = 9
Olympus 14-150 = 10
The sony 55210 and the panasonic are both very cheap, with the Olympus being the same price as the sony 18-200 (twice the price of the others...) and yet the sony lenses are leaps and bounds better image quality?
Though saying this, the 'kit' lenses for panasonic seem to get marginally higher marks compared to sony's, so maybe it evens out on average over the line...
This is turning into some kind of 4/3 bashing, which isn't my intention. I'm partly wondering if I am misinterpreting the results of these tests somehow. I really want the 4:3 lineup to be worth the hassle of changing systems haha.
Both systems are small, I guess I want to be able to get good image quality for my money.
Any tips or thoughts are welcome, sorry for the ramble, late night
DXO sharpness numbers do not, in any way work cross platform. The only way you can even come close to determining how one lens/camera combo could fare against the other is if both systems have the EXACT same lens that you can normalize the results to.
Luckily for you, you have an A6000. And there is a lens on that system that is the EXACT same lens on m43's: the Sigma 60mm f2.8. The lens is literally a carbon copy of itself for both systems, the difference is the mount alone. Now look at the DXO sharpness numbers for both systems and then see how the lenses for each system compare to the sharpness of the Sigma 60mm on each of their respective systems. You will find plenty of m43's lenses come close and beat the Sigma 60mm. On Sony's side, you won't find any that beat it, and very few that actually get close to the sharpness of that lens.
Here are a few real world examples as to why you cannot use DXO sharpness numbers across platforms.
Real world scenario 1: Canon 6D with Canon 17-40mm F4: Sharpness score: 14MP /// Olympus E-M1 with Olympus 12-40mm f2.8: Sharpness score: 9MP
Now, here are actual real world photos with those setups:
http://www.43rumors.com/full-frame-vs-micro-43-revisited-with-pro-olympus-lens-guest-post-by-chris-corradino/
Clearly, the Oly looks MUCH sharper. So why the big number discrepency: more MP + larger pixels will give you a higher number here, but it doesn't actually give you an accurate representation of the quality of those extra numbers. So essentially, you have more megapixels, but all you've really done is enlarged a slightly blurry image.
Another test via DXO: Nikon D810 with Nikon 24mm f1.4: Sharpness score: 23MP /// Panasonic 12mm f1.4 (no dxo score, but its impossible to get anywhere near 23MP sharpness. Let's give it the benefit of the doubt and match it to the Nocticron: 13MP):
Now some real world corner performance at infinity (really important for landscape lenses): Nikon performance in the corners at f2.0 (scroll to the bottom of the link to see the Nikon 24mm f1.4 at f2.0): http://www.cameralabs.com/reviews/Nikon_Nikkor_AF-S_24mm_f1-8G_ED/sharpness.shtml
Panasonic 12mm f1.4 corner performance at near infinity:http://www.cameralabs.com/reviews/Panasonic_Leica_DG_Summilux_12mm_f1-4_H-X012/sharpness.shtml
It is clear as day that DXO would rate all the 3 24mm FF lenses higher than the Panasonic 12mm even though all 3 of them cannot in any way touch the corner performance of the Panasonic 12mm... not until they get to F4 can they compete. And I guarantee the DXO sharpness difference will be at least 10MP, but it becomes one of those situations where you have to ask yourself: Am I gonna believe DXO numbers, or my lying eyes?
This isn't to say all m43's lenses are better than FF or whatever... but it is to show you that DXO numbers do not play out in the real world when you are trying to compare across platforms. They do work to compare lenses within the same platform though.