Yep. At the test distance they used, the MTF50 score is less than some competing lenses. I found that out when I objectively tested my copy. However, when one looks at longer test distances (or landscape distances), the lens behaves quite differently - and is extremely sharp - to the point I'm fairly certain it's diffraction limited around F/4 through most of the frame. It can compete quite well, and is possibly even a bit superior to, the Voigtlander 50/2 Apo Lanthar at *distance*, another reference lens.
And in portrait situations - which is what the lens is designed for in the closer range - it will behave better than the others, even though it will "lose" the test war.
So what is going on here?
The test is misleading, the reviewer doesn't adequately understand the concepts involved (even though he likely means well and the site is quite nice in all other regards).
- An MTF50 score is a very small slice of what the overall resolution performance of a lens is, and not indicative, at all, of overall image quality. It is a very rough proxy for general sharpness, certainly not enough to quantify a lens as being absolutely and uniformly better than another.
- A test chart is generally shot at portrait distances (there are exceptions, one of our own forum members tests with extremely large charts and very long distances, but that's not the way photographylife is doing it), and this presents an issue because *some lenses are designed to perform differently in the portrait distance range than in the landscape distance range*
So we have to tackle both of these and it's going to get a little technical, but there is no other way.
If we look at MTF in the classic optical bench way of plotting resolution frequency (we'll use traditional terms of 10lp/mm, 30lp/mm, 50lp/mm, etc here) against contrast at a particular spot in the frame, you'll see a generally downward slope; this is because as we in frequency (the details get finer and finer) the ability to resolve those drops due to diffraction and other matters. The key point here is that Otto Schade, who pioneered MTF long ago, did all sorts of studies and determined that image quality is related to the square of the area under an MTF trace as so described, which has really serious implications: First, it means that looking at only one frequency point isn't telling you the whole picture, and second, it means the lower frequencies are quite important. And MTF50 score is the resolution when the contrast hits 50%. Doesn't tell you about the overall balance of frequencies or the shape. It's useful in a very broad way for a general idea of "sharp", but as I'm about to explain, you'll also see it can be misleading, or not even relevant to a shooting situation.
Next we to briefly hit upon some concepts of lens design that have been out there for a while. I can't tell you who first discovered this, because I don't know, but the earliest writings about the topic of designing for a flat plane (the test chart) versus designing a lens for reality (three dimensional) that I saw was from the writings of Jun Hirakawa, a very famous lens designer from Pentax, and the date on the writings was about 2000 IIRC. Similar concepts were also noted by Nikon designer Haruo Sato when he did the F mount 58/1.4G Noct. Hirakawas writings specifically noted that if you approached the design you needed to make sure that astigmatism was well controlled, even if it meant leaving in some field curvature, even if doing so meant the test numbers might not be as good if you did so. In Haruo Sato's writing, and I think also in some interviews with the designer of the 50/1.2S, Hiroki Harada, it's mentioned that there is a TRADE OFF between going for maximum resolution OR being able to get a natural depiction OOF transitions and bokeh, which are quite relevant to portraiture. In other words, you can max out one aspect, but you lose the other. This is a fine balancing act - IMO Sato got it a bit wrong (too much of a trade) in the 58G, while Harada got it right in the 50/1.2S.
So I assure you, if Harada wanted to win the test chart wars, he easily could have - he's Nikons most senior designer, but his view was that the 50/1.2S at portrait distances would be used for people, so he tuned/optimized the lens *for that task* instead of trying to beat the test chart game. What he did was make sure the lens was pretty sharp - because he realized in the high resolution era, people wanted textures accurately reproduced, but he didn''t max it out. He made sure the transition as well as both the front and back bokeh were nice. He took the trade that would mean it loses (slightly) in the test chart. And - he also knew as distance increased, he would need to concentrate on resolution more so, so if you test the lens with, say, MTF mapper at various distances, you'll see this portrait tuning reduce and eventually go away as you get outside of portrait distance. This is where the designer is optimizing the lens for a task in real life, as opposed to the test chart.
Now the third thing. Going back to resolution again. People always concentrate on the highest numbers, how important they are, how they "prove" that, say, the sony lens is absolutely better than the Nikon because of this, like the Nikon designers were idiots. But now let's get to the real word, keeping in mind both of the paragraphs above. If you are handheld, taking a portrait, I can almost guarantee you that you'll *never* see the maximum resolution performance of the lens, ever. You can do 10 runs of a test with MTF mapper using your best AF method - pin focus - and you'll have 10 *different* resolutions (small differences), and that's if you're on a tripod and focusing carefully. You add subject movement, motion blur, any sort of less precise focus, and those higher spatial frequencies - the 50lp/mm and up (probably lower than that) won't be achieved in your image. But the lower ones will be.
So what would you rather have as a portrait shooter?
A lens that is amazing on the test chart at resolutions that you likely will never achieve (because you're not shooting portraits on a tripod with exact focus) OR a lens that is quite sharp, but whose designer made some trade offs for rendering/OOF/bokeh to provide a more realistic depiction of the scene and "gave away" some high frequency resolution (which would lower the MTF50 score and thus the lens would "lose" on the chart) to do so, because he knew that the likelihood of achieving high frequency resolution in the portrait situation wasn't happening anyway?
I know which lens I'd prefer if I'm shooting people. It's not the test chart winner.
And remember, at distance, the 50/1.2S will hang with anything, from anyone.
Now - if for what you personally shoot, you need max resolution at closer distances, then, no, the 50/1.2S is not your lens. Different answer than if you were a portrait shooter. Personally, I use something else for portrait distance full length in the studio because I want a different "tradeoff game" for that work, but I'll use the 50/1.2 outdoors with portraiture all day long and prefer it over the lens I use in the studio - tool to task matching, as opposed to test chart winner wars.
The key is - the test chart "review" doesn't tell us what we need to know, and thus, like most flat chart sites, it's of minimal value - it doesn't tell us anything about the more important behavior for portrait situations, and because the chart test is not at distance, it doesn't tell us the performance at distance either. Now you know why I don't place much weight at all in such chart tests. When I use a chart - I'm trying to see where (and how much) any portrait tuning is done, and I'm also very interested in the shape of the plot when resolution frequency is plotted against contrast, as that tells me more about some subtle aspects of lens rendering.