And now, the megapixel race ruins DSLR IQ

  • Thread starter Thread starter Simon97
  • Start date Start date
... 4/3s needs around 32Mp - possibly more. That is assuming that the lenses are up to the task and that the internal camera processing can reasonably keep pace. A decently designed 32Mp sensor should outperform or equal an 8Mp sensor in just about every way.

--
Jay Turberville
http://www.jayandwanda.com
 
There is more to the magnitude of noise and contrast gradients than
their depths. Noise also has width, and height, in an image. If one
image has less pixels than another, the noise and contrast gradients
of those pixels cover a larger area, each. When you start comparing
the images by viewing them in a manner in which the width and height
are normalized, you are biasing the comparison in favor of the image
with less pixels.
Right. I've been doing some fiddling this weekend, and have confirmed that when equalized for resolution, the 8Mp sensor in my CP8400 outperforms the 8Mp sensor in my E-500 on a per area basis. A 4/3" sensor with 32Mp should outperform an 8Mp 4/3" sensor given similar technologies being applied.

I also ran Imatest SFR tests at MTF50 and MTF20 on the 40D and 50D resolution charts and found that indeed the 50D delivers almost exactly 20% more linear resolution than the 40D. When I visually inspect the images, it looks more like a 15% increase. I'm assuming that is a result of the stronger sharpening that is not only apparent on the 40D image, but also reported by Imatest.

So DPReview's claim that the 15Mp sensor isn't delivering a proportionate increase in resolution seems wrong. I think they really had to squint oddly in order to come up with the resolution numbers that they put into their chart.

--
Jay Turberville
http://www.jayandwanda.com
 
Sorry to be argumentative Bob, but if you don't like the way dPReview
tests then perhaps you should do your own testing and show us the
results.
It's a good point and something I find myself doing all too often because I find the myths that DPReview all too often promotes to be frustrating.
I don't know how much more "testing" it takes to demonstrate that
there are only minor differences between the 40D and 50D in measured
optical resolution.
The tests are done in exactly the same way and
regardless of whether the "absolute" numbers are absolutely precise,
the "relative" numbers are quite meaningful. By crowding the APS-C
sensor with too many photosites the noise levels are elevated which,
in turn, require greater noise suppression to render similar
appearances at higher ISO. This means a loss of detail - it's really
not rocket science.
Actually, there is significant subjectivity in how the numbers are interpretted from reading the chart. But I agree, it is not rocket science. Objective measurements from the charts show that the resolution increase pretty much exactly as you'd expect given the increase in pixel counts. Noise has nothing to do with any of this.

Pixels 4752/3888 = 1.22
MTF50_Hor 2246/1786 = 1.26
MTF20_Hor 2807/2301 = 1.21

MTF50_vert 2188/1794 = 1.22
MTF20_vert 2687/2274 = 1.18

Average increase in resolution = 1.2175

It seems to me that the DPReview tests do not support their assertions. Reading those resolution charts entails a significant degree of subjectivity. My read of them comes up with an increase in resolution of 1.15 - a tad less than Imatest measures. I suspect this is because the 40D image has had more sharpening applied to it.








You're given not only black and white but color resolution chart
results, DR and ISO results as well as a very nice assortment of
captures at various focal lengths and ISO's. Personally, I see little
to complain about. It is what it is.
Yep. It sure is what it is - namely poor interpretations of tests that range from very good to mediocre.

--
Jay Turberville
http://www.jayandwanda.com
 
Unfortunately, other evidence doesn't support these conclusions. The
50D theoretically provides a spatial resolution advantage of 22% over
the 40D and an 11% advantage over the D300. Both of these are small
enough to get lost in experimental error (different lens quality,
poor focus, shake, different exposure, etc. etc.). Other tests (such
as Joes) have shown the 50D delivering very close to the theoretical
resolution advantage. So, i disagree that the conclusion is valid.
My independant results confirm this. The 50D has right around a 22% advantage at MTF50 and MTF20. At MTF10 (approximately the Rayleigh criteria where all detail extinguishes), the advantage is only about 15%.
Rather, I think DPR has a very definite agenda on this topic, which
has been explored across several threads.
Yes, they used to jump on compacts for having low DR, but my experience and tests show the deficit isn't nearly as much as one would expect from all the howling. Further, they conveniently decided not to do DR testing of compacts. And finally, the DR test that they do are often very misleading and result in a lot of confusion.
Nice story, but hardly scientific evidence, and I've heard other
versions. If the end, with digital photography, what matters is how
much information you capture, and information is broadly equivalent
to the space under the system MTF curve. You get more of that with a
high density camera, and in practically every case I can think of,
you can get a better result with it, at least in theory. What camera
manufacturers and review sites choose to do with their defaults and
testing methods is a different matter.
Yup. I just did a test today to compare the sensor in my CP8400 to the sensor in my E-500. Both are 8Mp CCDs from about the same time period. When images are compared on a "per area" or "per resolution" basis, the CP8400 always provides better results. I even underexposed the CP8400 by two stops at ISO 400 to simulate ISO 1600, and when linear resolutions were equalized and the images were compared on a per area basis, the CP8400 was clearly more pictorially pleasing and seemed to have somewhat better dynamic range.

The main problem is that people keep comparing at 100% pixels and are not evaluating on a per picture or per sensor area basis.
--
Jay Turberville
http://www.jayandwanda.com
 
Did I say it was "scientific evidence"??? I don't remember doing
so.... Again, look at the comparisons at various ISO's between the
Nikon D3 (12 megapixel) and the 50D (15 megapixel) in the link
provided.....
The Nikon D3 has more than twice the sensor area of the 50D. So it darned well better outperform it on a per pixel and per image basis when it comes to noise.

And as expected, the 50D slightly outperforms the D3 when it comes to resolution. Though the D3 AA filtering lets through more image detail beyond Nyquist. In other words, it has a weaker AA filter and this probably enhances the appearance of sharpness somewhat.

--
Jay Turberville
http://www.jayandwanda.com
 
Don't you see the fallacy in this logic?

If you were to cut the wafer on a 24x36mm sensor into four equal
sized portions noise levels would remain identical on each of the
four new "sensors". Each "sensor" would have 1/4 the area of the
original but the photosites would be identical in size to the
originals. Each photsite has a signal to noise ratio which does not
change when viewed in isolation or as a collective.
Don't you see the fallacy in your logic. You are arguing "per pixel" noise. But photography isn't about recording pixels, it is about making images. When comparing two sensors of the same format (50D vs. 40D) the key is to compare full images or equal image areas. All this 100% pixel peeping causes people to compare unequal areas of silicon and hence reach poor conclusions about what whether 15Mp are better than 10Mp.
It's the "density" and "dimensions" of photosites which affect noise
not the size of the sensor.
Assuming similar technology, it is the sensor size that matters. Ultimately, it is a combination of active photon collecting silicon and the efficiency of the microlenses. Larger sensors tend to have more silicon that actually collects photons. That is their fundamental advantage. Modern sensors like the one in the 50D have minor improvements in total silicon and microlense design. So they deliver minor "per picture" improvements in noise and DR, while also delivering more significant improvements in resolution.
When more photosites are added in a
single plane to a sensor the size of the individual photosites must
be smaller or they must be more closely packed together or both. At
some point this eventual crowding obviously creates issues which
appear when signals are amplified for purposes of allowing higher ISO
equivalencies.
Sure. On a "per pixel" basis. But then there are proportionally more pixels. It reminds me of the quote attributed to Lenin, "Quantity has a quality all its own."

--
Jay Turberville
http://www.jayandwanda.com
 
There is much more to sensor noise than your oversimplification would
indicate... Perhaps you (and John) should read this from Kodak to get
an understanding of all the implications:
Here's a practical example. Same basic exposure. Same area of silicon. Same focal length. Same raw processor. The 8400 image uses four times as many pixels that are 1/4 the size as those used by the E-500. With proper resizing, the 8400 shows more shadow detail and less objectionable noise. Neither is very good, but the more dense 8400 image is better.

I've done the same thing with step wedge tests for DR, and the 8400 beats all of my four thirds cameras on a per area basis while using older and much smaller pixels. And the bonuse is that when given good light, the higher pixel density provides a very significant boost in image detail that can be recorded.



--
Jay Turberville
http://www.jayandwanda.com
 
Like so many naysayers, the OP didn't take the time to think his claim through.

As you point out, FOR ANY GIVEN OUTPUT SIZE, the newer camera and sensor are giving a better picture.

-gt
 
the minimum is 48 megs/image. Less uprezzing = better res. &
sharpness. How come no one else can relate to this, or are people
just using these cams for everyday fun use??
The problem is that too many people simply believe what they read wihout putting much effort into questioning it in a critical manner.

--
Jay Turberville
http://www.jayandwanda.com
 
Nikon bothered to fight banding almost
completely, and Canon didn't (banding has nothing to do with pixel
density; it is a line-by-line blackpoint calibration issue).
In general I agree with your criticism of the high photosite density
is always bad argument; but I disagree with your statement above. If
you leave everything else alone and increase the pixel count the
banding will get worse. This is because the per pixel signal to
banding noise will go down and this is not fully compensated for by
the change in size of the noise. This is similar but worse than
(because of the correlation of banding noise) the effect for read
amplifier noise where the pixel capacitance and amplifier noise tend
to stay constant so the signal to read noise gets worse
proportionally to the pixel area ratio. Re-sampling only improves SNR
by the square root of that ratio so it doesn't return all of the lost
signal to read noise. This is different than shot noise which scales
by the square root of pixel area so re-sampling exactly corrects for
photosite size changes when QE stays constant.
I realize that image banding noise does not decrease at the same rate as 2-D random noise when you increase total pixel count in an image. I was simply saying that pixel size is not a direct cause of banding; it comes from sloppy readout on a line-by-line basis.
One interesting possibility for very high pixel densities is that if
you out-resolve the lens then much of the fixed pattern and read
noise will be too small to be real image objects, so non-linear
processing may be able to preferentially remove most of those noise
contributions without affecting the image.
Low frequency banding will still be confused with signal, and needs some masked pixels to determine that.

Banding is not fixed pattern noise; not the kind we're talking about here in the 50D. It is different every frame.

--
John

 
Don't you see the fallacy in this logic?

If you were to cut the wafer on a 24x36mm sensor into four equal
sized portions noise levels would remain identical on each of the
four new "sensors". Each "sensor" would have 1/4 the area of the
original but the photosites would be identical in size to the
originals. Each photsite has a signal to noise ratio which does not
change when viewed in isolation or as a collective.
Don't you see the fallacy in your logic. You are arguing "per pixel"
noise. But photography isn't about recording pixels, it is about
making images. When comparing two sensors of the same format (50D
vs. 40D) the key is to compare full images or equal image areas. All
this 100% pixel peeping causes people to compare unequal areas of
silicon and hence reach poor conclusions about what whether 15Mp are
better than 10Mp.
Hi Jay,

I don't believe anyone has really questioned whether 15mp is or is not better than 10mp. The question is whether having 15mp on the APS-C sensor gives a "significant" resolution increase proportional to the additional pixels. It appears that dPReview does not think it does and that you and some others believe it does. I agree with Phil's findings that it apparently doesn't and I've yet to see any concrete evidence to the contrary - and yes, I am discussing per-pixel noise, absolutely.

Of course there is subjectivity in reading the results of the resolution chart photos. If I were reporting what I see I would estimate that the results show about 2350 lines horizontal and vertical so my estimation would be higher than Phil's. On the other hand I see absolutely no significant difference between the 50D and the Nikon D300 on either horizontal or vertical so my report would be higher than Phil's on this camera as well. The point is that I see no relevant differences between 12 and 15 megapixels and the Kodak 14's are equal or higher in my estimation to the 50D. Yes, the Kodak's had no AA filter but the D300 does. So what I'm seeing is conservative estimates on most cameras by the dPReview staff but they are internally consistent in my experience.
It's the "density" and "dimensions" of photosites which affect noise
not the size of the sensor.
Assuming similar technology, it is the sensor size that matters.
Ultimately, it is a combination of active photon collecting silicon
and the efficiency of the microlenses. Larger sensors tend to have
more silicon that actually collects photons. That is their
fundamental advantage. Modern sensors like the one in the 50D have
minor improvements in total silicon and microlense design. So they
deliver minor "per picture" improvements in noise and DR, while also
delivering more significant improvements in resolution.
That the larger sensor always produces lower noise is an assumption not born out by practical observation. My 1DS had considerably more noise at higher ISO than my 40D. Observations are being biased by better electronics and better noise suppression algorithms - it's not as simple as sensor size nor is is all about shot noise. Look at higer ISO noise in medium format sensors. By the logic that larger areas always produce less noise they should be relatively noise free. That decidedliy isn't the case and most manufacturers simply do not try to get serious high ISO from medium format sensors with equivalent pixel densities of smaller sensor dSLR's.
When more photosites are added in a
single plane to a sensor the size of the individual photosites must
be smaller or they must be more closely packed together or both. At
some point this eventual crowding obviously creates issues which
appear when signals are amplified for purposes of allowing higher ISO
equivalencies.
Sure. On a "per pixel" basis. But then there are proportionally
more pixels. It reminds me of the quote attributed to Lenin,
"Quantity has a quality all its own."
Yes, my point is that there is a point of diminishing returns on pixel density vis a vis noise, just where that point is located on an APS-C sensor is not yet clear. What is clear to me is that published higher ISO frames from the 50D indicate the effects of aggressive noise reduction which significantly impacts detail. Without noise reduction details are diminished by excessive noise as seen in the link I provided as compared with the Nikon D3.

Observed same frame photos from the D3 and 50D as well as resolution chart measurements show little, if any, differences in absolute resolution. Likewise in my observation between other 12 megapixel 1.5x and 1.6x and the 50D. So why have 15 megapixels if 12 will perform equally well? I believe this is Phil's argument and from everything I've seen I have to agree.

Best regards,

Lin
 
Thank you Lin for your advice. I had read that a long time ago, among other papers on the matter, including refereed research papers. You do not need to read into what is a simplified account from me for this forum (and for the perceived level of expertise of the other party in the dialogue) that I am not aware and have not considered the other noise sources. I could go through them one by one, if you like. In any case, to say that I'm hung up on shot noise, when half of my post concerned read noise (and many of the noise sources are bundled into 'read noise'). The fact is, you are wrong, as is indicated by your failure to dispute the reasoning I have put forward, rather engaging in generalised statements of little content. I read this as being due to an unfamiliarity with the theory and practice of sensor design. If this is the case, I would advise its better to avoid making pronouncements when you don't have the knowledge base to support your arguments.
--
Bob

 
There is much more to sensor noise than your oversimplification would
indicate... Perhaps you (and John) should read this from Kodak to get
an understanding of all the implications:
I don't see anything unexpected there. You remind me of characters in the saturday morning cartoons I used to watch, throwing banana peels and ridiculously large objects like anvils and houses into the paths of pursuers. You could have at least made a reference to something specific, there.

Anyway, Kodak was never known as a company that produced low-noise sensors. The advancements we have seen in Canon and Nikon sensors involve patents which Sony never paid to use, so they don't discuss.

Regardless, my arguments are not based so much on theory, as on real-world evidence. P&S sensors with tiny pixels are outperforming DSLRs per unit of area, NOW. The only exception is that some Nikons like the D3 and D700 and most Canon DSLRs are slightly better in read noise (per unit of sensor area) at high ISOs. In terms of shot noise, some of the denser P&S sensors have higher quantum efficiency than any DSLR.

--
John

 
Yep. It sure is what it is - namely poor interpretations of tests
that range from very good to mediocre.
I've been thinking for a while now that a very useful test of sensor resolution might go like this.

With a light source of three LEDs, red, green, and blue (true narrowband not filtered), adjust the relative intensity of the LEDs on the B&W test subject such that the three color channels are of equal intensity in the RAW data (a pinkish-magenta chart). Now, you have a true B&W RAW of the sensor, with no sharpening or softening, and no need for demosaicing. This will show the potential of the sensor, unclouded by conversion issues (only the lens issue remains).

--
John

 
Hi Jay,

I don't believe anyone has really questioned whether 15mp is or is
not better than 10mp. The question is whether having 15mp on the
APS-C sensor gives a "significant" resolution increase proportional
to the additional pixels.
It has now been demonstrated that it gives close to the theoretical 22%. You may argue that this is not 'significant', but it is all that a 50% rise in pixel count has to offer. Perhaps your view is now that Canon should have gone for a bigger increase?
It appears that dPReview does not think it
does and that you and some others believe it does. I agree with
Phil's findings that it apparently doesn't and I've yet to see any
concrete evidence to the contrary - and yes, I am discussing
per-pixel noise, absolutely.
You are entitled to agree with what you want, but given the patent flaws in DPR's rests, the posting of tests which unambiguously show the contrary and your inability to post any supporting evidence of your own, we may be excused for coming to the conclusion that your agreement is based on faith rather than evidence and reasoning.
Of course there is subjectivity in reading the results of the
resolution chart photos. If I were reporting what I see I would
estimate that the results show about 2350 lines horizontal and
vertical so my estimation would be higher than Phil's. On the other
hand I see absolutely no significant difference between the 50D and
the Nikon D300 on either horizontal or vertical so my report would be
higher than Phil's on this camera as well. The point is that I see no
relevant differences between 12 and 15 megapixels and the Kodak 14's
are equal or higher in my estimation to the 50D. Yes, the Kodak's had
no AA filter but the D300 does. So what I'm seeing is conservative
estimates on most cameras by the dPReview staff but they are
internally consistent in my experience.
What would be the linear adavantage of 15 over 14MP - 3.5%? How likely is this to be observable outside of laboratory conditions? In addition, with its FF sensor, the DSLR/14 will have the advantages of magnifying lens deficiencies 1.6 times less.
That the larger sensor always produces lower noise is an assumption
not born out by practical observation.
No one has ever said such a thing. Of course a very bad big sensor migh end up performing worse than a very good small sensor. The 5D was a case in point, a poor sensor rescued by being big.
My 1DS had considerably more
noise at higher ISO than my 40D. Observations are being biased by
better electronics and better noise suppression algorithms - it's not
as simple as sensor size nor is is all about shot noise. Look at
higer ISO noise in medium format sensors. By the logic that larger
areas always produce less noise they should be relatively noise free.
That decidedliy isn't the case and most manufacturers simply do not
try to get serious high ISO from medium format sensors with
equivalent pixel densities of smaller sensor dSLR's.
MF uses obsolescent sensors designed for science and aerospace. they use read chains built from off the shelf components, because the market doesn't have the volume to sustain the huge development spend of the consumer markets. However, even with obsolete sensors and off the shelf read chains against state of the art components, the extra sensor area brings home an advantage at least at low ISO's.
Yes, my point is that there is a point of diminishing returns on
pixel density vis a vis noise, just where that point is located on an
APS-C sensor is not yet clear. What is clear to me is that published
higher ISO frames from the 50D indicate the effects of aggressive
noise reduction which significantly impacts detail. Without noise
reduction details are diminished by excessive noise as seen in the
link I provided as compared with the Nikon D3.
Once again, you are entitled to a view, but you keep on putting forward opinions without any supporting evidence. It may be that there is a point of diminishing returns, bu where and why?
Observed same frame photos from the D3 and 50D as well as resolution
chart measurements show little, if any, differences in absolute
resolution. Likewise in my observation between other 12 megapixel
1.5x and 1.6x and the 50D. So why have 15 megapixels if 12 will
perform equally well? I believe this is Phil's argument and from
everything I've seen I have to agree.
and based on much more extensive and compelling evidence, many of us will disagree.

--
Bob

 
bobn2 wrote:
snip....
It has now been demonstrated that it gives close to the theoretical
22%. You may argue that this is not 'significant', but it is all that
a 50% rise in pixel count has to offer. Perhaps your view is now that
Canon should have gone for a bigger increase?
Then you wouldn't mind furnishing this "demonstration"??
It appears that dPReview does not think it
does and that you and some others believe it does. I agree with
Phil's findings that it apparently doesn't and I've yet to see any
concrete evidence to the contrary - and yes, I am discussing
per-pixel noise, absolutely.
You are entitled to agree with what you want, but given the patent
flaws in DPR's rests, the posting of tests which unambiguously show
the contrary and your inability to post any supporting evidence of
your own, we may be excused for coming to the conclusion that your
agreement is based on faith rather than evidence and reasoning.
Bob,

You refer to "patent flaws" and "tests which unambiguously show the contrary" but I've yet to see this evidence.... where is it???

snip...

snip
and based on much more extensive and compelling evidence, many of us
will disagree.
Much more "extensive and compelling evidence"??? It's more compelling because it supports your assertion that "there are patent flaws in DPR's tests"? It's more "extensive"?? You accuse me of making unsupported statements then proceed to make statements you can't apparently support. Hmmm...

Where are these "more extensive" tests? Not only have I not seen more extensive tests in this thread, I've not seen more extensive tests on this camera anywhere else, so please enlighten me. Where are they?

Lin
 
One of the problems is that one doesn't keep to hand a long list of links just to convince those who refuse to look for the evidence themselves. I suppose the big advantage DPReview has over other tests is that it gives it to you on a plate, along with a nice little narrative telling you what to think, so you don't even have to bother to look at what their tests actually show. Anyway, here's a start, will post some more later, when I've got time to locate them.
http://forums.dpreview.com/forums/read.asp?forum=1019&message=29864009

--
Bob

 

Keyboard shortcuts

Back
Top