For "JPEG DR", if one wants to go that way,
After reading the first page of this thread I had an idea ;
What if DPReview (or another big website) set up a studio scene for dynamic range measurement in 'real' terms : i.e. a scene with enormous lighting range from jet black velvet in shadow
Yes like a cavity acting as a light trap. DPR's new test scene has a bit of that which is good. Lots of varying low-contrast fine textures to trick the NR algorithm.
Then I'd throw in a handful of differently-coloured sewing threads (not on their spools) in a dark place so the camera's JPEG engine has some fine colour detail to deal with.
to bright spotlight reflections and all the stuff inbetween.
A bright, slow gradient to match the clipping against. As small as possible not to reduce overall scene contrast by lens flare needlessly.
Each camera/sensor takes the same picture and we can easily see the clipping areas since ALL cameras and films will clip at different points in this extreme scene.
Which tone curve are you going to apply? How are you going to set exposure?
Do you calibrate to a highlight, a shadow, or a midtone?
I'd use a sequence 1/3 stops apart and pick the one where I get 255,255,255 closest to the middle of the clipping gradient reference (or better also pick a few around that). I'd also put 1/3 stop reference marks on the gradient.
How do you compensate for ISO variances between cameras.
Use the lowest ISO (or the ISO performing the best if there's a compromised lowest ISO).
Then darken the bright gradient and brighten the darkest parts of the scene to some predefined average levels using some standardised method (e.g. gamma) where visual inspection can be done. Compare to a well-exposed reference. Everyone can then make up their own mind.
It would still be affected by light spectrum and things like that (which the test should point out), but at least the effect of NR, sharpening, JPEG compression and pattern noise would be factored in.
The T4110 step wedge (and other techniques) work pretty well at dealing with these issues and make it easy to get standardized results.
Problem with the wedge and Imatest, or DPR, or even DxO, is that none of them registers pattern noise like banding. That can often be the factor that limits the practically useful DR. It also doesn't go away well when downsizing, unlike random noise.
Hopefully, at some point, there will be software capable of, in the vast majority of cases, reducing line noise at the source without damaging the real image noticeably.
The GH1 has the unique problem of clipping 99.4% of its raw data at black at ISO 100, which, I'd expect, would limit the amount of subject details you could salvage from the deepest shadows, as well as fool the wedge/Imatest method.