How about Dynamic range?

OK, then let's say that RAW has more 'headroom' than JPEG (is that OK?), but why is that? Why don't the in-camera JPEGs take full advantage of all the information and DR that's available in the original RAW capture? Why does Canon for example use a mode like HTP (which just is a 1 stop under-exposure, resulting in more noise) to prevent blown highlights, if there's already 1 stop highlight headroom available in the RAW file? Isn't that a bit silly!?
There's nothing contradictory in that. It's just one more stop shifted to highlights. The lowest contrast setting for JPEGs in the camera usually puts the JPEG clipping point just below the RAW clipping point, in the "lead" channel, green. The red and blue channels are scaled for WB, and those are where the most clipping usually occurs. If you set the camera to normal or high contrast, then you start wasting more RAW highlights in the JPEGs.

--
John

 
I took my 7d and 1dmkII out in the woods today around sunset. While the 7d images looked fairly good on the camera display I was quite disappointed once they were viewed on the monitor. Although I shot in RAW and processed in DPP, there was something amiss in the highlights of the 7d images. They appeared a bit clipped though the rest of the image was properly exposed. Compared to the venerable 1dmkII, the differences were striking.
For comparison, the 1dmkII has around 9.2 stops of DR to the 7d's 8.3. Also, it appears from the review that the 7d exhibits less DR headroom in the highlights. No amount of PP could rectify the rather glaring distinctions. Personally, for the $ I would pick up a 5d or 1dmkII (if better AF is needed) rather than a 7d. Alternatively, wait a couple of months and the price of a good used 1dmkIII should be around the same $. While I loved the high ISO performance and improved resolution, and appreciated the improved AF compared to other xxd bodies, the DR issue is a disappointment. The 7d is going back.
I don't know how you're gauging this, but the 7D image, taken as a whole, has more DR than either of these cameras, by the normal definition of DR. You are talking about highlight headroom, it seems, and that is often more a matter of metering mode and contrast settings than it is RAW headroom.
--
John

 
No, RAW has no "headroom". RAW file is what it is, there's clipping there or not. What may extract more or less of that is the conversion from RAW to other formats.

Supposedly DXOMArk measures RAW DR, but there's some controversy about if their testing is well-designed and done correctly. Anyway, it's clear it's close to what one expect, MF cameras do better, then FF, then APS-C, them 4:3, then compacts.
This isn't necessarily true. The general rules are that DSLRs have the highest at high ISOs, medium format and compacts the least, and the more pixels, generally, the higher the DR at low ISOs (Screen), but with compacts generally a stop less than a DSLR or MF with the same number of pixels (some compacts beat some DSLRs, though).
Some softwares have better performance extracting DR than others, and some have recovery tools, meaning essentially that they change the top and bottom curve tones to do that (typical jpeg conversion tone curve gives this 8-9stop DR values DPR tests.

Best APS-C sensor measured there is D90/D5000 but Gabor has shown some trick done at RAW level may be causing that, not sure.

Anyway, 12 stops is already pretty good if one can really get all that from sensor, better already than positive film and similar to negative film.
The question is how big are you displaying the image. For a small image, you can waste many stops of RAW headroom and still get a usable image on many cameras, at base ISO. The biggest obstacle there is that you may run into banding.

--
John

 
Yes, the dynamic range is one of the issues holding me back from upgrading. I'd much rather have greater dynamic range in my pictures than more megapixels as you speak of.

I'm fine using my 10D until I can upgrade to a camera that will suit my picture taking needs.
The 7D has way more DR than the 10D, at base ISO, and even more yet, at high ISOs. At ISO 1600, the 7D has about 3 to 4 stops more practical DR than the 10D.

Do you know what DR is? Or are you confusing it with highlight headroom?

--
John

 
I was wondering what makes the images from my 40D the images so special (other than the fact that I took them ;) ). It may be dynamic range. Here is a compilation of dpr's recent DR results for in-camera jpegs from Canon and Nikons. These are prevailing values up to ISO 1600:

Cam... EV
30D... 8.4
40D... 9.1
50D... 8.3
7D... 8.3
5Dii... 8.4

D200... 8.2
D300S... 8.4

The 40D DR is a standout. I wonder why?
There is no magic in the 40D; must be just a difference in tone curves used.

--
John

 
Why would you expect the same DR with the same sensor? The downstream electronics and digitization affect DR more than anything. The 20D and 30D happen to have the same sensor and electronics, but the with the 30D Canon started artificial clipping of RAW data below the ADC limits, throwing a wild card into the mix.

--
John

 
At the pixel level, I suspect it won't be too different from the 40D/50D, probably ~ 11 stops. At the image level, it'll be better.

Pay a visit to DXOMark although the 7D data is not in yet.

It won't be as good as the 5D2 for sure.

Neither will it be better than D5000/D3000/D90 'cos Canon does not clip their black levels like Nikon.
 
OK, then let's say that RAW has more 'headroom' than JPEG (is that OK?), but why is that? Why don't the in-camera JPEGs take full advantage of all the information and DR that's available in the original RAW capture? Why does Canon for example use a mode like HTP (which just is a 1 stop under-exposure, resulting in more noise) to prevent blown highlights, if there's already 1 stop highlight headroom available in the RAW file? Isn't that a bit silly!?
There's nothing contradictory in that. It's just one more stop shifted to highlights. The lowest contrast setting for JPEGs in the camera usually puts the JPEG clipping point just below the RAW clipping point, in the "lead" channel, green. The red and blue channels are scaled for WB, and those are where the most clipping usually occurs. If you set the camera to normal or high contrast, then you start wasting more RAW highlights in the JPEGs.
I've been wondering about that. How much 'headroom' (to the clipping point) there actually is in RAW. I'm shooting RAW+JPEG, but my computer is old and slow, so I'm not processing the RAWs, just saving them for later, just in case. I'm shooting with Neutral Picture Style, contrast -2, and almost always in daylight with WB set at 5600K. I'm also shooting 'to the right', carefully watching the R/G/B histograms to avoid clipping. Are you saying that with those conditions/settings I can't expect that there's much additional 'headroom' in the RAWs? And does any of the three color channels (usually, under the same conditions) have more 'headroom' than the others?
 
Wouldn't a 8 bit jpeg be only capable of 8 stops, whereas a 14 bit
raw channel would potentially carry 14 stops DR ?

Since the green pixel is has the greatest brightness It would have less
headroom. The ratios used is to make TV white , 6500K ,

Y (luminance) = .59G +.3R +.11B. This approximates the eye's response
to primary colours.

peter
 
Wouldn't a 8 bit jpeg be only capable of 8 stops, whereas a 14 bit
raw channel would potentially carry 14 stops DR ?
That would be true if jpeg were recording linear data (ie doubling the illumination doubles the digital number representing it). Most of the time jpeg is used to store data that has been given a "gamma" transformation -- the data is raised to a power, usually 1/2.2, and that compresses the highlights while lifting the shadows so that the 8 bits can store more like a 9.5 stop range of illumination levels.

--
emil
--



http://theory.uchicago.edu/~ejm/pix/20d/
 
At the pixel level, I suspect it won't be too different from the 40D/50D, probably ~ 11 stops. At the image level, it'll be better.
Pay a visit to DXOMark although the 7D data is not in yet.
It won't be as good as the 5D2 for sure.
The 7D might do better at "screen" at low ISOs; some 7Ds have pixel read noise lower than the 5D2 (the IR one does). Having a few more pixels will make the 5D2 a little better in "print".

In practice, however, the 7D read noise has less banding, and the periodic vertical banding it has is almost completely removable in theory, so the 7D really has better DR potential, I think. I have shot ISO 100 at -5 EC and the images don't really look too bad.
Neither will it be better than D5000/D3000/D90 'cos Canon does not clip their black levels like Nikon.
Clipping blacks does nothing for image quality, except clip away part of the image. That can be done with any RAW, really, if that's what you want.

--
John

 
Yes, the dynamic range is one of the issues holding me back from upgrading. I'd much rather have greater dynamic range in my pictures than more megapixels as you speak of.

I'm fine using my 10D until I can upgrade to a camera that will suit my picture taking needs.
The 7D has way more DR than the 10D, at base ISO, and even more yet, at high ISOs. At ISO 1600, the 7D has about 3 to 4 stops more practical DR than the 10D.

Do you know what DR is? Or are you confusing it with highlight headroom?
I know what dynamic range is. I also don't care much about high iso dynamic range. 95% of my shooting is at ISO 100. While the 7D has more dynamic range, no doubt about that, I would much prefer a camera that has the dynamic range of Fuji's S5pro.

P.S. Doesn't Highlight headroom also play into dynamic range to a certain extent?
--
Canon 10D
Canon EF 50mm MKII
Sigma 10-20mm EX DC
Canon 70-300mm IS
http://coreyhardcastle.smugmug.com
 
Is this true for the mRAW and sRAW files too? I haven't read an analysis of what these options do for dynamic range or noise.
--
mRAW and sRAW are equivalent to taking a full-size RAW, converting it, and downsampling the result by a factor of 1/2 (sRAW) or about 11/16 (mRAW). The downsampling eliminates all small scale detail, and gets rid of fine scale noise as well. Thus mRAW and sRAW have lower pixel-level noise, because their coarser scale pixels measure the noise at larger image scales, and noise is scale dependent in an image.

But note that the lower noise of the smaller RAW formats is not less because of some magic -- the lower level of noise at coarser scales was already there in the full RAW, since it can be generated from the latter by the same processing steps that generated the smaller RAW format. And in fact, a much more optimal treatment is to apply a quality noise filter such as Noise Ninja etc to filter the noise out while leaving the bulk of the detail (downsampling gets rid of detail and noise in equal proportion).

Finally, dynamic range and noise are two sides of the same coin. DR is the range of tonal levels over which the signal-to-noise is acceptable. Since noise is scale dependent, being larger at finer scales, DR is also scale dependent, being smaller at finer scales. There is nothing bad about this, it's just a fact of the way pixels sample images. The important thing to remember is that finer pixels still have the information about coarser scales in their data, which can be uncovered with proper image processing.

--
emil
--



http://theory.uchicago.edu/~ejm/pix/20d/
 
I know what dynamic range is. I also don't care much about high iso dynamic range. 95% of my shooting is at ISO 100. While the 7D has more dynamic range, no doubt about that, I would much prefer a camera that has the dynamic range of Fuji's S5pro.
That comes at a price; the DR is increased, but the quality at various levels is inferior. For stable subjects, you're better of taking multiple exposures.
P.S. Doesn't Highlight headroom also play into dynamic range to a certain extent?
DR = headroom + footroom.

--
John

 
I've been wondering about that. How much 'headroom' (to the clipping point) there actually is in RAW. I'm shooting RAW+JPEG, but my computer is old and slow, so I'm not processing the RAWs, just saving them for later, just in case. I'm shooting with Neutral Picture Style, contrast -2, and almost always in daylight with WB set at 5600K. I'm also shooting 'to the right', carefully watching the R/G/B histograms to avoid clipping. Are you saying that with those conditions/settings I can't expect that there's much additional 'headroom' in the RAWs? And does any of the three color channels (usually, under the same conditions) have more 'headroom' than the others?
With -2 contrast, you should have at least 1/3 stop in the green channe in DPP, maybe another 1/3 in ACR depending on the ISO (1/3 stop groups have different headroom)l, and more in the red and blue. With daylight WB, the red channel has about 1 stop more headroom than the green, and the blue, about a 1/2 stop more than the green. ACR will use the red and blue channels for extended grayscale highlights, IIRC. I don't keep up with the converters, so I can't give up-to-date specifics.

--
John

 
Yes of course gamma or log encoding emulates more bit depth.
So it's not as bad as I thought.

Film DPX 10 bit files are log encoded and can squeeze around 13 -14 linear
bits into 10. But you don't get something for nothing, it borrows bits
from the mid range or gamma as you stated. I'm surprised the movie
business dosen't now simply work with 14 bit linear files but there are a lot
of frames in a movie even for today's computers.

The pros outwiegh the cons with this form of compession but going from
14 (or more) to 8 bits would have to compromise quality to some degree
giving you less grading latitude.

Initially I shot jpeg on my 300D but tried raw and was amazing at the reach
that enabled. Combining two grades gave the camera increible DR when shot
in raw.

Also jpegs are colour sub sampled but you may have an option not to on
your PC but in the camera ?

peter
 
Is this true for the mRAW and sRAW files too? I haven't read an analysis of what these options do for dynamic range or noise.
--
mRAW and sRAW are equivalent to taking a full-size RAW, converting it, and downsampling the result by a factor of 1/2 (sRAW) or about 11/16 (mRAW). The downsampling eliminates all small scale detail, and gets rid of fine scale noise as well. Thus mRAW and sRAW have lower pixel-level noise, because their coarser scale pixels measure the noise at larger image scales, and noise is scale dependent in an image.

But note that the lower noise of the smaller RAW formats is not less because of some magic -- the lower level of noise at coarser scales was already there in the full RAW, since it can be generated from the latter by the same processing steps that generated the smaller RAW format. And in fact, a much more optimal treatment is to apply a quality noise filter such as Noise Ninja etc to filter the noise out while leaving the bulk of the detail (downsampling gets rid of detail and noise in equal proportion).
I could (very well) be wrong, but I've got this idea that downsampling affects the noise relatively more than the detail, because the noise isn't affected by the AA-filter (and lens, etc.), but the detail is, meaning that the noise is present at a higher spatial frequency than the detail, and therefore is affected most. (Or maybe one could say that the noise is captured with perfect per-pixel sharpness, and the detail isn't). But of course it doesn't really matter, because I'm also sure it's correct that a good noise filter gives a better result than a simple downsampling.
Finally, dynamic range and noise are two sides of the same coin. DR is the range of tonal levels over which the signal-to-noise is acceptable. Since noise is scale dependent, being larger at finer scales, DR is also scale dependent, being smaller at finer scales. There is nothing bad about this, it's just a fact of the way pixels sample images. The important thing to remember is that finer pixels still have the information about coarser scales in their data, which can be uncovered with proper image processing.

--
emil
--



http://theory.uchicago.edu/~ejm/pix/20d/
 
I've been wondering about that. How much 'headroom' (to the clipping point) there actually is in RAW. I'm shooting RAW+JPEG, but my computer is old and slow, so I'm not processing the RAWs, just saving them for later, just in case. I'm shooting with Neutral Picture Style, contrast -2, and almost always in daylight with WB set at 5600K. I'm also shooting 'to the right', carefully watching the R/G/B histograms to avoid clipping. Are you saying that with those conditions/settings I can't expect that there's much additional 'headroom' in the RAWs? And does any of the three color channels (usually, under the same conditions) have more 'headroom' than the others?
With -2 contrast, you should have at least 1/3 stop in the green channe in DPP, maybe another 1/3 in ACR depending on the ISO (1/3 stop groups have different headroom)l, and more in the red and blue. With daylight WB, the red channel has about 1 stop more headroom than the green, and the blue, about a 1/2 stop more than the green. ACR will use the red and blue channels for extended grayscale highlights, IIRC. I don't keep up with the converters, so I can't give up-to-date specifics.
Thanks. That's a very valuable/useful piece of information ;-)
 
I could (very well) be wrong, but I've got this idea that downsampling affects the noise relatively more than the detail, because the noise isn't affected by the AA-filter (and lens, etc.), but the detail is, meaning that the noise is present at a higher spatial frequency than the detail, and therefore is affected most.
But noise doesn't really matter when it is at higher frequencies. Noise is problematic at low frequencies, which dowsampling doesn't remove.

Personally, I'd rather see slightly more noise (based on low frequencies), and more resolution than the same noise with lower resolution. I think my brain sees things better, or at least is happier, there. I really don't understand the people who don't care how inaccurate (distorted and pixelated) an image is, as long as they don't see "those speckles". Noise at downsampled resolutions can hide in the detail, making one thing that the pixel should really be that color, when it sohouldn't. At very high resolutions, almost oversampling the optics and AA filter, it is obvious to the brain what is noise and what isn't.
(Or maybe one could say that the noise is captured with perfect per-pixel sharpness, and the detail isn't). But of course it doesn't really matter, because I'm also sure it's correct that a good noise filter gives a better result than a simple downsampling.
Get some noisy but detailed crops, at 100%, and use the pixelate tool in photoshop interactively; you might see that binned versions don't really improve things much at the same image size. Unfortunately, PS has no way of viewing like this with downsampling insteade of binning, but you can make multiple copies of a crop, and downsize to multiple sizes, and then upsize all to the same size, to compare. I bet you won't find anything better than the noisy original, for any busy, detailed scene.

--
John

 

Keyboard shortcuts

Back
Top