AWB vs. UniWB experiment: the data

Started Aug 10, 2012 | Discussions
Chris Noble
Chris Noble Veteran Member • Posts: 5,493
AWB vs. UniWB experiment: the data

Please read this entire post before responding.

Many of us have engaged in spirited debates about how to obtain the "best" Raw ETTR exposure. This thread addresses one part of that debate: which is better, AWB or UniWB , for that purpose? This is an AWB vs. UniWB data-gathering experiment. We will post comparisons of AWB and UniWB shots of the same scene, same time, same camera & same photographer. The objective is to expose for the "best" ETTR in each case.

All scenes, lighting conditions and lighting sources are welcome.

Please follow the following guidelines, which have been worked out in this thread:

http://forums.dpreview.com/forums/read.asp?forum=1041&message=42216351

1) Put your name and submission number in the subject line. One scene per post please. You can post as many different scenes as you want.

2) Shoot the same scene with WB set for AWB and then for UniWB (or in reverse order). Post must include both RawDigger histograms and both PP JPGs . We are standardizing on a common RawDigger log-scale presentation format for the histograms. Instructions can be found here, thank you Gollywop for proposing a standard format:

http://forums.dpreview.com/forums/read.asp?forum=1041&message=42226322

3) Include information about your camera, exposure, compensation, and the method you used in setting the exposure; use or avoidance of VF blinkies and pre/post VF histograms, your compensation rules of thumb, etc. Screenshots of your VF information would be useful but not required. Also comments on how you PP'd the JPGs.

4) Tell us how many test exposures you made and how you iterated compensation adjustment before the final shot. Bracketing is not allowed for this experiment. By bracketing we mean taking multiple exposures and picking the best one based on looking at the JPG rendering or histograms after the series has been shot. We are not suggesting that bracketing is not a useful tool; but we want to limit the experiment. Submit the last picture you took with the AWB setting and the last one you took with the UniWB setting. No cheating.

5) Give us your summary evaluation. In your opinion, which WB gave you the best ETTR exposure, and the best JPG result, where in the JPG image "best" can be observed, and why. And other words of wisdom (Hint: the tie-breakers are often saturated highlights or noisy shadows).

6) Tripod use is welcome but not required.

7) "Best ETTR" means rightmost possible without intentional saturation of specular highlights (In practice, specular highlights are often saturated intentionally. Not for this experiment please).

8) If you would like to examine the Raw files, please send a private message to the poster. Or you can use a special Dropbox created for this purpose by Vlad :

http://forums.dpreview.com/forums/read.asp?forum=1041&message=42217380

9) Please resist the urge to post unless you are submitting an entry or providing restpectful, thoughtful feedback and questions. It would be nice to include as many examples as possible before we reach the 150-post limit. We are not in a hurry. Bookmark this thread though, it may often sink below the first Micro Four Thirds Forum page between submissions if we are all busy shooting.

10) It's easy to cheat. Don't. No reason to, and your mother is watching you.

11) This thread is not for you if (a) these acronyms mean nothing to you or leave you indifferent; (b) you would like to debate the value of ETTR, UniWB, or green casts in your VF; (c) you would like to learn about ETTR and UniWB; (d) you would like to program your camera for UniWB; (e) you would like to post something sarcastic, demeaning, inflamatory, off-topic or responding in kind to the same.

Sorry; we can't meet everyone's needs in one thread. Do a search and you will find ETTR and UniWB explained in abundance, on DPReview and elsewhere on the 'Net.

12) I'm sorry if these instructions seem either too onerous, narrow, wide or not useful. It's the best I can do. Thank you everyone for your suggestions in the guideline thread:

http://forums.dpreview.com/forums/read.asp?forum=1041&message=42216351

 Chris Noble's gear list:Chris Noble's gear list
Panasonic Lumix DMC-GM5 Panasonic Lumix DC-GX9 Panasonic Lumix G Vario 7-14mm F4 ASPH Panasonic Lumix G 20mm F1.7 ASPH Panasonic Leica Summilux DG 25mm F1.4 +3 more
Jonas B
Jonas B Forum Pro • Posts: 14,597
A boring GCC chart....

....but I hope it fits your thread:

Chris Noble
OP Chris Noble Veteran Member • Posts: 5,493
Jonas GCC chart

Thank you Jonas, very interesting. I will do the same test this weekend and post it. We should all add it to our "get to know your camera" routine!

What type of camera?

I note the halogen light. Can you repeat in daylight?

My summary, tell me if I am wrong:

You exposed 0.5 EV below blinkies in both cases; AWB was 1.25 EV below saturation, UniWB was 0.5 EV below saturation (Green channel dominant). That suggests that your in-camera UniWB JPGs match Raw very closely? Also 2/3 EV "improvement" going from AWB to UniWB using same exposure technique? I mention that because my "default" starting point with my G1 is UniWB, + 2/3 EV compensation, after a lot of trial-error. Maybe just a coincidence.

Thanks again for an interesting example.

 Chris Noble's gear list:Chris Noble's gear list
Panasonic Lumix DMC-GM5 Panasonic Lumix DC-GX9 Panasonic Lumix G Vario 7-14mm F4 ASPH Panasonic Lumix G 20mm F1.7 ASPH Panasonic Leica Summilux DG 25mm F1.4 +3 more
gollywop
gollywop Veteran Member • Posts: 8,301
gollywop_1

Exposure technique: A mode, combination of LV blinkies and post-shot histograms. Using EC, back off onset of LV blinkies one notch, shoot, check post-shot histograms. If histograms show pile on r.h. edge, reshoot down 1/3 EV. Go further, if necessary (usually not). Stop when histograms look good.

Number of shots: 2 for each.

Default processed jpegs and RawDigger histograms:

Evaluation of exposure: (-1/3 to -1/2)

Shot indoors including window on partly sunny day. From the linear histograms, comparing corresponding peaks in the green channel, the AutoWB is down 1/3 EV in the upper regions and 1/2 EV in the shadows.

Processed jpegs and evaluation:

I adjusted them in ACR. I opened one in PS and the other in Bridge so that I could have them both on the screen at the same time. I attempted to equalize the two as much as possible. I began with the AutoWB shot and did my thing with it. I then attempted to obtain the same 'thing' with the UniWB shot.

I used the AutoWB temperature/tint to set WB for the UniWB shot. I picked various points (highlights, mids, shadows) to equalize exposure and brightness. Where possible, I made equal adjustments but made individual adjustments where warranted. I attempted also to make the histograms of the two shots look as similar as possible.

Unlike the other pairs, no matter what I did I was unable to make the AutoWB shot look as good (at least in my estimation) as the UniWB shot. For some reason, it simply lacks "body." The WB adjustment produced better color in the "indoor" area than the AutoWB, and the shadows are better.
--
gollywop

-- hide signature --

Jonas B
Jonas B Forum Pro • Posts: 14,597
Re: Jonas GCC chart + 1 image

Chris Noble wrote:

Thank you Jonas, very interesting. I will do the same test this weekend and post it. We should all add it to our "get to know your camera" routine!

Thank you Chris.
I'm sorry for forgetting about the topic title rule.

What type of camera?

This was with the E-M5

I note the halogen light. Can you repeat in daylight?

Yes. But it would be of little use. Moment... Yes, with the same setup but in daylight I get about the same exposure values from both the WB settings; like 1/20 for AutoWB and 1/15 for UniWB. The difference, around half a stop, is to small for me to really care about in most cases.

My summary, tell me if I am wrong:

You exposed 0.5 EV below blinkies in both cases; AWB was 1.25 EV below saturation, UniWB was 0.5 EV below saturation (Green channel dominant). That suggests that your in-camera UniWB JPGs match Raw very closely? Also 2/3 EV "improvement" going from AWB to UniWB using same exposure technique? I mention that because my "default" starting point with my G1 is UniWB, + 2/3 EV compensation, after a lot of trial-error. Maybe just a coincidence.

You got it right. As I have my camera set to half stops between every step (shutter speed and aperture) and I know I get good images that way I think about the difference as 1 stop. [b]Minor[ b], or partly, blinkies from areas i want not to be burned are OK.

With my method of "measuring" we can conclude 2/3 of a stop only.

Everything matches close enough to make me satisfied.

In daylight the difference between UniWB and AutoWB or DaylightWB decreases; you get the most out of UniWB in candlelight, or from bulbs or halogens (or, of course, when the light is mixed).

I leave the camera at UniWB all the time. There is no need to fiddle around with the WB setting. Here is a sample:

In some ways the image of the old caravan above is typical; mixed light, I didn't want the bright pars to be burned out, I wanted some details in the shadow and I think that is more important the bigger you print. So the camera is set to UniWB and blinkies and the, for me, correct exposure is set in a second.

The blinkies also make it possible to shoot wherever there is a lot of contrast. It's like having an automatically warning spot meter all over the image. Very handy.

Thank you for starting this thread and also for the kindness not saying my sample is boring... !

regards,

Jonas

gollywop
gollywop Veteran Member • Posts: 8,301
gollywop_2

Exposure technique: A mode, combination of LV blinkies and post-shot histograms. Using EC, back off onset of LV blinkies one notch, shoot, check post-shot histograms. If histograms show pile on r.h. edge, reshoot down 1/3 EV. Go further, if necessary (usually not). Stop when histograms look good.

Number of shots: 2 for each.

Default processed jpegs and RawDigger histograms:

Evaluation of exposure: (-2/3 EV)

Shot completely indoors on partly sunny day. Hard to judge upper regions from linear, but comparing shoulders of Logged histograms, AutoWB would seem to be down 2/3 EV. From the linear histograms, AutoWB would appear to be down 1/2 to 2/3 EV depending on channel.

Processed jpegs and evaluation:

I adjusted them in ACR. I opened one in PS and the other in Bridge so that I could have them both on the screen at the same time. I attempted to equalize the two as much as possible. I began with the AutoWB shot and did my thing with it. I then attempted to obtain the same 'thing' with the UniWB shot.

I used the AutoWB temperature/tint to set WB for the UniWB shot. I picked various points (highlights, mids, shadows) to equalize exposure and brightness. Where possible, I made equal adjustments but made individual adjustments where warranted. I attempted also to make the histograms of the two shots look as similar as possible.

These two are very similar (other than the fact that the cat moved his head between shots). The UniWB shot has slightly better shadow detail and structure, but the 2/3 EV difference produces nothing to get excited about.
--
gollywop

-- hide signature --

gollywop
gollywop Veteran Member • Posts: 8,301
gollywop_3

Exposure technique: A mode, combination of LV blinkies and post-shot histograms. Using EC, back off onset of LV blinkies one notch, shoot, check post-shot histograms. If histograms show pile on r.h. edge, reshoot down 1/3 EV. Go further, if necessary (usually not). Stop when histograms look good.

Number of shots: 1 shot for UniWB, 2 for AutoWB.

Default processed jpegs and RawDigger histograms:

Evaluation of exposure: (-2/3 EV)

Shot outdoors, partly sunny day. Results are clear as a bell: AutoWB is down 2/3 EV across the board.

Processed jpegs and evaluation:

I adjusted them in ACR. I opened one in PS and the other in Bridge so that I could have them both on the screen at the same time. I attempted to equalize the two as much as possible. I began with the AutoWB shot and did my thing with it. I then attempted to obtain the same 'thing' with the UniWB shot.

I used the AutoWB temperature/tint to set WB for the UniWB shot. I picked various points (highlights, mids, shadows) to equalize exposure and brightness. Where possible, I made equal adjustments but made individual adjustments where warranted. I attempted also to make the histograms of the two shots look as similar as possible.

Here the differences in the shadows are clearly in favor of UniWB. In general, this is not 'startling.' But the differences at the base of the foliage, particularly just above the corner of the stone wall, are pretty strong.
--
gollywop

-- hide signature --

gollywop
gollywop Veteran Member • Posts: 8,301
gollywop_4

Exposure technique: A mode, I began by trying to use the LV blinkies, but it brecame immediately clear that they were going to be misleading for this scene and lead to significant overexposure. So I began each shot with EC at 0, and checked the post-shot histograms. I then altered EC as necessary (downward in this case) till I got acceptable post-shot histograms.

Number of shots: 1 shot for UniWB, 2 for AutoWB.

Default processed jpegs and RawDigger histograms:

Evaluation of exposure: (-1/3 EV)

indoors at night, incandescent light. AutoWB is down 1/3 in green highlights, down 1/2 in red mids, and a little over 1/2 in the blue shaddows.

Processed jpegs and evaluation:

I adjusted them in ACR. I opened one in PS and the other in Bridge so that I could have them both on the screen at the same time. I attempted to equalize the two as much as possible. I began with the AutoWB shot and did my thing with it. I then attempted to obtain the same 'thing' with the UniWB shot.

I used the AutoWB temperature/tint to set WB for the UniWB shot. I picked various points (highlights, mids, shadows) to equalize exposure and brightness. Where possible, I made equal adjustments but made individual adjustments where warranted. I attempted also to make the histograms of the two shots look as similar as possible.

These final jpegs are very similar. The UniWB shot has slightly better detail in the wood grains and imperfections. It also has slightly better shadow detail.

-- hide signature --

gollywop

-----------

Chris Noble
OP Chris Noble Veteran Member • Posts: 5,493
Re: gollywop_4

Can you blow up a deep shadow area so we can compare the noise?

 Chris Noble's gear list:Chris Noble's gear list
Panasonic Lumix DMC-GM5 Panasonic Lumix DC-GX9 Panasonic Lumix G Vario 7-14mm F4 ASPH Panasonic Lumix G 20mm F1.7 ASPH Panasonic Leica Summilux DG 25mm F1.4 +3 more
Vlad S Veteran Member • Posts: 3,766
could you post 100% crops please

gollywop wrote:

Here the differences in the shadows are clearly in favor of UniWB. In general, this is not 'startling.' But the differences at the base of the foliage, particularly just above the corner of the stone wall, are pretty strong.

I still would like to see the 100% crops of the area that you are talking about, because I can't see the difference in the scaled down versions. And yes, I do have a calibrated, true 8 bit, IPS monitor.

Vlad

 Vlad S's gear list:Vlad S's gear list
Olympus OM-D E-M5 Panasonic Lumix G Vario 14-45mm F3.5-5.6 ASPH OIS Olympus M.Zuiko Digital ED 9-18mm F4.0-5.6 Panasonic Lumix G 20mm F1.7 ASPH Panasonic Lumix G Vario 100-300mm F4-5.6 OIS +2 more
Chris Noble
OP Chris Noble Veteran Member • Posts: 5,493
Red/Blue dominant scenes please?

Most scenes (& these examples) have the Green histogram leading edge to the right of Red and Blue. Could someone post an example or two with strong Reds or Blues and weak Greens? I'll look for one as well but can't in the next few days.

My curiosity is as follows: if WB changes move the 3 colors around a bit without reversing their dominance order on the histogram, I would not expect a big difference between using one WB setting and another -- you are still ETTR-ing the dominant color, and the trailing ones don't matter. But if the dominant color order changes in the transformation from Raw to JPEG, might that result in more dramatic differences in exposure between WB settings?

 Chris Noble's gear list:Chris Noble's gear list
Panasonic Lumix DMC-GM5 Panasonic Lumix DC-GX9 Panasonic Lumix G Vario 7-14mm F4 ASPH Panasonic Lumix G 20mm F1.7 ASPH Panasonic Leica Summilux DG 25mm F1.4 +3 more
gollywop
gollywop Veteran Member • Posts: 8,301
gollywop_5

Exposure technique: M mode, I began by trying to use the LV blinkies with A mode, but with AutoWB the EC bottomed out at -3 and the blinkies kept going. So I switched to M mode at the same aperture, but increased shutter speed till the blinkies stopped. I shot and checked post-shot histograms. I continued to increase shutter speed till the post-shot histograms were appropriate.

Number of shots: 3 shots for UniWB, 2 for AutoWB. Note: In practice I would most likely have gotten the UniWB shot in 2 tries. Once I saw the opening post-shot histogram I knew I'd want two reductions, but, because of this test, I played it conservatively.

Default processed jpegs and RawDigger histograms:

Evaluation of exposure: (-1/3 EV)

indoors at night, shot to include part of light. AutoWB down 1/3 EV across the board.

Processed jpegs and evaluation:

I adjusted them in ACR. I opened one in PS and the other in Bridge so that I could have them both on the screen at the same time. I attempted to equalize the two as much as possible. I began with the AutoWB shot and did my thing with it. I then attempted to obtain the same 'thing' with the UniWB shot.

I used the AutoWB temperature/tint to set WB for the UniWB shot. I picked various points (highlights, mids, shadows) to equalize exposure and brightness. Where possible, I made equal adjustments but made individual adjustments where warranted. I attempted also to make the histograms of the two shots look as similar as possible.

I was surprised how close these two shots were. Again you can see better shadow detail with the UniWB shot, but it's not an overwhelming difference. The AutoWB shot also has more chroma noise, which is best seen in the creamy bottom to the small milk jug. The only way you can really compare these shots is to download them and put them either in ACR/LR or PS together. Since they were taken with a tripod, the a/b toggling will be good.
--
gollywop

-- hide signature --

gollywop
gollywop Veteran Member • Posts: 8,301
Re: gollywop_4

Chris Noble wrote:

Can you blow up a deep shadow area so we can compare the noise?

Chris, please, enough! I've already spent too much time on all this. Please have Vlad PM me the instructions for the drop box, and I'll put the ORFs in there for anyone to examine.

-- hide signature --

gollywop

-----------

rkeller Senior Member • Posts: 1,066
Re: gollywop_4

You make a claim to the forum at large, but are unwilling to provide a simple crop? And you expect people to download full-res files? Strange.

gollywop wrote:

Chris Noble wrote:

Can you blow up a deep shadow area so we can compare the noise?

Chris, please, enough! I've already spent too much time on all this. Please have Vlad PM me the instructions for the drop box, and I'll put the ORFs in there for anyone to examine.

-- hide signature --

"If you simplify your English, you are freed from the worst follies of orthodoxy. You cannot speak any of the necessary dialects, and when you make a stupid remark its stupidity will be obvious, even to yourself." - George Orwell "Politics and the English Language"

"Unfortunately, in digital photography a lot of people are seeing pixels, not photographs ... Everyone together now: it's not the pixels. Sing it with me." - Thom Hogan

"If you pick up a camera with any sort of serious intent, you will at least occasionally need to use a flash. Done deal. Lock solid, Take it to the bank." - Joe McNally

gollywop
gollywop Veteran Member • Posts: 8,301
Re: could you post 100% crops please

Vlad S wrote:

gollywop wrote:

Here the differences in the shadows are clearly in favor of UniWB. In general, this is not 'startling.' But the differences at the base of the foliage, particularly just above the corner of the stone wall, are pretty strong.

I still would like to see the 100% crops of the area that you are talking about, because I can't see the difference in the scaled down versions. And yes, I do have a calibrated, true 8 bit, IPS monitor.

Ok, I relented, but just for these. I'm on vacation, and this is becoming like a job.

-- hide signature --

gollywop

-----------

gollywop
gollywop Veteran Member • Posts: 8,301
Re: gollywop_4

Chris Noble wrote:

Can you blow up a deep shadow area so we can compare the noise?

As I said to Vlad, I'll do these, but please, no more.

-- hide signature --

gollywop

-----------

gollywop
gollywop Veteran Member • Posts: 8,301
100% crops

-- hide signature --

gollywop

-----------

Vlad S Veteran Member • Posts: 3,766
ORFs

gollywop wrote:

Chris, please, enough! I've already spent too much time on all this. Please have Vlad PM me the instructions for the drop box, and I'll put the ORFs in there for anyone to examine.

I have PMed you the login info. I think your own final images are of more value than ORFs, becuase it helps to see what amount of benefit the original photographer could put to use, rather than what exists in the RAW file.

Vlad

 Vlad S's gear list:Vlad S's gear list
Olympus OM-D E-M5 Panasonic Lumix G Vario 14-45mm F3.5-5.6 ASPH OIS Olympus M.Zuiko Digital ED 9-18mm F4.0-5.6 Panasonic Lumix G 20mm F1.7 ASPH Panasonic Lumix G Vario 100-300mm F4-5.6 OIS +2 more
Vlad S Veteran Member • Posts: 3,766
Anyone else can comment on the differences?

gollywop wrote:

Ok, I relented, but just for these. I'm on vacation, and this is becoming like a job.

Thank you for posting these. I appreciate your taking time from your vacation (no sarcasm), but I guess your passion keeps you in this forum...

I can barely tell that the images are ever so slightly different, but I can't really pick which one is better. I think that UniWB has a little more contrast in the shadows, but the AutoWB has a little more detail. But if I did not see the file names I really would not be able to tell which is which.

Anyone else care to comment on the differences between these crops?

 Vlad S's gear list:Vlad S's gear list
Olympus OM-D E-M5 Panasonic Lumix G Vario 14-45mm F3.5-5.6 ASPH OIS Olympus M.Zuiko Digital ED 9-18mm F4.0-5.6 Panasonic Lumix G 20mm F1.7 ASPH Panasonic Lumix G Vario 100-300mm F4-5.6 OIS +2 more
gollywop
gollywop Veteran Member • Posts: 8,301
Re: Anyone else can comment on the differences?

Vlad S wrote:

gollywop wrote:

Ok, I relented, but just for these. I'm on vacation, and this is becoming like a job.

Thank you for posting these. I appreciate your taking time from your vacation (no sarcasm), but I guess your passion keeps you in this forum...

I can barely tell that the images are ever so slightly different, but I can't really pick which one is better. I think that UniWB has a little more contrast in the shadows, but the AutoWB has a little more detail. But if I did not see the file names I really would not be able to tell which is which.

Anyone else care to comment on the differences between these crops?

The best thing you can do is download both images (largest size) into ACR or LR. Then you can a/b them with the up/down arrows at full screen (press space bar).

-- hide signature --

gollywop

-----------

Keyboard shortcuts:
FForum MMy threads