Action to fix 5D II black dots...

Started Dec 7, 2008 | Discussions
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Action to fix 5D II black dots...
Dec 7, 2008

Since it will probably take some time for
Canon to fix this problem, I played around
with Photoshop and put together a small
action that will fix the black spots to the
right of blown highlights:

http://ray.cg.tuwien.ac.at/rft/Photography/TipsAndTricks/5D-BlackSpots/

Note that I did not add any examples, since
I do not own a 5D II yet. You are welcome
to try the action on all the samples in the
various threads. I have done so, and the action
seems to fix most instances.

Note however, that it is not possible to correctly
identify all instances of black spots, and thus
the action will sometimes fail to correct a small
number of black spots, and will incorrectly affect
some regions with out black spots. I have tried
to make the action as discriminately as possible
but as always your milage may vary...

Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
apixel
Contributing MemberPosts: 591
Like?
Re: Action to fix 5D II black dots...
In reply to Robert F. Tobler, Dec 7, 2008

Thanks for making the action. Unfortunately, this is what I get when I follow your link:

Could not handle request for path ' rft/Photography'

Traceback (most recent call last):
File " home/xtpy/Server/Server.py", line 187, in handle_http_request
(format, response) = \
File "
home/xtpy/Server/Standard.py", line 214, in handle_request
page.output(env, out)
File " home/xtpy/Server/Nodes.py", line 1067, in output
output_text(page.text, env, out)
File "
home/xtpy/Server/Nodes.py", line 441, in output_text
item.output(env, out)
File " home/xtpy/Server/Nodes.py", line 2127, in output
output_text(value, env, out)
File "
home/xtpy/Server/Nodes.py", line 443, in output_text
text.output(env, out)
File " home/xtpy/Server/Nodes.py", line 609, in output
if self.text: output_text(self.text, env, out)
File "
home/xtpy/Server/Nodes.py", line 441, in output_text
item.output(env, out)
File " home/xtpy/Server/Nodes.py", line 2127, in output
output_text(value, env, out)
File "
home/xtpy/Server/Nodes.py", line 443, in output_text
text.output(env, out)
File " home/xtpy/Server/Nodes.py", line 609, in output
if self.text: output_text(self.text, env, out)
File "
home/xtpy/Server/Nodes.py", line 441, in output_text
item.output(env, out)
File " home/xtpy/Server/Nodes.py", line 2127, in output
output_text(value, env, out)
File "
home/xtpy/Server/Nodes.py", line 441, in output_text
item.output(env, out)
File " home/xtpy/Server/Nodes.py", line 2127, in output
output_text(value, env, out)
File "
home/xtpy/Server/Nodes.py", line 443, in output_text
text.output(env, out)
File " home/xtpy/Server/Nodes.py", line 609, in output
if self.text: output_text(self.text, env, out)
File "
home/xtpy/Server/Nodes.py", line 441, in output_text
item.output(env, out)
File " home/xtpy/Server/Nodes.py", line 1120, in output
Counter.write_counter(count_file_name, counter)
File "
home/xtpy/Server/Counter.py", line 42, in write_counter
count_file = open(count_file_name, "w")

IOError: [Errno 13] Permission denied: ' var/www/htdocs/rft/Photography/TipsAndTricks/5D-BlackSpots/xtpy/index.cnt'
--
------------
Photo gallery at: http://www.fotophoto.net/

Reply   Reply with quote   Complain
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Should now be accessible...
In reply to apixel, Dec 7, 2008

... thanks for the bug report and sorry for
the inconvenience. Please try again now.

Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
Reply   Reply with quote   Complain
Dave
Contributing MemberPosts: 570
Like?
Re: Should now be accessible...
In reply to Robert F. Tobler, Dec 7, 2008

Hi,

This is great, after reading many threads on the BD's I thought it might be possible to post process them out.

Thanks for the action and all your hard work.

My 5D mkii is still on order.

Regards
Dave

Reply   Reply with quote   Complain
DuncanM1
Contributing MemberPosts: 762
Like?
Re: Should now be accessible...
In reply to Dave, Dec 7, 2008

Dave wrote:

Hi,
This is great, after reading many threads on the BD's I thought it
might be possible to post process them out.

Thanks for the action and all your hard work.

My 5D mkii is still on order.

Regards
Dave

You are actually going to buy a DSLR that you know is defective, possibly at the sensor level, and rely on PP to remove the defects? I think you are taking brand loyalty to new extremes.

Reply   Reply with quote   Complain
stuart melnikoff
Regular MemberPosts: 269
Like?
Black Dot Action
In reply to Robert F. Tobler, Dec 8, 2008

Thanks for the assist!

Reply   Reply with quote   Complain
Jbrose
Regular MemberPosts: 274
Like?
Re: Black Dot Action
In reply to stuart melnikoff, Dec 8, 2008

Another poster actually found that the black dots are getting produced with a combination of camera settings, so really not a defecting camera as some people are crying. Nice to have actions to cure the problem if a person still uses those settings though.

Reply   Reply with quote   Complain
DuncanM1
Contributing MemberPosts: 762
Like?
Re: Black Dot Action
In reply to Jbrose, Dec 8, 2008

Actually the problem is occurring in RAW file output, so there is no way for a user to do more than retouch the resulting images. This is a sensor/firmware issue.

Reply   Reply with quote   Complain
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Version 1.1...
In reply to Robert F. Tobler, Dec 8, 2008

... has been tweaked to slightly increase
the number of cases that can be fixed.

http://ray.cg.tuwien.ac.at/rft/Photography/TipsAndTricks/5D-BlackSpots/

Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
Reply   Reply with quote   Complain
zegrea
Forum MemberPosts: 61Gear list
Like?
Re: Action to fix 5D II black dots...
In reply to Robert F. Tobler, Dec 8, 2008

It works also on the PS for WINDOWS ?

 zegrea's gear list:zegrea's gear list
Phase One Capture One Pro
Reply   Reply with quote   Complain
bunyarra
Contributing MemberPosts: 748
Like?
Re: Black Dot Action
In reply to DuncanM1, Dec 8, 2008

DuncanM1 wrote:

Actually the problem is occurring in RAW file output, so there is no
way for a user to do more than retouch the resulting images. This is
a sensor/firmware issue.

Ah .. a Canon employee finally speaks on the issue. I'll send back my 5d II (that I have yet to take a photo with showing these black dots). Please provide the RMA. And thanks for designing such a great camera for a very sensible price.

Oh yes - not forgetting that pixel peepers have never printed anything that also showed this artifact.

Yup - love to have it not happen and I am sure it will be fixed. Pending that, I'll probably just get back to .. shock .. taking photos and .. bigger shock .. printing them.

-- hide signature --
Reply   Reply with quote   Complain
Bluestar_
Forum MemberPosts: 85
Like?
Re: Black Dot Action
In reply to bunyarra, Dec 8, 2008

do you really think any stock agency prints submitted photos?

do you believe anyone buying those pictures online will believe that the problems will not show up in print?

when you buy a new car and it's scratched do you accept when the dealer tells you - but the scratches only show up when you look really close?

i for one don't want to have to pp for problems that should not be there in the first place.

Oh yes - not forgetting that pixel peepers have never printed
anything that also showed this artifact.

Yup - love to have it not happen and I am sure it will be fixed.
Pending that, I'll probably just get back to .. shock .. taking
photos and .. bigger shock .. printing them.

Reply   Reply with quote   Complain
Tom Melanson
Senior MemberPosts: 1,214Gear list
Like?
Re: Should now be accessible...
In reply to DuncanM1, Dec 8, 2008

You're quite right.

I ordered one before this problem became known.
This "black dot" business is going to put a black eye on Canon's reputation.

Had I known about this issue I would not have ordered it. To do so after knowing about this serious lack of QC would indeed be taking brand loyalty to extremes.
Tom

http://www.lookand.se
http://davebrown212.fotopic.net/

You are actually going to buy a DSLR that you know is defective,
possibly at the sensor level, and rely on PP to remove the defects? I
think you are taking brand loyalty to new extremes.

-- hide signature --

(See equipment list under 'profile')

 Tom Melanson's gear list:Tom Melanson's gear list
Canon EOS-1Ds Mark II Canon EOS 7D Canon EOS 5D Mark III Canon EF 85mm f/1.8 USM Canon EF 135mm f/2.0L USM +9 more
Reply   Reply with quote   Complain
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Version 2.0...
In reply to Robert F. Tobler, Dec 9, 2008

...of my action to fix the black dots has
been uploaded:

http://ray.cg.tuwien.ac.at/rft/Photography/TipsAndTricks/5D-BlackSpots/

It is now slightly more discriminate about
what represents a real black dot, and tries to
avoid reducing the highlight size when
correcting the black dots.

I have tried it on most of the samples that
float around in this forum, and it seems to
do a decent job on all of those (in my
opinion... but I might be biased

Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
Reply   Reply with quote   Complain
wildlife1212
Senior MemberPosts: 1,109
Like?
Canon will include this in 5DII box in the next shipping
In reply to Robert F. Tobler, Dec 9, 2008

any way
I am impressed your PS knowledge

Reply   Reply with quote   Complain
Shamus1
Senior MemberPosts: 1,601Gear list
Like?
Re: Version 2.0...
In reply to Robert F. Tobler, Dec 10, 2008

Unfortunately running CS2 so looks like the action will have to wait for my CS4 update

I'm sure many do appreciate your work...

 Shamus1's gear list:Shamus1's gear list
Canon EOS-1D Mark III Canon EOS 7D Canon EOS-1D Mark IV Canon EOS 5D Mark III Adobe Photoshop CS6 +2 more
Reply   Reply with quote   Complain
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Re: Version 2.0...
In reply to Shamus1, Dec 10, 2008

Shamus1 wrote:

Unfortunately running CS2 so looks like the action will have to wait
for my CS4 update

I have stated the discalimer about CS3/CS4 only
because I cannt test it on CS2. Maybe you could
try it, and tell me if it works. If it does I will
change the disclaimer.

Thanks and Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
Reply   Reply with quote   Complain
weigertj
Forum MemberPosts: 71
Like?
Re: Action to fix 5D II black dots...
In reply to Robert F. Tobler, Dec 10, 2008

Nice job!

Imagine, if you could fix it with a PS action Canon should be able to fix it with an in-camera post-processing "action" after a firmware update. It may be not the real solution of the existing problem but who will find it out?

-- hide signature --
Reply   Reply with quote   Complain
Victor Engel
Forum ProPosts: 15,200Gear list
Like?
Re: Action to fix 5D II black dots...
In reply to Robert F. Tobler, Dec 10, 2008

Robert F. Tobler wrote:

Note however, that it is not possible to correctly
identify all instances of black spots,

Isn't it? The black spots have raw values lower than true black. If the raw data can be converted in such a way that the black level is low enough, only these black spots will have the lowest values.

-- hide signature --

http://www.pbase.com/victorengel/

5 D M a r k I I : Very multi-promise cabbage soup!

 Victor Engel's gear list:Victor Engel's gear list
Canon EOS 600D Canon EF 50mm f/1.8 II Canon EF 135mm f/2.0L USM Canon EF 300mm f/4.0L IS USM Canon EF 100-400mm f/4.5-5.6L IS USM +7 more
Reply   Reply with quote   Complain
Robert F. Tobler
Senior MemberPosts: 1,007Gear list
Like?
Re: Action to fix 5D II black dots...
In reply to Victor Engel, Dec 10, 2008

Victor Engel wrote:

Robert F. Tobler wrote:

Note however, that it is not possible to correctly
identify all instances of black spots,

Isn't it? The black spots have raw values lower than true black. If
the raw data can be converted in such a way that the black level is
low enough, only these black spots will have the lowest values.

The key word here is "raw values". In a Photoshop
action I do not have access to these raw values. I
can only work on the image data as already imported
into Photoshop.

Of course, a Canon fix, or a fix built into a raw converter
could correctly identify all black spots.

Greetings,
--
Robert F. Tobler
http://ray.cg.tuwien.ac.at/rft/Photography/

 Robert F. Tobler's gear list:Robert F. Tobler's gear list
Sigma DP1 Merrill Sigma DP2 Merrill Sigma DP3 Merrill
Reply   Reply with quote   Complain
Keyboard shortcuts:
FForum MMy threads