Application for checking integrity of photos/backups?

Trk

Forum Enthusiast
Messages
460
Reaction score
237
Do you use any application for checking that photos and or backups have not been changed or corrupted? Can you recommend something?
 
I'm flushing this up as it seems to be one of the easiest and safest ways of checking if old files are changing.

Run the old files against the backups and be alerted to anything that has altered.

FreeFileSync.

Read Skyglider's test. It convinced me.

Tony
I cannot use this technique because I am backing up files compressed, because in terrabyte scale it saves tens of gigabytes here and there.

Also comparing set of files is uncomfortable lengthy operation. One of my backup drives is slower 3TB drive that I was indexing 12 hours, comparing method would incur additional processing time.

Also I will have to stick to checksumming method because I read that Microsoft resilient filesystem cannot be used on removable drives, I will not setup Unix servers and whatnot for backups for sure and RAID is unreliable and not resilient to filesystem corruptions.

I tried freefilesync and it is nice program, but I want everything automatic = once setup and not to care about anything anymore.
 
I'm flushing this up as it seems to be one of the easiest and safest ways of checking if old files are changing.

Run the old files against the backups and be alerted to anything that has altered.

FreeFileSync.

Read Skyglider's test. It convinced me.

Tony
I cannot use this technique because I am backing up files compressed, because in terrabyte scale it saves tens of gigabytes here and there.

Also comparing set of files is uncomfortable lengthy operation. One of my backup drives is slower 3TB drive that I was indexing 12 hours, comparing method would incur additional processing time.

Also I will have to stick to checksumming method because I read that Microsoft resilient filesystem cannot be used on removable drives, I will not setup Unix servers and whatnot for backups for sure and RAID is unreliable and not resilient to filesystem corruptions.

I tried freefilesync and it is nice program, but I want everything automatic = once setup and not to care about anything anymore.
Will the following plan work for you?
  1. Transfer photos from SD card to hard drive using FreeFileSync. FreeFileSync's content compare will verify that all of the photos were transferred from the SD card error free. One would want the photos initially stored on the hard drive the same as they are stored on the SD card (not compressed) to be able to cull and post process the photos.
  2. Keep your photos in folders in a "data" partition. Then backup the data partition using your backup software with compression and the "Validate" option which uses the check summing method.
Note that using check summing validation only checks for errors from memory to the storage device. One must use a byte-for-byte validation to check for errors from the source drive to memory.

Using Image for Windows to backup, selecting validate byte-for-byte does both.

Sky
 
Last edited:
Do you use any application for checking that photos and or backups have not been changed or corrupted? Can you recommend something?
Check out fixity. Avpreserve.com
Thank you for tip. It looks like program checks metadata of files only which is strange feature and logic, because it takes longer to check metadata than just calculate checksums for files.

Also I never change metadata of raw images (I do not save e.g. development information in raw file nor sidecar files).

Positive is that it is free software :-)
Fixity calculates checksums, finds changed, new and deleted files. It can be scheduled, generates reports and send email notifications.
 
Fixity calculates checksums, finds changed, new and deleted files. It can be scheduled, generates reports and send email notifications.
Looks like nice utility, but not very user friendly. I have first version of utility that I am using now, it is available at Utility download (portable, requires .NET 4.5), everything is done there with one or two mouse clicks.
 
Last edited:
I've tried to install freefilesync before and it had the opencandy malware in the installer. I just checked the latest download and it's still there. I don't recall if the program can be installed without installing the malware. I tried to see if there was a way to opt out of the OpenCandy part, but didn't see one in the first couple of screens, before I let Malwarebytes remove it.





file downloaded today, 6-23-15
file downloaded today, 6-23-15



--
When is it "Okay" to be mean, petty or unethical?
-
my gallery of so-so photos
 
I've tried to install freefilesync before and it had the opencandy malware in the installer. I just checked the latest download and it's still there. I don't recall if the program can be installed without installing the malware. I tried to see if there was a way to opt out of the OpenCandy part, but didn't see one in the first couple of screens, before I let Malwarebytes remove it.
More and more free software are including OpenCandy as part of the install. Here's a Wikipedia write up on OpenCandy. It includes a list of applications known to use or have used OpenCandy.

https://en.wikipedia.org/wiki/OpenCandy

If OpenCandy installs with a free software, MalwareBytes normally flags it for removal. Can also use Control Panel > Programs and Features to uninstall it. No harmful effects that I'm aware of but if anyone knows of any, please do let us know.

Thanks,
Sky
 
Mine is clean, Kerry.

You forgot to tell us which site you downloaded it from.
Ah, sorry. I went to the freefilesync site, https://www.freefilesync.org/ clicked on the download button which opened another page on their site, https://www.freefilesync.org/download.php , where I clicked on the download button again and was redirected to FossHub, http://www.fosshub.com/FreeFileSync.html where all the different versions were found. I clicked on the Windows version on that page.

Since I got mine from the author's site, how did you get one that was up to date (version 7.1) and clean?

Kerry
 
I've tried to install freefilesync before and it had the opencandy malware in the installer. I just checked the latest download and it's still there. I don't recall if the program can be installed without installing the malware. I tried to see if there was a way to opt out of the OpenCandy part, but didn't see one in the first couple of screens, before I let Malwarebytes remove it.
More and more free software are including OpenCandy as part of the install. Here's a Wikipedia write up on OpenCandy. It includes a list of applications known to use or have used OpenCandy.
Yes, I've encountered a few "free" programs that use OpenCandy or some other adware type of additional program in their installer. Usually, you have an option to turn that stuff off, before the programs are installed. I didn't see a way to turn off OpenCandy in the Freefilesync 7.1 installer, but I didn't go all the way through the installation.
That is interesting, if incomplete. I did find their info on how to bypass OpenCandy useful. I used their /nocandy switch on the commandline, to run the installer and it seems to have worked fine. Malwarebytes didn't object to the install, like it did before and I couldn't find OpenCandy in any of the installed programs in the Control Panel.

Even so, IMO, it's pretty sad that one has to go to such lengths to prevent malware or adware from being installed on one's computers. Since the author of freefilesync uses such devious methods to make money, it is certain that if I like/use the program, I'll never donate money to him and I'll continue to look for and use other programs that don't do those things in their installers.
If OpenCandy installs with a free software, MalwareBytes normally flags it for removal. Can also use Control Panel > Programs and Features to uninstall it. No harmful effects that I'm aware of but if anyone knows of any, please do let us know.
Lots of stuff like that isn't "harmful", but that doesn't mean one should simply ignore it, does it? I don't like it when people try to install programs onto my systems without my consent or knowledge. I especially don't like it when those programs spy on me or do other activities without my approval or knowledge. That's why I buy and use Malwarebytes and other such utilities.

Of course, that's my prerogative. Others can and should do as they wish.

Kerry
 
Since the author of freefilesync uses such devious methods to make money

That is a strong statement to make on a public forum, Kerry.

Are you sure of your facts?

Tony
 
Since the author of freefilesync uses such devious methods to make money

That is a strong statement to make on a public forum, Kerry.

Are you sure of your facts?
I saw what I saw. If you dispute what I saw, say so. If you don't agree with my conclusions, that's okay. Like I said, others are free to do as they wish with such programs.

Kerry
 
Mine is clean, Kerry.

You forgot to tell us which site you downloaded it from.

Tony
It's not a matter of the download site wrapping it in a custom installer with adware.

The freefilesync developer is using an OpenCandy installer now (that started with one of the 6.x releases, and current releases still use it).

Of course, the developer tries to justify it, as you can see from multiple sections about it in the installation section of the FAQ now;


If you're very careful, you should be able to find a way to 'opt out" of any extras. But, with OpenCandy, different offers and screens may show up for different users (based on what is already installed on a given machine, etc.), and sometimes how ot opt out of one is confusing. IOW, sometimes you may need to use a Custom Install choice, then make sure to uncheck the buttons for the extras that are enabled by default. Other times, hyou may need to click NO or similar, etc.

As already mentioned by Kerry, you can also start the installer from a command prompt using a /NONCANDY parameter after the .exe name to avoid any offers for extras. See this page for more details on avoiding the offers:


If you accidentally install any extras (usually some form of adware, with some of it pretty bad with browser hijacking, interception of search results, etc), see this post with instructions on removing it, with links to very good utilities for that purpose (adwcleaner, alwarebytes anti-malware free, hitman pro)

 
See posts about it in this thread from June 2014

http://www.dpreview.com/forums/post/53889058

The developer of FreeFileSync has been using an OpenCandy based installer since before that post was made, and it installs "extras" (usually some form of browser hijacker with adware) by default unless you are *very* careful to use a Custom Installation and uncheck the boxes beside the "offers" being made.

Of course, OenCandy "sugar coats" it, making it sound like they;re offering you great ;products, etc. Yea, right. Tell users that have their browsers hijjacked that, especially when they get modified search results with links to products being promoted, popups, etc. with a lot of the adware that can be installed.

The developer could have set it up as an "opt in" versus "opt out" installer, as OpenCandy allows the developer control over that part.

But, in the case of FreeFilSync (when I've tested it's installer in the past), it's setup to use an "opt out" versus "opt in" setup (meaning you can end up with an adware infested machine if you're not very careful to use a Custom Installation and uncheck the boxes for any extras).

Developers like to think using OpenCandy is OK, and it looks like the FreeFileSync developer goes to great lengths to try and justify it's use in the product's FAQ.

Of course, a typical user that downloads and installs it is probably not going to notice that it's including adware by default until after they start seeing the symptoms, much less dig through the product's FAQs before installing it and paying any attention to the sections about it using OpenCandy.

--
JimC
------
 
Last edited:
Will the following plan work for you?
  1. Transfer photos from SD card to hard drive using FreeFileSync. FreeFileSync's content compare will verify that all of the photos were transferred from the SD card error free. One would want the photos initially stored on the hard drive the same as they are stored on the SD card (not compressed) to be able to cull and post process the photos.
  2. Keep your photos in folders in a "data" partition. Then backup the data partition using your backup software with compression and the "Validate" option which uses the check summing method.
Note that using check summing validation only checks for errors from memory to the storage device. One must use a byte-for-byte validation to check for errors from the source drive to memory.

Using Image for Windows to backup, selecting validate byte-for-byte does both.

Sky
This procedure does not solve what I want. Copy with verification do almost all filemanagers, I tried freefilesync and it is not only malicious, infested with adware, but also user unfriendly.

I transfer data from sdcard with verification, backup with verification and on top of this i am using own app which i developed in couple of days to checksum/verify everything periodically and automatically.

As others pointed out the best way is zfs or btrfs, but I refuse to deploy unix servers at my home just for backups.
 
Until I read this thread I was not aware that FFS was installing that malware. Maybe it didn't when I first downloaded it.

I did an upgrade in early June.

I have just looked at my MalwareBytes log and see that it picked up the virus, at the time I did the upgrade, and isolated it without my knowing. Probably I could set MB to display the log of problems it finds every time it picks one up - but as long as it does the job secretly and silently it is good enough for me.

Bonus point then for MalwareBytes!

Tony
 
... Bonus point then for MalwareBytes!
I'll second that.

After reading about OpenCandy in this thread, I looked at my MalwareBytes quarantine list and sure enough, several copies of OpenCandy were locked up behind bars. I'd never even heard of OpenCandy until this thread.

Tom
 
When I backup photos I simply re-load them in DPP and quickly check that thumbnails are created.

This is not a 100% check but it's good enough for me. I do this with all my backups -
2 x HDD, 2 x DVD. The chances of that not working is miniscule these days and hey, there
only photos. I spin the HDDs up at least every 6 months.

I used to write the DVDs at a slower speed but our tech at work said they should be done
at the recommended speed ??

Of course a checksum is the best. Windows should give you that option every time a file
is copied. That would be the quickest time to do it as it's reading the original anyway.
 
Last edited:

Keyboard shortcuts

Back
Top