Interesting... If you delete the 'index' on a drive, or card, you can
still recover image data that has not been erased. If I format a card
in my 30D, or 40D, I cannot recover image data with external apps.
Do you mean deleting a file, which in turn means deleting the index entry of the file from the table of contents, instead of deleting the index on a drive?
Why is that? Are you certain that your info is current? Do you really
know what happens in a 30D, or a 40D when you format a card, or are
you just guessing?
In brief, FAT file system is made up of a few parts. Specifically, the partition record, the file allocation table, the root directory, and data portion.
When you delete a file, what happens is that the first character of the filename is overwritten, and the space it occupied is marked as available. However, all the information of the file is still there. As long as nothing new (e.g. a new file) is written to the device, you can recover everything except the first character of the filename.
If you delete the entire folder, it becomes more challenging to recover the file. But it should still be possible to do so.
If, however, you overwrite the root directory (as when you do a camera format, or a quick format), you overwrite the entire entry. A file recovery program will need to scan through the entire device to search for subfolders, or the actual data itself. I believe I read in your other posts that you use extremely large CF cards, perhaps that may be why it is hard for you to recover images from a formatted card?
I do not know how wear levelling and (to a smaller extent) bad block management, as implemented by the CF controller, may impact the recovery of the data. Anything I post on this topic will be pure guesswork so I won't waste my time and yours by speculating here.
I think you might be guessing, and I think you are missing something
in the way of current understanding. Show me. Describe in detail how
recent Canon DSLR's format their installed cards. I don't mean
"repeat what you have been told". I would like for you to offer a
school session on how Canon really formats camera mounted cards.
My reasoning is based on educated guess. I do have experience working with file systems at a byte level. It is reasonable (to me) to assume that Canon merely overwrites the partition record, FAT and root directory. To overwrite the entire flash card is unnecessary, time consuming and reduces the lifespan of the card. Even at UDMA speeds, you need 50 seconds to completely overwrite a 2GB flash.
I can find out exactly what happens when a card is formatted, but I don't believe it is necessary to know the details in this case. I can instruct you as to how to discover it for yourself if you are really curious. Instead of doing that, I would suggest you try out some other recovery utilities instead, to see which one can pull your images out of a formatted card. That would be much more useful knowledge. And, sadly, I do not know the answer to this one. I tested a number of recovery applications about 2 years ago, but I've forgotten which one I tried and which worked. In the end I had to do a raw dump of the entire CF and go through it manually.
Sarcasm towards others who don't agree with you does not reflect very well on you. Actually, I'm not even sure what we don't agree about.
Let's see.
1. Formatting is different from deleting. I think we agree here.
2. Formatting does no harm. I think we agree here too.
3. Formatting is good. I agree, more or less. But I won't say it's the same as playing Russian Roulette with your images if you don't format after every download.
Come to think of it, maybe I can convince you that formatting is bad. According to you, if you format, you cannot recover the data. In that case, wouldn't it be better for you to delete rather than format, on the very slim chance you might need to recover your image (say, accidentally deleted from hard disk and discovered before you shot any new photos)?
By the way, I have encountered files corrupted when they are being read using a card reader. Very rare, but it did happen.
I guess the only point we don't agree on is that it is OK to just delete. I think we can both agree to each his or her own on this though.