Researchers follow the noise to find composite images
Researchers at the University of Albany have developed an efficient and automatic process for identifying composite images, based on the different noise patterns between the two images. In a paper presented at the IEEE's International Conference on Computational Photography, a team led by Siwei Lyu showed they were able to find and locate composited material in images from an online 'Photoshopping' contest site worth1000.com. The team's algorithm exploits the tendency for image noise (regardless of source) to have a characteristic shape (kurtosis). Scanning the image for areas with different noise patterns allows the system to identify non-original content.
|The original image from the contest website Worth1000.com||The same image, overlaid with the added areas identified by the algorithm.|
Because the process is based on analysis of noise, the authors concede it can't identify images with cloning or similar shots from the same camera, and struggles with downsized and heavily-compressed images that have lost their underlying noise characteristics. However, they hope to extend their work by improving its ability to distinguish between local image detail and noise, to improve its accuracy and provide improved noise reduction methods.
The group's research paper can be read here. Non statisticians may wish to look at Figure 4 to see how successful the system was in identifying added-in regions. As the authors point out,'Note that these forgeries are carefully manipulated and processed and have realistic appearance, many can only be exposed based on conceptual knowledge of the physical world (e.g., hippopotamus is unlikely to be found in arctic regions).' Figure 2, which shows the system's success at isolating intentionally introduced noise, hints at the benefits the system could bring to context-sensitive noise-reduction, with further work.
- Canon EOS M58.8%
- Panasonic G85/G803.3%
- Panasonic FZ2500/FZ20001.9%
- Panasonic LX10/LX151.2%
- Panasonic GH5 development3.6%
- Sony a99 II15.9%
- Nikon KeyMission 170 and 801.0%
- Fujifilm GFX 50S development28.3%
- Olympus E-M1 II development18.7%
- Olympus E-PL80.1%
- Olympus 25mm F1.2 Pro1.5%
- Olympus 12-100mm F4 IS Pro1.9%
- Olympus 30mm F3.5 Macro0.1%
- Sigma 85mm F1.4 Art3.6%
- Sigma 12-24mm F4 Art2.6%
- Sigma 500mm F4 DG OS HSM Sport2.4%
- YI M12.2%
- GoPro Hero50.8%
- GoPro Karma drone2.2%