Detecting false captioning using common-sense reasoning

Sangwon Lee, David A. Shamma, Bruce Gooch

Research output: Contribution to conferencePaper

2 Citations (Scopus)

Abstract

Detecting manipulated images has become an important problem in many domains (including medical imaging, forensics, journalism and scientific publication) largely due to the recent success of image synthesis techniques and the accessibility of image editing software. Many previous signal-processing techniques are concerned about finding forgery through simple transformation (e.g. resizing, rotating, or scaling), yet little attention is given to examining the semantic content of an image, which is the main issue in recent image forgeries. Here, we present a complete workflow for finding the anomalies within images by combining the methods known in computer graphics and artificial intelligence. We first find perceptually meaningful regions using an image segmentation technique and classify these regions based on image statistics. We then use AI common-sense reasoning techniques to find ambiguities and anomalies within an image as well as perform reasoning across a corpus of images to identify a semantically based candidate list of potential fraudulent images. Our method introduces a novel framework for forensic reasoning, which allows detection of image tampering, even with nearly flawless mathematical techniques.

Original languageEnglish
PagesS65-S70
DOIs
Publication statusPublished - 2006 Dec 1
Event6th Annual Digital Forensic Research Workshop, DFRWS 2006 - Lafayette, IN, United States
Duration: 2006 Aug 142006 Aug 16

Other

Other6th Annual Digital Forensic Research Workshop, DFRWS 2006
CountryUnited States
CityLafayette, IN
Period06/8/1406/8/16

All Science Journal Classification (ASJC) codes

  • Information Systems

Fingerprint Dive into the research topics of 'Detecting false captioning using common-sense reasoning'. Together they form a unique fingerprint.

  • Cite this

    Lee, S., Shamma, D. A., & Gooch, B. (2006). Detecting false captioning using common-sense reasoning. S65-S70. Paper presented at 6th Annual Digital Forensic Research Workshop, DFRWS 2006, Lafayette, IN, United States. https://doi.org/10.1016/j.diin.2006.06.006