Litcius/Paper detail

Generate, Segment, and Refine: Towards Generic Manipulation Segmentation

Peng Zhou, Bor-Chun Chen, Xintong Han, Mahyar Najibi, Abhinav Shrivastava, Ser-Nam Lim, Larry S. Davis

2020Proceedings of the AAAI Conference on Artificial Intelligence137 citationsDOIOpen Access PDF

Abstract

Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have resulted in a large quantities of manipulated images being shared on the internet. While the intent behind such manipulations varies widely, concerns on the spread of false news and misinformation is growing. Current state of the art methods for detecting these manipulated images suffers from the lack of training data due to the laborious labeling process. We address this problem in this paper, for which we introduce a manipulated image generation process that creates true positives using currently available datasets. Drawing from traditional work on image blending, we propose a novel generator for creating such examples. In addition, we also propose to further create examples that force the algorithm to focus on boundary artifacts during training. Strong experimental results validate our proposal.

Topics & Concepts

Computer scienceFocus (optics)Generator (circuit theory)SegmentationArtificial intelligenceImage editingProcess (computing)SoftwareImage segmentationThe InternetMisinformationFalse positive paradoxImage (mathematics)Machine learningComputer visionComputer securityWorld Wide WebPower (physics)Operating systemProgramming languageOpticsQuantum mechanicsPhysicsDigital Media Forensic DetectionAdversarial Robustness in Machine LearningGenerative Adversarial Networks and Image Synthesis