Litcius/Paper detail

A-PixelHop: A Green, Robust and Explainable Fake-Image Detector

Yao Zhu, Xinyu Wang, Hong-Shuo Chen, Ronald Salloum, C.‐C. Jay Kuo

2022ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)18 citationsDOI

Abstract

A novel method for detecting CNN-generated images, called Attentive PixelHop (or A-PixelHop), is proposed in this work. It has three advantages: 1) low computational complexity and a small model size, 2) high detection performance against a wide range of generative models, and 3) mathematical transparency. A-PixelHop is designed under the assumption that it is difficult to synthesize high-quality, high-frequency components in local regions. It contains four building modules: 1) selecting edge/texture blocks that contain significant high-frequency components, 2) applying multiple filter banks to them to obtain rich sets of spatial-spectral responses as features, 3) feeding features to multiple binary classifiers to obtain a set of soft decisions, 4) developing an effective ensemble scheme to fuse the soft decisions into the final decision. Experimental results show that A-PixelHop outperforms state-of-the-art methods in detecting CycleGAN-generated images. Furthermore, it can generalize well to unseen generative models and datasets.

Topics & Concepts

Computer scienceFuse (electrical)Artificial intelligenceTransparency (behavior)Pattern recognition (psychology)Generative grammarBinary numberDetectorRange (aeronautics)Image (mathematics)Set (abstract data type)Filter (signal processing)Binary decision diagramMultiple ModelsComputer visionAlgorithmMathematicsEngineeringElectrical engineeringTelecommunicationsProgramming languageMaterials scienceArithmeticComposite materialComputer securityGenerative Adversarial Networks and Image SynthesisDigital Media Forensic DetectionAdversarial Robustness in Machine Learning