Litcius/Paper detail

Deepfake Video Detection Based on MesoNet with Preprocessing Module

Zhiming Xia, Tong Qiao, Ming Xu, Xiaoshuai Wu, Han Li, Yunzhi Chen

2022Symmetry49 citationsDOIOpen Access PDF

Abstract

With the development of computer hardware and deep learning, face manipulation videos represented by Deepfake have been widely spread on social media. From the perspective of symmetry, many forensics methods have been raised, while most detection performance might drop under compression attacks. To solve this robustness issue, this paper proposes a Deepfake video detection method based on MesoNet with preprocessing module. First, the preprocessing module is established to preprocess the cropped face images, which increases the discrimination among multi-color channels. Next, the preprocessed images are fed into the classic MesoNet. The detection performance of proposed method is verified on two datasets; the AUC on FaceForensics++ can reach 0.974, and it can reach 0.943 on Celeb-DF which is better than the current methods. More importantly, even in the case of heavy compression, the detection rate can still be more than 88%.

Topics & Concepts

PreprocessorComputer scienceRobustness (evolution)Artificial intelligencePerspective (graphical)Data pre-processingFace (sociological concept)Computer visionPattern recognition (psychology)SociologyGeneBiochemistrySocial scienceChemistryDigital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisAdvanced Steganography and Watermarking Techniques