Litcius/Paper detail

4DPM: Deepfake Detection With a Denoising Diffusion Probabilistic Mask

Rui Yang, Zhenrong Deng, Yushu Zhang, Xiaonan Luo, Rushi Lan

2024IEEE Signal Processing Letters21 citationsDOI

Abstract

In the face of increasingly realistic fake human faces, research on enhancing the differences between real and fake images is valuable for improving the generalization capabilities of fake face detection models. In this letter, we propose a method called DPMask (Diffusion Probabilistic Mask) to amplify the distinctions between authentic and counterfeit human facial images. Specifically, we use a dataset consisting of real human facial images and Simplex noise to train a denoising diffusion probabilistic model for the proposed DPMask. Subsequently, we separately apply the DPMask and U-Net to real and fake human facial images to create noticeably distinct genuine and counterfeit human facial images. A lightweight classification network blue is further designed based on RepVGG to classify the newly generated real and fake human faces. Experimental results demonstrate that our model achieves high accuracy on a manually created fake face dataset (RFFD), a GAN-generated fake face dataset (Seq-DeepFake), and a DDPM-generated face dataset (HiFi-IFDL). Furthermore, the addition of DPMask significantly improves the performance of some public fake face detection models.

Topics & Concepts

Probabilistic logicComputer scienceNoise reductionDiffusionArtificial intelligencePattern recognition (psychology)PhysicsThermodynamicsDigital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine Learning