Litcius/Paper detail

Faketracer: Exposing Deepfakes with Training Data Contamination

Pu Sun, Yuezun Li, Honggang Qi, Siwei Lyu

20222022 IEEE International Conference on Image Processing (ICIP)11 citationsDOI

Abstract

We describe a proactive defense method to expose Deep-Fakes with training data contamination. Note that the existing methods usually focus on defending from general DeepFakes, which are synthesized by GAN using random noise. In contrast, our method is dedicated to defending from native Deep-Fakes, which is synthesized by auto-encoder that involves face swapping and encoding-decoding process that general DeepFakes do not have. Specifically, we design two types of traces namely sustainable traces and erasable traces, which are added on the faces to manipulate the training of DeepFake models. Consequently, the trained DeepFake model can synthesize faces with sustainable traces but no erasable traces. With the help of these two traces, we can expose DeepFakes proactively. Our method is compared with recent passive and proactive defense methods, which corroborates the efficacy of our method.

Topics & Concepts

Computer scienceEncoderDecoding methodsFocus (optics)Encoding (memory)Face (sociological concept)Process (computing)Noise (video)Artificial intelligenceComputer securityAlgorithmProgramming languageImage (mathematics)SociologySocial scienceOpticsPhysicsOperating systemDigital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine Learning