Litcius/Paper detail

Visually Maintained Image Disturbance Against Deepfake Face Swapping

Junhao Dong, Xiaohua Xie

202120 citationsDOI

Abstract

As a deep learning-based application, DeepFake can generate malicious images or videos through replacing the face of a source image with the target face, which poses a significant threat to social media. In this paper, we propose a scheme to prevent such tampering by exploring adversarial examples against DeepFake. Specifically, adversarial examples are produced by adding tailored distortion to source images. The added distortion is imperceptible to human vision but can mislead the generation of face-swapped images effectively. We present three novel adversarial attacks against DeepFake autoencoders from perspectives of adversarial transferability and latent representation. Our first method synthesizes universal perturbation, which is image-agnostic. By contrast, the latter two methods directly perform the preciser perturbation specific to a source image. Extensive experiments demonstrate the effectiveness of our adversarial examples against DeepFake in terms of both reference and non-reference image quality assessment.

Topics & Concepts

Adversarial systemTransferabilityComputer scienceDistortion (music)Artificial intelligenceFace (sociological concept)Image (mathematics)Computer visionImage qualityRepresentation (politics)Machine learningLawComputer networkSociologyBandwidth (computing)LogitSocial scienceAmplifierPolitical sciencePoliticsAdversarial Robustness in Machine LearningDigital Media Forensic DetectionAdvanced Image Processing Techniques
Visually Maintained Image Disturbance Against Deepfake Face Swapping | Litcius