Litcius/Paper detail

Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality

Peter Lorenz, Ricard Durall, Janis Keuper

202332 citationsDOI

Abstract

Diffusion models recently have been successfully applied for the visual synthesis of strikingly realistic appearing images. This raises strong concerns about their potential for malicious purposes. In this paper, we propose using the lightweight multi Local Intrinsic Dimensionality (multiLID), which has been originally developed in context of the detection of adversarial examples, for the automatic detection of synthetic images and the identification of the according generator networks. In contrast to many existing detection approaches, which often only work for GAN-generated images, the proposed method provides close to perfect detection results in many realistic use cases. Extensive experiments on known and newly created datasets demonstrate that the proposed multiLID approach exhibits superiority in diffusion detection and model identification.Since the empirical evaluations of recent publications on the detection of generated images are often mainly focused on the "LSUN-Bedroom" dataset, we further establish a comprehensive benchmark for the detection of diffusion-generated images, including samples from several diffusion models with different image sizes.The code for our experiments is provided at https://github.com/deepfake-study/deepfake-multiLID.

Topics & Concepts

Computer scienceCurse of dimensionalityBenchmark (surveying)Artificial intelligenceCode (set theory)Context (archaeology)Identification (biology)Image (mathematics)DiffusionSource codePattern recognition (psychology)Machine learningData miningPaleontologyBiologyOperating systemGeographyThermodynamicsPhysicsBotanySet (abstract data type)Programming languageGeodesyCell Image Analysis TechniquesGenerative Adversarial Networks and Image SynthesisImage Processing Techniques and Applications
Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality | Litcius