Litcius/Paper detail

Inversion Based on a Detached Dual-Channel Domain Method for StyleGAN2 Embedding

Nan Yang, MengChu Zhou, Bingjie Xia, Xiwang Guo, Liang Qi

2021IEEE Signal Processing Letters17 citationsDOI

Abstract

A style-based generative adversarial network (StyleGAN2) yields remarkable results in image-to-latent embedding. This work proposes a Detached Dual-channel Domain Encoder as an effective and robust method to embed an image to a latent code, i.e., GAN inversion. It infers a latent code from two aspects: a) a detached dual-channel design to support faithful image reconstruction; and b) a local skip connection that allows conveying pieces of information with image details. We further introduce a hierarchical progressive training strategy that allows the proposed encoder to separately capture different semantic features. The qualitative and quantitative experimental results show that the well-trained encoder can embed an image into a latent code in StyleGAN2 latent space with less time than its peers while preserving facial identity and image details well.

Topics & Concepts

Computer scienceEmbeddingEncoderArtificial intelligenceImage (mathematics)Dual (grammatical number)Encoding (memory)Code (set theory)Inversion (geology)Computer visionPattern recognition (psychology)Channel (broadcasting)Theoretical computer scienceLiteraturePaleontologyOperating systemStructural basinArtSet (abstract data type)Programming languageComputer networkBiologyGenerative Adversarial Networks and Image SynthesisAdvanced Image Processing TechniquesDigital Media Forensic Detection