Litcius/Paper detail

TextFace: Text-to-Style Mapping Based Face Generation and Manipulation

Xianxu Hou, Xiaokang Zhang, Yudong Li, Linlin Shen

2022IEEE Transactions on Multimedia28 citationsDOI

Abstract

As a subtopic of text-to-image synthesis, text-to-face generation has great potential in face-related applications. In this paper, we propose a generic text-to-face framework, namely, TextFace, to achieve diverse and high-quality face image generation from text descriptions. We introduce text-to-style mapping, a novel method where the text description can be directly encoded into the latent space of a pretrained StyleGAN. Guided by our text-image similarity matching and face captioning-based text alignment, the textual latent code can be fed into the generator of a well-trained StyleGAN to produce diverse face images with high resolution (1024×1024). Furthermore, our model inherently supports semantic face editing using text descriptions. Finally, experimental results quantitatively and qualitatively demonstrate the superior performance of our model.

Topics & Concepts

Computer scienceFace (sociological concept)Closed captioningGenerator (circuit theory)Artificial intelligenceSimilarity (geometry)Image editingCode (set theory)Image (mathematics)Text generationMatching (statistics)Natural language processingPattern recognition (psychology)Programming languageLinguisticsStatisticsPhilosophyPhysicsSet (abstract data type)MathematicsQuantum mechanicsPower (physics)Generative Adversarial Networks and Image SynthesisFace recognition and analysisMultimodal Machine Learning Applications
TextFace: Text-to-Style Mapping Based Face Generation and Manipulation | Litcius