Litcius/Paper detail

EmoStyle: One-Shot Facial Expression Editing Using Continuous Emotion Parameters

Bita Azari, Angelica Lim

202414 citationsDOI

Abstract

Recent studies have achieved impressive results in face generation and editing of facial expressions. However, existing approaches either generate a discrete number of facial expressions or have limited control over the emotion of the output image. To overcome this limitation, we introduced EmoStyle, a method to edit facial expressions based on valence and arousal, two continuous emotional parameters that can specify a broad range of emotions. EmoStyle is designed to separate emotions from other facial characteristics and to edit the face to display a desired emotion. We employ the pre-trained generator from StyleGAN2, taking advantage of its rich latent space. We also proposed an adapted inversion method to be able to apply our system on real images in a one-shot manner. The qualitative and quantitative evaluations show that our approach has the capability to synthesize a wide range of expressions to output high-resolution images. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>

Topics & Concepts

Facial expressionComputer scienceShot (pellet)Expression (computer science)Image editingArtificial intelligenceSpeech recognitionComputer visionComputer graphics (images)Human–computer interactionChemistryImage (mathematics)Programming languageOrganic chemistryFacial Nerve Paralysis Treatment and ResearchFace recognition and analysisVisual Attention and Saliency Detection
EmoStyle: One-Shot Facial Expression Editing Using Continuous Emotion Parameters | Litcius