Litcius/Paper detail

Non-isomorphic Interaction Techniques for Controlling Avatar Facial Expressions in VR

Marc Baloup, Thomas Pietrzak, Martin Hachet, Géry Casiez

202111 citationsDOIOpen Access PDF

Abstract

The control of an avatar’s facial expressions in virtual reality is mainly based on the automated recognition and transposition of the user’s facial expressions. These isomorphic techniques are limited to what users can convey with their own face and have recognition issues. To overcome these limitations, non-isomorphic techniques rely on interaction techniques using input devices to control the avatar’s facial expressions. Such techniques need to be designed to quickly and easily select and control an expression, and not disrupt a main task such as talking. We present the design of a set of new non-isomorphic interaction techniques for controlling an avatar facial expression in VR using a standard VR controller. These techniques have been evaluated through two controlled experiments to help designing an interaction technique combining the strengths of each approach. This technique was evaluated in a final ecological study showing it can be used in contexts such as social applications.

Topics & Concepts

AvatarFacial expressionComputer scienceHuman–computer interactionTask (project management)Set (abstract data type)Expression (computer science)Virtual realityControl (management)Artificial intelligenceEngineeringSystems engineeringProgramming languageInteractive and Immersive DisplaysGaze Tracking and Assistive TechnologyFace recognition and analysis
Non-isomorphic Interaction Techniques for Controlling Avatar Facial Expressions in VR | Litcius