Litcius/Paper detail

HeadBox: A Facial Blendshape Animation Toolkit for the Microsoft Rocketbox Library

Matias Volonte, Eyal Ofek, Ken Jakubzak, Shawn Bruner, Mar González-Franco

20222022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)21 citationsDOI

Abstract

HeadBox is a series of opensource tools to do facial animation on the Microsoft Rocketbox avatar library. It includes a tool to create blendshapes out of the facial bones inside Maya and transfer the new blendshapes to the other avatars in the library. We have created a total of 15 visemes, 48 FACS, 30 for the Vive facial tracker. These blendshapes have been released with the original library. An additional Unity demo shows the use these tools with Openface and Oculus Lipsync.

Topics & Concepts

AnimationComputer scienceComputer graphics (images)Computer facial animationAvatarComputer animationMultimediaHuman–computer interactionVirtual Reality Applications and ImpactsFace recognition and analysisAugmented Reality Applications