Litcius/Paper detail

AR Hero: Generating Interactive Augmented Reality Guitar Tutorials

Lucchas Ribeiro Skreinig, A.M. Stănescu, Shohei Mori, Frank Heyen, Peter Mohr, Michael Sedlmair, Dieter Schmalstieg, Denis Kalkofen

20222022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)13 citationsDOI

Abstract

We introduce a system capable of generating interactive Aug-mented Reality guitar tutorials by parsing common digital guitar tablature and by capturing the performance of an expert using a multi-camera array. Instructions are presented to the user in an Augmented Reality application using either an abstract visualization, a 3D virtual hand, or a 3D video. To support individual users at different skill levels the system provides full control of the play-back of a tutorial, including its speed and looping behavior, while delivering live feedback on the user's performance.

Topics & Concepts

GuitarComputer scienceAugmented realityVisualizationHuman–computer interactionVirtual realityParsingHEROComputer graphics (images)MultimediaArtificial intelligenceManagementEconomicsAugmented Reality ApplicationsInteractive and Immersive DisplaysVirtual Reality Applications and Impacts