Litcius/Paper detail

FingerTouch: Touch Interaction Using a Fingernail-Mounted Sensor on a Head-Mounted Display for Augmented Reality

Ju-Young Oh, Ji‐Hyung Park, Jung-Min Park

2020IEEE Access17 citationsDOIOpen Access PDF

Abstract

This study proposes FingerTouch, a method of touch interaction using a head-mounted display for mobile augmented reality. FingerTouch allows users to manipulate virtual content with one-finger touch interaction regardless of the material or tilt of the plane the finger is touching. In addition, users can interact freely with virtual contents using FingerTouch. As the prototype developed in this study uses only one inertial measurement unit sensor attached to a fingernail, it features high mobility and allows users to feel natural tactile feedback, which is important for performing everyday tasks. The user evaluation of FingerTouch indicated that it provides high accuracy, with an average cursor navigation error of 2.15 mm and an average finger gesture recognition accuracy of 95% across 22 participants, two surface orientations, and three surface materials.

Topics & Concepts

Computer scienceAugmented realityGestureOptical head-mounted displayComputer visionVirtual realityInertial measurement unitImmersion (mathematics)Artificial intelligenceCursor (databases)Head (geology)Interaction techniqueHuman–computer interactionComputer graphics (images)GeologyGeomorphologyPure mathematicsMathematicsInteractive and Immersive DisplaysAugmented Reality ApplicationsTactile and Sensory Interactions
FingerTouch: Touch Interaction Using a Fingernail-Mounted Sensor on a Head-Mounted Display for Augmented Reality | Litcius