Litcius/Paper detail

GestureEcho: A Silent Symphony of Art with Hand Tracking and Voice-Guided Drawing

Sachin U. Balvir, Sameer Tembhurney, Sarah N. Shaikh, Sarvesh S. Sathawane, Aditya Mane, Mohd Raziullah Khatib, Pranav Bawankule

202415 citationsDOI

Abstract

This study presents a revolutionary voice and gesture detection system with applications ranging from augmented reality to presentation control, painting, and sketching. The technology combines voice recognition to comprehend spoken directions with hand tracking to track user motions. These modules can be integrated such that the system can handle activities involving sketching while the hand tracking component draws on a canvas. Although the system has application potential in many areas, its main goals are to improve presentation control and make activities like drawing and painting easier. This logical and instinctive approach to computer interaction has wide-ranging effects on the entertainment, educational, and design sectors.

Topics & Concepts

SymphonyTracking (education)Computer scienceSpeech recognitionComputer visionArtPsychologyArt historyPedagogyInteractive and Immersive Displays