Voice user interfaces for effortless navigation in medical virtual reality environments

Abstract

In various situations, such as clinical environments with sterile conditions or when hands are occupied with multiple devices, traditional methods of navigation and scene adjustment are impractical or even impossible. We explore a new solution by using voice control to facilitate interaction in virtual worlds to avoid the use of additional controllers. Therefore, we investigate three scenarios: Object Orientation, Visualization Customization, and Analytical Tasks and evaluate whether natural language interaction is possible and promising in each of these scenarios. In our quantitative user study participants were able to control virtual environments effortlessly using verbal instructions. This resulted in rapid orientation adjustments, adaptive visual aids, and accurate data analysis. In addition, user satisfaction and usability surveys showed consistently high levels of acceptance and ease of use. In conclusion, our study shows that the use of natural language can be a promising alternative for the improvement of user interaction in virtual environments. It enables intuitive interactions in virtual spaces, especially in situations where traditional controls have limitations. • Presenting an alternative, hands-free interaction system using real-time natural language processing. • Evaluation of VUIs in VR, spanning three primary categories: Orientation, Customization, and Analysis. • Exploring whether voice interaction can serve as a feasible mode of communication with visualizations. • Offering an open-source project to enhance accessibility for voice-based applications.

Topics & Concepts