A Mobile Gesture Interaction Method for Augmented Reality Games Using Hybrid Filters
Guanglong Du, Dawei Guo, Kang Su, Xueqian Wang, Shaohua Teng, Di Li, Peter Liu
Abstract
In most existing games, the separation of gaming operation and feedback regions results in a lower immersion. Therefore, a mobile gesture interaction method is proposed to unify operation and feedback regions to provide users with more immersive interaction experiences. Specifically, the proposed method integrates a Leap Motion (LM) device with a HoloLens (HL) augmented reality (AR) glasses, which provides a natural mobile interaction interface between real bare hands and virtual objects in a real environment. To obtain an accurate mobile interaction between the real bare hand and virtual objects, the proposed method provides an effective registration method between LM and HL AR glasses. To ensure the accuracy and stability of the gesture data, the Kalman filter (KF) and the Particle filter (PF) are applied to estimate the position and the orientation of the hand. The proposed interaction method provides a gaming interaction method similar to real world interaction in daily life, which significantly improves the immersive experience of games. Game experiments and user subjective experience analysis are performed to evaluate the effectiveness of the proposed method. Results show that the proposed method yields a better accuracy and provide users with a more immersive interaction experience.