Wi-Fi Sensing for Joint Gesture Recognition and Human Identification From Few Samples in Human-Computer Interaction
Ronghui Zhang, Chunxiao Jiang, Sheng Wu, Quan Zhou, Xiaojun Jing, Junsheng Mu
Abstract
Gesture recognition is the central enabler of human-computer interaction (HCI). In addition to the semantic information contained in gestures, gesture-based user identification can effortlessly enhance HCI system security. Recently, the Wi-Fi-integrated sensing and communication (ISAC) technology has shown great potential in a field hitherto occupied by computer vision and radar sensing. In this work, leveraging Wi-Fi sensing, we propose a system called WiGesID that achieves joint gesture recognition and human identification (JGRHI). The basic idea behind WiGesID is to identify personalized spatiotemporal dynamic patterns from the gestures of different users. Moreover, we develop an effective approach to recognize new categories of gestures and users by computing relation scores between the features of the new category samples and the support samples. To evaluate the performance, we implemented WiGesID and conducted extensive experiments. The results demonstrate that our system outperforms the state-of-the-art method for cross-domain sensing and accurately recognizes new categories, which promotes the use of this application of Wi-Fi sensing in HCI.