GaitCube: Deep Data Cube Learning for Human Recognition With Millimeter-Wave Radio
Muhammed Zahid Ozturk, Chenshu Wu, Beibei Wang, K. J. Ray Liu
Abstract
Monitoring and identifying gait has recently emerged as a promising solution candidate for unobtrusive human recognition. In order to enable ubiquitous and reliable application, a gait recognition system must be robust to environment changes and easy to use without requiring too much user cooperation and recalibration, while maintaining high accuracy, which is often not satisfied in conventional approaches. In this article, we present <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\boldsymbol {GaitCube}$ </tex-math></inline-formula> , a high-accuracy gait recognition system with the minimal training requirement using a single commodity millimeter-wave (mmWave) radio. To reduce the training overhead, we propose <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">gait data cube</i> , a novel 3-D joint-feature representation of micro-Doppler and micro-range signatures over time that can comprehensively embody the physical relevant features of one’s gait. With a pipeline of signal processing, <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\boldsymbol {GaitCube}$ </tex-math></inline-formula> can automatically detect and segment human walking and effectively extract the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">gait data cubes</i> . We implement and evaluate <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\boldsymbol {GaitCube}$ </tex-math></inline-formula> through experiments conducted at six different locations in a typical indoor space with ten subjects over a month, resulting in >50000 gait instances. The results show that <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\boldsymbol {GaitCube}$ </tex-math></inline-formula> achieves an accuracy of 96.1% with a single gait cycle using one receive antenna, and the accuracy increases to 98.3% when combining all the receive antennas. Further, it achieves an average recognition accuracy of 79.1% for testing over different times and unseen locations by using only 2 min of training data collected in a single location, enabling a practical and ubiquitous gait-based identification.