Litcius/Paper detail

Arm Motion Classification Using Time-Series Analysis of the Spectrogram Frequency Envelopes

Zhengxin Zeng, Moeness G. Amin, Tao Shan

2020Remote Sensing38 citationsDOIOpen Access PDF

Abstract

Hand and arm gesture recognition using radio frequency (RF) sensing modality proves valuable in man–machine interfaces and smart environments. In this paper, we use the time-series analysis method to accurately measure the similarity of the micro-Doppler (MD) signatures between the training and test data, thus providing improved gesture classification. We characterize the MD signatures by the maximum instantaneous Doppler frequencies depicted in the spectrograms. In particular, we apply two machine learning (ML) techniques, namely, the dynamic time warping (DTW) method and the long short-term memory (LSTM) network. Both methods take into account the values as well as the temporal evolution and characteristics of the time-series data. It is shown that the DTW method achieves high gesture classification rates and is robust to time misalignment.

Topics & Concepts

Dynamic time warpingSpectrogramComputer scienceModality (human–computer interaction)Artificial intelligenceGesturePattern recognition (psychology)Time–frequency analysisSimilarity (geometry)Series (stratigraphy)Speech recognitionTime seriesDoppler effectGesture recognitionComputer visionMachine learningImage (mathematics)Filter (signal processing)BiologyPaleontologyAstronomyPhysicsTime Series Analysis and ForecastingHand Gesture Recognition SystemsMusic and Audio Processing
Arm Motion Classification Using Time-Series Analysis of the Spectrogram Frequency Envelopes | Litcius