Advancing IR-UWB Radar Human Activity Recognition With Swin Transformers and Supervised Contrastive Learning
Xiaoxiong Li, Si Chen, Shuning Zhang, Yuying Zhu, Zelong Xiao, Xun Wang
Abstract
Impulse radio ultrawideband (IR-UWB) radar has the advantages of low cost, high resolution, and independence of light and weather conditions. Its potential in human activity recognition (HAR) for IoT device sensing draws interest. One challenge in this domain is effectively representing spatial static and temporal dynamic information in echo sequences. Transformers, used extensively in NLP and CV, have powerful sequence long-range dependency modeling capabilities. However, in the field of radar HAR, the application research of transformers is still insufficient. In addition, there is currently a lack of publicly available IR-UWB radar human action data sets. To this end, we proposed various fine-grained feature image calculation methods and designed an IR-UWB Radar Human Activity data set (IURHA2023). This article presents a swin transformer encoder combining cosine similarity attention and patch overlap to obtain deep spatio-temporal features of human action feature images. Compared with other proposed transformer models or traditional CNNs and RNNs, the improved swin transformer encoder performs better. To further improve the feature learning capability of the backbone network and the robustness to echo variations, we propose a supervised contrastive learning-enhanced swin transformer (SCL-SwinT). It obtains distinctions and compact embeddings by comparing the similarities of positive and negative examples partitioned according to labels. Experimental results on the IURHA2023 data set show that SCL-SwinT achieves a recognition rate exceeding 90%, and the inference speed on IoT edge devices satisfies real-time applications. Ablation experiments demonstrate the effectiveness of the proposed components. In addition, SCL-SwinT exhibits good robustness to environmental factors like noise, multipath, and distance.