Recursive Multi-Signal Temporal Fusions With Attention Mechanism Improves EMG Feature Extraction
Rami N. Khushaba, Angkoon Phinyomark, Ali H. Al‐Timemy, Erik Scheme
Abstract
The design of pattern recognition-based myoelectric interfaces has been heavily explored and contested in the research literature. A considerable proportion of the performance of these interfaces has been linked to the quality of the feature extraction (FE) stage used to describe the underlying myoelectric signal. In this paper, we address two important factors of FE that have not been fully exploited; 1) Spatial focus - traditional FE methods focus mainly on the concatenation of features extracted from individual channels and 2) Temporal focus - available FE methods are cross-sectional in nature, largely ignoring the temporal information that may exist between feature windows. To overcome these limitations, several spatiotemporal FE methods have been proposed including hand-crafted and deep learning (DL) models, with the latter showing significant performance enhancements at the cost of increased computational burden. This paper tackles the aforementioned limitations by 1) proposing novel extensions to simple time-domain FE methods, including the waveform length, zero crossings and root mean square, that can capture the relation between any number of channels, and 2) leveraging the long short-term memory concepts from deep neural networks to build a recursive framework that overcomes the cross-sectional nature of traditional methods. The advantages offered by the proposed Recursive Multi-Signal Temporal Fusion (RMTF) features include improved performance, competing with state-of-the-art FE methods without the computational costs associated with leading DL models, and the simplicity of the concepts making them suitable for real-time implementations. Experiments on 65 intact-limbed and amputee subjects reveal an approximate average of 15% reduction in classification errors as compared to models built with other feature sets.