DSCNN-CAU: Deep-Learning-Based Mental Activity Classification for IoT Implementation Toward Portable BCI
Manali Saini, Udit Satija, Madhur Deo Upadhayay
Abstract
Mental activity classification (MAC) based on electroencephalogram (EEG) is used in the brain–computer interface (BCI) and neurofeedback applications. For this purpose, machine learning and deep learning (DL) techniques are utilized in the previous studies. However, in real time, there is a need to deploy these techniques on Internet of Things (IoT)-enabled mobile devices for portability. Toward this aspect, we propose DL-based MAC using a depthwise separable convolutional neural network with a custom attention unit (DSCNN-CAU) and IoT implementation using a smartphone for portable BCI applications. The performance assessment on EEG signals from two public and two self-acquired databases demonstrates that the overall accuracies of 99.25%, 95.00%, and 91.50%, 89.25% are obtained, respectively. Evaluation results on smartphone depict that most of the real-time recorded EEG signals in self-acquired databases are classified correctly. Further comparative analysis demonstrates that the proposed model and the IoT implementation outperform the existing techniques in terms of accuracy, robustness against artifacts, latency, and battery current dissipation. A total current of 21 mAh is dissipated in EEG signal recording, processing, and event-based transmission to the server, and low latency of 71 ms is achieved in MAC. Further analysis of cross-database performance enables the selection of the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_{P1}$ </tex-math></inline-formula> channel for real-time MAC in IoT-based scenarios.