Compact Convolutional Neural Network with Multi-Headed Attention Mechanism for Seizure Prediction
Xin Ding, Weiwei Nie, Xinyu Liu, Xiuying Wang, Qi Yuan
Abstract
Epilepsy is a neurological disorder related to frequent seizures. Automatic seizure prediction is crucial for the prevention and treatment of epilepsy. In this paper, we propose a novel model for seizure prediction that incorporates a convolutional neural network (CNN) with multi-head attention mechanism. In this model, the shallow CNN automatically captures the EEG features, and the multi-headed attention focuses on discriminating the effective information among these features for identifying pre-ictal EEG segments. Compared with current CNN models for seizure prediction, the embedded multi-headed attention empowers the shallow CNN to be more flexible, and enables improvement of the training efficiency. Hence, this compact model is more resistant to being trapped in overfitting. The proposed method was evaluated over the scalp EEG data from the two publicly available epileptic EEG databases, and achieved outperforming values of event-level sensitivity, false prediction rate (FPR), and epoch-level F1. Furthermore, our method achieved the stable length of seizure prediction time that was between 14 and 15 min. The experimental comparisons showed that our method outperformed other prediction methods in terms of prediction and generalization performance.