VAEEG: Variational auto-encoder for extracting EEG representation

Abstract

• A VAE-based self-supervised learning model for EEG representation extraction. • VAEEG achieved outstanding performance in the reconstruction of EEG signals. • The latent representations from VAEEG perform well in several clinical tasks. • The VAEEG model enhances the efficiency and accuracy of downstream tasks. The electroencephalogram (EEG) exhibits characteristics of complexity and strong randomness. Existing deep learning models for EEG typically target specific objectives and datasets, with their scalability constrained by the size of the dataset, resulting in limited perceptual and generalization abilities. In order to obtain more intuitive, concise, and useful representations of brain activity, we constructed a reconstruction-based self-supervised learning model for EEG based on Variational Autoencoder (VAE) with separate frequency bands, termed variational auto-encoder for EEG (VAEEG). VAEEG achieved outstanding reconstruction performance. Furthermore, we validated the efficacy of the latent representations in three clinical tasks concerning pediatric brain development, epileptic seizure, and sleep stage classification. We discovered that certain latent features: 1) correlate with adolescent brain developmental changes; 2) exhibit significant distinctions in the distribution between epileptic seizures and background activity; 3) show significant variations across different sleep cycles. In corresponding downstream fitting or classification tasks, models constructed based on the representations extracted by VAEEG demonstrated superior performance. Our model can extract effective features from complex EEG signals, serving as an early feature extractor for downstream classification tasks. This reduces the amount of data required for downstream tasks, simplifies the complexity of downstream models, and streamlines the training process.

Topics & Concepts