Emotion Recognition Based on EEG Brain Rhythm Sequencing Technique
Jiawen Li, Shovan Barma, Sio Hang Pun, Mang I Vai, Peng Un Mak
Abstract
This work proposes a technique that analyzes electroencephalography (EEG) using brain rhythms ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\delta $ </tex-math></inline-formula> , <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\theta $ </tex-math></inline-formula> , <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\alpha $ </tex-math></inline-formula> , <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\beta $ </tex-math></inline-formula> , and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\gamma $ </tex-math></inline-formula> ) presented in a sequential format and applies it for emotion recognition. Although brain rhythms are regarded as reliable parameters in EEG-based emotion recognition, to achieve high accuracy by considering fewer optimal multichannel rhythmic features (MCRFs) has not been addressed in detail. Thus, the rhythm sequence for each channel is generated by choosing the strongest brain rhythm having the maximum instantaneous power for every 200-ms time bin. A <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula> -nearest neighbor ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula> -NN) classifier is employed for evaluating the rhythmic features extracted from different sequences, and the experimental validation was performed on three well-known emotional databases (DEAP, MAHNOB, and SEED). The results showed that approximately 30% of MCRFs for as high as 87%–92%, achieving high classification accuracies with a small number of data. Further investigation revealed that the frontal and parietal regions are active during the emotional process, as consistent as earlier studies. Therefore, the proposed technique demonstrates its availability and reliability for emotion recognition. It also provides a novel solution to find optimal channel-specific rhythmic features in EEG signal analysis.