Whole-brain dynamics of articulatory, acoustic and semantic speech representations
Maxime Verwoert, Joaquín Amigó-Vega, Yingming Gao, Maarten C. Ottenhoff, Pieter Kubben, Christian Herff
Abstract
Speech production is a complex process that traverses several representations, from the meaning of spoken words (semantic), through the movement of articulatory muscles (articulatory) and, ultimately, to the produced audio waveform (acoustic). In this study, we identify how these different representations of speech are spatially and temporally distributed throughout the depth of the brain. Intracranial neural data is recorded from 15 participants, across 1647 electrode contacts, while overtly speaking 100 unique words. We find a bilateral spatial distribution for all three representations, with a more widespread and temporally dynamic distribution in the left compared to the right hemisphere. The articulatory and acoustic representations share a similar spatial distribution surrounding the Sylvian fissure, while the semantic representation is more widely distributed across the brain in a mostly distinct network. These results highlight the distributed nature of the speech production neural process and the potential of non-motor representations for speech brain-computer interfaces. Intracranial neural recordings reveal the dynamic and distributed nature of semantic, articulatory and acoustic representations of speech production, highlighting the potential of nonmotor representations for speech brain-computer interfaces.