Decoding imagined speech reveals speech planning and production mechanisms

  • Speech imagery (the ability to generate internally quasi-perceptual experiences of speech) is a fundamental ability linked to cognitive functions such as inner speech, phonological working memory, and predictive processing. Speech imagery is also considered an ideal tool to test theories of overt speech. The study of speech imagery is challenging, primarily because of the absence of overt behavioral output as well as the difficulty in temporally aligning imagery events across trials and individuals. We used magnetoencephalography (MEG) paired with temporal-generalization-based neural decoding and a simple behavioral protocol to determine the processing stages underlying speech imagery. We monitored participants’ lip and jaw micromovements during mental imagery of syllable production using electromyography. Decoding participants’ imagined syllables revealed a sequence of task-elicited representations. Importantly, participants’ micromovements did not discriminate between syllables. The decoded sequence of neuronal patterns maps well onto the predictions of current computational models of overt speech motor control and provides evidence for hypothesized internal and external feedback loops for speech planning and production, respectively. Additionally, the results expose the compressed nature of representations during planning which contrasts with the natural rate at which internal productions unfold. We conjecture that the same sequence underlies the motor-based generation of sensory predictions that modulate speech perception as well as the hypothesized articulatory loop of phonological working memory. The results underscore the potential of speech imagery, based on new experimental approaches and analytical methods, and further pave the way for successful non-invasive brain-computer interfaces.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Joan OrpellaORCiD, Francesco Mantegna, M. Florencia AssaneoORCiD, David PoeppelORCiDGND
URN:urn:nbn:de:hebis:30:3-730664
DOI:https://doi.org/10.1101/2022.05.30.494046
Parent Title (English):bioRxiv
Document Type:Preprint
Language:English
Date of Publication (online):2022/09/27
Date of first Publication:2022/09/27
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Release Date:2023/04/18
Issue:2022.05.30.494046
Page Number:18
HeBIS-PPN:507498828
Institutes:Angeschlossene und kooperierende Institutionen / MPI für empirische Ästhetik
Dewey Decimal Classification:1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie
Sammlungen:Universitätspublikationen
Licence (German):License LogoCreative Commons - CC BY-NC-ND - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International