Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects
Not on the map. Why?
Abstract (arXiv)
A popular approach to decompose the neural bases of language consists in correlating, across individuals, the brain responses to different stimuli (e.g. regular speech versus scrambled words, sentences, or paragraphs). Although successful, this `model-free' approach necessitates the acquisition of a large and costly set of neuroimaging data. Here, we show that a model-based approach can reach equivalent results within subjects exposed to natural stimuli. We capitalize on the recently-discovered similarities between deep language models and the human brain to compute the mapping between i) the brain responses to regular speech and ii) the activations of deep language models elicited by modified stimuli (e.g. scrambled words, sentences, or paragraphs). Our model-based approach successfully replicates the seminal study of Lerner et al. (2011), which revealed the hierarchy of language areas by comparing the functional-magnetic resonance imaging (fMRI) of seven subjects listening to 7min of both regular and scrambled narratives. We further extend and precise these results to the brain signals of 305 individuals listening to 4.1 hours of narrated stories. Overall, this study paves the way for efficient and flexible analyses of the brain bases of language.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 4 of its 29 references that are in the map. First posted on arXiv 12 Oct 2021.
Builds on
4 of 29 references.
References · 4
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
- 2019Linking artificial and human neural representations of languagecited by 37
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 4; 2024: 0; 2025: 0; 2026: 1.
10 papers.
- 2022Toward a realistic model of speech processing in the brain with self-supervised learningcited by 63
- 2022Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?cited by 27
- 2022Neural Language Models are not Born Equal to Fit Brain Data, but Training Helpscited by 26
- 2021Long-range and hierarchical language predictions in brains and algorithmscited by 10
- 2023Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations?cited by 8
- 2023Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attentioncited by 7
- 2023Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Languagecited by 3
- 2022MEG-MASC: a high-quality magneto-encephalography dataset for evaluating natural speech processingcited by 2
- 2023Syntactic Structure Processing in the Brain while Listeningcited by 1
- 2026HDND: Hierarchical Dynamic Neural Decoding for Multilingual Word/Character Retrieval from Non-Invasive Brain Recordingscited by 1
- 2026HDND: Hierarchical Dynamic Neural Decoding for Multilingual Word/Character Retrieval from Non-Invasive Brain Recordings21 Sep 2026
- 2023Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention29 Oct 2023
- 2023Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language5 Oct 2023
- 2023Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations?3 Oct 2023
- 2023Syntactic Structure Processing in the Brain while Listening16 Feb 2023
- 2022MEG-MASC: a high-quality magneto-encephalography dataset for evaluating natural speech processing26 Jul 2022
- 2022Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps7 Jul 2022
- 2022Toward a realistic model of speech processing in the brain with self-supervised learning3 Jun 2022
- 2022Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?3 May 2022
- 2021Long-range and hierarchical language predictions in brains and algorithms28 Nov 2021