Computational Lesions in Multilingual Language Models Separate Shared and Language-specific Brain Alignment
Not on the map. Why?
Abstract (arXiv)
How the brain supports language across different languages is a basic question in neuroscience and a useful test for multilingual artificial intelligence. Neuroimaging has identified language-responsive brain regions across languages, but it cannot by itself show whether the underlying processing is shared or language-specific. Here we use six multilingual large language models (LLMs) as controllable systems and create targeted ``computational lesions'' by zeroing small parameter sets that are important across languages or especially important for one language. We then compare intact and lesioned models in predicting functional magnetic resonance imaging (fMRI) responses during 100 minutes of naturalistic story listening in native English, Chinese and French (112 participants). Lesioning a compact shared core reduces whole-brain encoding correlation by 60.32% relative to intact models, whereas language-specific lesions preserve cross-language separation in embedding space but selectively weaken brain predictivity for the matched native language. These results support a shared backbone with embedded specializations and provide a causal framework for studying multilingual brain-model alignment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 106 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
36 of 106 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
24 more
- 2020What is the State of Neural Network Pruning?cited by 583
- 2019Importance Estimation for Neural Network Pruningcited by 541
- 2019The State of Sparsity in Deep Neural Networkscited by 476
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
- 2013One Billion Word Benchmark for Measuring Progress in Statistical Language Modelingcited by 308
- 2018SentEval: An Evaluation Toolkit for Universal Sentence Representationscited by 294
- 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 181
- 2024Compact Language Models via Pruning and Knowledge Distillationcited by 148
- 2024Nemotron-4 340B Technical Reportcited by 144
- 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
- 2024Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Modelscited by 126
- 2018On the importance of single directions for generalizationcited by 99
- 2022The Geometry of Multilingual Language Model Representationscited by 95
- 2020On the Language Neutrality of Pre-trained Multilingual Representationscited by 85
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 84
- 2024LLM Pruning and Distillation in Practice: The Minitron Approachcited by 82
- 2022PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importancecited by 79
- 2019Investigating Multilingual NMT Representations at Scalecited by 68
- 2023Scaling laws for language encoding models in fMRIcited by 68
- 2021Disentangling Syntax and Semantics in the Brain with Deep Networkscited by 40
- 2023Neither hype nor gloom do DNNs justicecited by 40
- 2022Discovering Language-neutral Sub-networks in Multilingual Language Modelscited by 28
- 2024Unveiling Linguistic Regions in Large Language Modelscited by 22
- 2023Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformerscited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts
- 2026Linguistic properties and model scale in brain encoding: from small to compressed language models
- 2026Brain-LLM Alignment Tracks Training Data, Not Typology
- 2026Interpreting Brain Responses to Language with Sparse Features from Language Models
- 2025Do Large Language Models Think Like the Brain? Sentence-Level Evidences from Layer-Wise Embeddings and fMRI
- 2025fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understanding
- 2024What Are Large Language Models Mapping to in the Brain? A Case Against Over-Reliance on Brain Scores
- 2026Cognitive Expert Language Models Better Align with the Corresponding Brain Systems