mlsanityData to 14 Oct 2026

Brain-LLM Alignment Tracks Training Data, Not Typology

arXiv 2605.23032 ↗First posted 21 May 2026cs.CL cs.AI q-bio.NCcited by 0

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Brain-LLM alignment is well established in English, yet the brain's language network is neuroanatomically universal across languages. Does alignment also generalize cross-linguistically, and what governs the variation? We test this using fMRI data from 112 participants across English, Chinese, and French (the Le Petit Prince corpus) and seven LLMs spanning English-dominant, Chinese-dominant, and multilingual architectures. Our central finding is that training-language dominance, not an inherent property of English, drives the alignment pattern: a Chinese-dominant model (Baichuan2-7B), architecture-matched to LLaMA-2-7B, reverses the gradient entirely, aligning best with Chinese brains and worst with English. Beyond training dominance, formal typological distance independently covaries with alignment degradation, syntax-associated brain regions (IFG) show 2.3× steeper typological gradients than lexico-semantic regions (PTL), and tokenization fertility accounts for ~60% of a cross-linguistic shift in optimal encoding layer. These results reveal that the apparent "English advantage" in brain-LLM alignment is an artifact of training data composition, while the remaining variation reflects genuine typological structure concentrated in syntactic processing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 25 of its 73 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

25 of 73 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  5. 2019How multilingual is Multilingual BERT?cited by 645
  6. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
  7. 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 181
  8. 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 178
  9. 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
  10. 2022Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?cited by 113
  11. 2020Finding Universal Grammatical Relations in Multilingual BERTcited by 110
  12. 2020On the Language Neutrality of Pre-trained Multilingual Representationscited by 85
13 more
  1. 2023Testing the Predictions of Surprisal Theory in 11 Languagescited by 77
  2. 2023Scaling laws for language encoding models in fMRIcited by 68
  3. 2021First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERTcited by 65
  4. 2024Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNscited by 65
  5. 2018Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processingcited by 63
  6. 2018Are All Languages Equally Hard to Language-Model?cited by 53
  7. 2025From Language to Cognition: How LLMs Outgrow the Human Language Networkcited by 30
  8. 2022Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Modelscited by 14
  9. 2022Language models and brains align due to more than next-word prediction and word-level informationcited by 14
  10. 2023Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax and Contextcited by 13
  11. 2025ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoningcited by 13
  12. 2019Robust Evaluation of Language-Brain Encoding Experimentscited by 9
  13. 2025Meaning-infused grammar: Gradient Acceptability Shapes the Geometric Representations of Constructions in LLMscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Computational Lesions in Multilingual Language Models Separate Shared and Language-specific Brain Alignment
  2. 2026Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts
  3. 2025Fine-grained Analysis of Brain-LLM Alignment through Input Attribution
  4. 2026Linguistic properties and model scale in brain encoding: from small to compressed language models
  5. 2024Probing the Emergence of Cross-lingual Alignment during LLM Training
  6. 2026When Language Models Lose Their Mind: The Consequences of Brain Misalignment
  7. 2025From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons Alignment
  8. 2026Cognitive Expert Language Models Better Align with the Corresponding Brain Systems