Generative causal testing to bridge data-driven models and scientific theories in language neuroscience
Not on the map. Why?
Abstract (arXiv)
Representations from large language models are highly effective at predicting BOLD fMRI responses to language stimuli. However, these representations are largely opaque: it is unclear what features of the language stimulus drive the response in each brain area. We present generative causal testing (GCT), a framework for generating concise explanations of language selectivity in the brain from predictive models and then testing those explanations in follow-up experiments using LLM-generated stimuli.This approach is successful at explaining selectivity both in individual voxels and cortical regions of interest (ROIs), including newly identified microROIs in prefrontal cortex. We show that explanatory accuracy is closely related to the predictive power and stability of the underlying predictive models. Finally, we show that GCT can dissect fine-grained differences between brain areas with similar functional selectivity. These results demonstrate that LLMs can be used to bridge the widening gap between data-driven models and formal scientific theories.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 1 Oct 2024.
Builds on
15 of 65 references.
References · 15
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2023Neural General Circulation Models for Weather and Climatecited by 232
- 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
- 2023Scaling laws for language encoding models in fMRIcited by 68
- 2019Veridical Data Sciencecited by 65
- 2023Explaining black box text modules in natural language with language modelscited by 61
- 2022Describing Differences between Text Distributions with Natural Languagecited by 54
- 2019Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brainscited by 37
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026Sanity Checks for Agentic Data Sciencecited by 4
- 2026Stroke Lesions as a Rosetta Stone for Language Model Interpretabilitycited by 2
- 2025Towards Interpretable Visual Decoding with Attention to Brain Representationscited by 1
- 2026Interpreting Brain Responses to Language with Sparse Features from Language Modelscited by 1
- 2025What does it mean to understand language?cited by 0
- 2026Interpreting Brain Responses to Language with Sparse Features from Language Models5 Jun 2026
- 2026Sanity Checks for Agentic Data Science13 Apr 2026
- 2026Stroke Lesions as a Rosetta Stone for Language Model Interpretability3 Feb 2026
- 2025What does it mean to understand language?24 Nov 2025
- 2025Towards Interpretable Visual Decoding with Attention to Brain Representations28 Sep 2025