mlsanityData to 7 Oct 2026

Generative causal testing to bridge data-driven models and scientific theories in language neuroscience

arXiv 2410.00812 ↗First posted 1 Oct 2024cs.CL q-bio.NCcited by 5

Not on the map. Why?

Abstract (arXiv)

Representations from large language models are highly effective at predicting BOLD fMRI responses to language stimuli. However, these representations are largely opaque: it is unclear what features of the language stimulus drive the response in each brain area. We present generative causal testing (GCT), a framework for generating concise explanations of language selectivity in the brain from predictive models and then testing those explanations in follow-up experiments using LLM-generated stimuli.This approach is successful at explaining selectivity both in individual voxels and cortical regions of interest (ROIs), including newly identified microROIs in prefrontal cortex. We show that explanatory accuracy is closely related to the predictive power and stability of the underlying predictive models. Finally, we show that GCT can dissect fine-grained differences between brain areas with similar functional selectivity. These results demonstrate that LLMs can be used to bridge the widening gap between data-driven models and formal scientific theories.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

15 of 65 references.

References · 15

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  5. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  6. 2023Neural General Circulation Models for Weather and Climatecited by 232
  7. 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
  8. 2023Scaling laws for language encoding models in fMRIcited by 68
  9. 2019Veridical Data Sciencecited by 65
  10. 2023Explaining black box text modules in natural language with language modelscited by 61
  11. 2022Describing Differences between Text Distributions with Natural Languagecited by 54
  12. 2019Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brainscited by 37
3 more
  1. 2022Self-supervised models of audio effectively explain human cortical responses to speechcited by 37
  2. 2022Joint processing of linguistic properties in brains and language modelscited by 37
  3. 2023BrainSCUBA: Fine-Grained Natural Language Captions of Visual Cortex Selectivitycited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.