Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction?
On the map: LLM reasoning → Causal reasoning in LLMs
Abstract (arXiv)
Interventional data is widely regarded as the gold standard for teaching models causal reasoning. We test this assumption in a fully controlled synthetic environment pitting observational correlation against causal effect, and find it fails instructively. In Simpson's-paradox worlds, where the two have systematically opposite signs, increasing the fraction of interventional samples in pretraining does not improve causal direction: the magnitude of the model's do()-response grows monotonically, yet its sign is copied from the observational context. What governs whether interventional evidence is used is not the training mixture but the evidence type present in the context at inference time. Under an identical training recipe, a purely observational context induces systematic sign reversal in 29/50 worlds, a mixed context in 19/50, while aligned interventional probes alone yield 41/50 correct. Erasing observational evidence from the context immediately releases the suppressed causal interpolation ability (ratio_true = +0.56); a four-state content manipulation shows the switch is content-mediated and graded. The suppression is stable across training seeds (11/11 strong reversals persist on a matched-protocol second seed) and robust as a rate at 0.93B parameters (31.8% vs. 6% reversals in the matched probe-only arm), even as absolute gains shrink four-fold. An external audit on CLadder exposes a learned positive-effect prior with a two-layer structure: sign-randomized retraining removes it in-distribution but not out-of-distribution. We summarize: the capability lives in the weights; the switch lives in the context, and activation patching localizes the switch to the middle layers' observational rows. We further quantify the sampling noise floor of probe-based causal evaluation and an evidence-averaging protocol that cuts sign errors from 26% to 9%.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 13 of its 17 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
13 of 17 references.
Closest ancestors · 3
Same direction, newest first
- 2024Teaching Transformers Causal Reasoning through Axiomatic Training10 Jul
- 2023CLadder: Assessing Causal Reasoning in Language Models7 Dec
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality28 Apr
Other references · 10
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 671
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
- 2023Can Large Language Models Infer Causation from Correlation?cited by 142
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2023Passive learning of active causal strategies in agents and language modelscited by 21
- 2024Transformers Handle Endogeneity in In-Context Linear Regressioncited by 8
- 2025Ice Cream Doesn't Cause Drowning: Benchmarking LLMs Against Statistical Pitfalls in Causal Inferencecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Evaluating Interventional Reasoning Capabilities of Large Language Models
- 2026ReplaySCM: A Benchmark for Executable Causal Mechanism Induction from Interventions
- 2026Why LLMs Fail at Causal Discovery and How Interventional Agents Escape
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models
- 2025Do Large Language Models Show Biases in Causal Learning? Insights from Contingency Judgment
- 2026Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
- 2026Causal Tongue-Tie: LLMs Can Encode Causal Direction, But Their Yes/No Outputs Fail to Express
- 2026ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs