Prediction Bottlenecks Don't Discover Causal Structure (But Here's What They Actually Do)
Not on the map. Why?
Abstract (arXiv)
A Mamba state-space model trained only for next-step prediction appears to recover Granger-causal structure through a simple readout S = |Wout Win|, with early experiments suggesting the phenomenon generalized across architectures and benefited from interventional data at p < 10-5. We package the protocol used to test that claim -- standardized synthetic generators (VAR/Lorenz/CauseMe-style), three intervention semantics (do(X=c), soft-noise, random-forcing), edge-provenance cards on three real datasets, and size-matched control arms -- as a reusable falsification benchmark, and walk the claim through it in five stages. The method-level claim does not survive: (i) a plain linear bottleneck does as well or better; (ii) tuned Lasso beats the bottleneck on synthetic CauseMe-style benchmarks, and on Lorenz-96 (the only real benchmark with unambiguous ground truth) classical PCMCI and Granger lead a tight cluster in which the bottleneck trails; (iii) the headline intervention advantage is roughly 60% a sample-size confound, and the residual disappears under standard do(X=c) interventions, surviving only under a non-standard random-forcing scheme; (iv) even that residual reproduces, with a larger effect, in classical bivariate Granger -- the effect is method-agnostic. What survives is a narrow characterization result; the benchmark is the lasting artifact, and each stage above is one of its control arms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 9 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
3 of 9 references.
References · 3
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Detecting causal associations in large nonlinear time series datasetscited by 244
- 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 200
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CausalProfiler: Generating Synthetic Benchmarks for Rigorous and Transparent Evaluation of Causal Machine Learning
- 2023Causal Structure Recovery of Linear Dynamical Systems: An FFT based Approach
- 2026CausalReasoningBenchmark: A Real-World Benchmark for Disentangled Evaluation of Causal Identification and Estimation
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era
- 2026CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts
- 2026From Causal Discovery to Dynamic Causal Inference in Neural Time Series
- 2026One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baseline
- 2025A Technical Exploration of Causal Inference with Hybrid LLM Synthetic Data