mlsanityData to 14 Oct 2026

Counterfactual Predictions in Scientific Emulators Without Controlled Experiments

arXiv 2610.02252 ↗First posted 30 Sep 2026cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Many scientific questions require reasoning about what was never observed: What if the conditions, interventions, or history had been different? Models can predict accurately on observed data yet fail on such what-if queries when correlated inputs are varied independently. A common remedy is to add controlled simulation data in which these factors are explicitly disentangled, but this requires access to a simulator, can be computationally expensive, and inherits the simulator's modeling assumptions. We introduce ReRoute, a framework for targeted scientific what-if prediction that combines factual data with partial mechanistic knowledge, without requiring controlled intervention data for adaptation. ReRoute fixes the queried input of a pretrained backbone to a reference value, reintroduces its variation through a known mechanistic pathway, and fine-tunes on the original factual data, while leaving downstream effects to the learned dynamics. We provide a causal identification result for this construction under explicit structural assumptions, with the core argument machine-checked in Lean. After showing that ReRoute achieves highly accurate counterfactual predictions in a controlled advection-diffusion system where exact responses are available, we turn to state-of-the-art climate emulation. On held-out coupled-climate interventions, ReRoute reduces aggregate climate error by 18.2-31.8% under severe CO2 distribution shifts while preserving skill under standard conditions, at a small fraction of the cost of retraining on additional controlled simulations, without even accounting for the substantial expense of generating such data. Finally, on an emulator trained from historical ERA5 reanalysis, where no counterfactual reference exists, ReRoute preserves substantially more of the surface warming implied by the observed boundary conditions under a fixed-CO2 counterfactual.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

21 of 42 references.

References · 21

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  3. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  4. 2020Universal Differential Equations for Scientific Machine Learningcited by 353
  5. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  6. 2024Causal machine learning for predicting treatment outcomescited by 74
  7. 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 62
  8. 2023Towards Stability of Autoregressive Neural Operatorscited by 59
  9. 2023ACE: A fast, skillful learned global atmospheric model for climate predictioncited by 56
  10. 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
  11. 2024A Library for Learning Neural Operatorscited by 38
  12. 2022Hard-Constrained Deep Learning for Climate Downscalingcited by 32
9 more
  1. 2023Challenges of learning multi-scale dynamics with AI weather models: Implications for stability and one solutioncited by 31
  2. 2024Unifying Causal Representation Learning with the Invariance Principlecited by 31
  3. 2019Achieving Conservation of Energy in Neural Network Emulators for Climate Modelingcited by 28
  4. 2018Data-driven Discovery of Closure Modelscited by 20
  5. 2025Fourier Neural Operators Explained: A Practical Perspectivecited by 16
  6. 2025Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learningcited by 12
  7. 2025The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warmingcited by 2
  8. 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulatorscited by 2
  9. 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inferencecited by 1

Built on by

Not cited yet.