mlsanityData to 14 Oct 2026

The Simulacrum: Decision-Theoretic Pretraining for Near-Optimal Time-Series Forecasting and Inference

arXiv 2606.27711 ↗First posted 26 Jun 2026cs.LG cs.AI stat.COcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a neural network-based framework for learning time series estimators through a process we term decision-theoretic pretraining. Analysts specify a generative world, a distribution over data-generating processes, and a target decision objective. A neural network trained on stratified simulations from this world approximates the corresponding optimal decision rule, yielding a neural estimator that provides forecasts, parameter estimates, predictive intervals, or model-selection for zero-shot inference on previously unseen time series. The joint specification of the generative world and objective enables the estimators to directly approximate process-level, finite-sample properties: near-optimal risk, bias control, minimax performance, and uniform calibration. Our experiments demonstrate that these neural estimators can outperform traditional baselines such as maximum likelihood estimation and model selection via AICc, for the same model structural model classes. Furthermore, even when trained purely on simulations of structural models, they achieve competitive or state-of-the-art forecasting accuracy on major real-world benchmarks, compared with statistical, neural or large pre-trained models. We illustrate the framework by addressing two longstanding challenges: finite-sample bias and miscalibration in AR(p) models, and the forecast combination puzzle. These applications highlight the approach's main advantage: its ability to approximate solutions to analytically intractable or computationally prohibitive time series problems, including complex structural equations or optimality criteria. Ultimately, by enabling explicit control over decision-theoretic trade-offs, the framework equips analysts with highly efficient estimation tools tailored to their specific analytical needs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 62 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

25 of 62 references.

References · 25

  1. 2016Densely Connected Convolutional Networkscited by 6,720
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  4. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  5. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  6. 2024Chronos: Learning the Language of Time Seriescited by 759
  7. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  8. 2023A decoder-only foundation model for time-series forecastingcited by 692
  9. 2019The frontier of simulation-based inferencecited by 502
  10. 2018Conditional Neural Processescited by 426
  11. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  12. 2021Transformers Can Do Bayesian Inferencecited by 360
13 more
  1. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  2. 2021Monash Time Series Forecasting Archivecited by 267
  3. 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 219
  4. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  5. 2020BayesFlow: Learning complex stochastic models with invertible neural networkscited by 144
  6. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
  7. 2020Principles and Algorithms for Forecasting Groups of Time Series: Locality and Globalitycited by 70
  8. 2025From Tables to Time: Extending TabPFN-v2 to Time Series Forecastingcited by 60
  9. 2019GRATIS: GeneRAting TIme Series with diverse and controllable characteristicscited by 42
  10. 2022Likelihood-Free Parameter Estimation with Neural Bayes Estimatorscited by 32
  11. 2020Global Models for Time Series Forecasting: A Simulation Studycited by 21
  12. 2026Zero-shot Forecasting by Simulation Alonecited by 5
  13. 2023Local and Global Trend Bayesian Exponential Smoothing Modelscited by 2

Built on by

Not cited yet.