mlsanityData to 14 Oct 2026

Exposure Bias as Epistemic Underidentification in Recursive Forecasting

arXiv 2606.12990 ↗First posted 11 Jun 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recursive multi-step forecasting is usually framed as distribution shift: models are trained on observed histories but deployed on their own predictions. We show this framing is incomplete by proving that, under partial observability or state truncation, recursive rollout is also an epistemic underidentification problem. Even with deterministic latent dynamics, one-step Bayes supervision identifies behavior only on observed contexts and need not identify the deployed recursive predictor once rollout queries self-generated induced states whose correct local targets are not determined by numeric state alone. We formalize this with induced states Z and provenance variables P, and derive a decomposition of induced-state error into teacher-forcing/rollout mismatch, representation--class approximation, and provenance information gaps. Empirically, we show that rollout enters a distinct induced-state regime, that fixed induced states define a distinct local corrective task, and that closed-loop gains arise not only from local adaptation but also from changing the induced states visited during rollout. Using a simple binary provenance encoding, provenance-aware correction can further improve performance, though gains are conditional rather than uniform. These results recast exposure bias as reasoning under self-induced epistemic uncertainty.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

14 of 23 references.

References · 14

  1. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  2. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  3. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  4. 2015Sequence Level Training with Recurrent Neural Networkscited by 576
  5. 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 216
  6. 2015How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary?cited by 78
  7. 2020Approximate information state for approximate planning and reinforcement learning in partially observed systemscited by 70
  8. 2022Robust Probabilistic Time Series Forecastingcited by 15
  9. 2022Flipped Classroom: Effective Teaching for Time Series Forecastingcited by 12
  10. 2023Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecastscited by 11
  11. 2024Time-Series Classification for Dynamic Strategies in Multi-Step Forecastingcited by 5
  12. 2024Stratify: Unifying Multi-Step Forecasting Strategiescited by 3
2 more
  1. 2025Epistemic Error Decomposition for Multi-step Time Series Forecasting: Rethinking Bias-Variance in Recursive and Direct Strategiescited by 3
  2. 2026Expectations vs. Realities: The Cost of MSE-Optimal Forecasting Under Conditional Uncertaintycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.