Beyond Model Ranking: Regime Diagnosis for Distributional-Statistical Misspecification in Industrial Time-Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Time-series forecasting models achieve strong benchmark performance but exhibit severe systematic bias in industrial deployments. This train--deploy gap is conventionally attributed to temporal-structural errors or distribution shifts. We characterize a complementary source that these explanations overlook: canonical losses embed fixed statistical priors, while industrial demand mixes benign and pathological regimes---zero-inflation, skewness, high variability---in which these priors are systematically violated. The induced bias persists even under perfect temporal modeling, remains in a distributional-shape component that normalization cannot remove, and creates an aggregation trade-off invisible to aggregate metrics. We turn these observations into an evaluation toolkit centered on the Regime-wise Relative Bias Vector (RBV): a metric-agnostic, regime-decomposed diagnostic that audits how pooled training allocates systematic mismatch across pathological subpopulations. A controlled attribution analysis decomposes RBV into a model-independent intrinsic floor, set by each loss's estimand, and an excess component attributable to training, tracing observed bias to the loss rather than the model. A large-scale study---13 loss objectives, 3 seeds, 60,000+ series spanning RetailShiftBench and M5, with random-split controls---shows that regime-aware diagnosis separates optimization-type from bias-type failure, and that regime-aware training resolves the pooling-induced bias that capacity scaling cannot, for mean-type losses. A formal structural observation, that risk under evaluation-distribution contamination is affine in the pathology mixture weight, grounds these findings. Our work complements model ranking with mechanism-grounded, regime-oriented evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
14 of 35 references.
References · 14
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2017Smart "Predict, then Optimize"cited by 339
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 130
- 2020Principles and Algorithms for Forecasting Groups of Time Series: Locality and Globalitycited by 70
- 2021The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Modelscited by 63
- 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 58
- 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
- 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 33
Built on by
Not cited yet.