mlsanityData to 14 Oct 2026

On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models

arXiv 2610.13676 ↗First posted 9 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series foundation models (TSFMs) increasingly offer covariate support, with calendar information being the most common type of categorical covariate in practice, as it is available for every point in time. However, how these features are encoded is largely treated as an implementation detail rather than as an object of study, despite encoding being one of the few design choices left for pretrained models at inference time. With the present study, we demonstrate that the way information is propagated into the model substantially affects forecast accuracy of TSFMs. Therefore, we systematically compare seven calendar encodings, including three conventional target-agnostic representations (ordinal, one-hot, and cyclic) and four target encodings, across four state-of-the-art TSFMs on nine datasets from multiple domains in a zero-shot rolling evaluation. The nine datasets are influenced by social activities, such as weekends and holidays, making calendar information particularly relevant for forecasting. We find that encoding choice affects forecast accuracy across all models, with MASE differences of up to 9.9 % on non-holidays and 83 % on holidays within a single model. Effectiveness and utilization vary substantially across models. Improvements are concentrated around holidays, where calendar information provides signals unavailable from target history, while some model encoding combinations also improve non-holiday forecasts. A SHAP-based attribution analysis locates the contribution of the covariates relative to the autoregressive component and explains why some model-encoding combinations degrade performance. Our findings suggest that current benchmarks for covariate-informed TSFMs can distort model comparisons by imposing fixed encoding strategies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 41 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

26 of 41 references.

References · 26

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2023A decoder-only foundation model for time-series forecastingcited by 692
  3. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  4. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
  5. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  6. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 120
  7. 2025fev-bench: A Realistic Benchmark for Time Series Forecastingcited by 64
  8. 2025From Tables to Time: Extending TabPFN-v2 to Time Series Forecastingcited by 60
  9. 2021Regularized target encoding outperforms traditional methods in supervised machine learning with high cardinality featurescited by 21
  10. 2023LibCity: A Unified Library Towards Efficient and Comprehensive Urban Spatial-Temporal Predictioncited by 20
  11. 2022Review of automated time series forecasting pipelinescited by 18
  12. 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challengescited by 16
14 more
  1. 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streamingcited by 13
  2. 2025UniCA: Unified Covariate Adaptation for Time Series Foundation Modelcited by 7
  3. 2025CoRA: Covariate-Aware Adaptation of Time Series Foundation Modelscited by 6
  4. 2026Explainable Load Forecasting with Covariate-Informed Time Series Foundation Modelscited by 4
  5. 2016Modelling and forecasting daily electricity load curves: a hybrid approachcited by 3
  6. 2025TFMAdapter: Lightweight Instance-Level Adaptation of Foundation Models for Forecasting with Covariatescited by 3
  7. 2026Real-world energy data of 200 feeders from low-voltage grids with metadata in Germany over two yearscited by 2
  8. 2026FETS Benchmark: Foundation Models Enable Scalable and Generalizable Energy Time Series Forecastingcited by 2
  9. 2026Multivariate Financial Forecasting using the Chronos Time Series Foundation Modelscited by 2
  10. 2026Probabilistic Low-Voltage Peak Load Forecasting with Time Series Foundation Models Evaluated on Application-Oriented Metricscited by 2
  11. 2026t0: A Time-Series Foundation Model for Forecasting with Contextcited by 2
  12. 2026Time series Foundation Models based on Physics-Informed Synthetic Histories for Cold-Start Photovoltaic Forecastingcited by 1
  13. 2026Evaluating Time Series Foundation Models for Electricity Price Forecasting: Contamination Risk, Distributional Shifts, and Covariate Dependencecited by 1
  14. 2026A Benchmark for Electrical Load Forecasting Across Grid Levels: Time-Series Transformers Outperform Established Methodscited by 1

Built on by

Not cited yet.