mlsanityData to 7 Oct 2026

Contrastive Time Series Forecasting with Anomalies

arXiv 2512.11526 ↗First posted 12 Dec 2025cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series forecasting predicts future values from past data. In real-world settings, some anomalous events have lasting effects and influence the forecast, while others are short-lived and should be ignored. Standard forecasting models fail to make this distinction, often either overreacting to noise or missing persistent shifts. We propose Co-TSFA (Contrastive Time Series Forecasting with Anomalies), a regularization framework that learns when to ignore anomalies and when to respond. Co-TSFA generates input-only and input-output augmentations to model forecast-irrelevant and forecast-relevant anomalies, and introduces a latent-output alignment loss that ties representation changes to forecast changes. This encourages invariance to irrelevant perturbations while preserving sensitivity to meaningful distributional shifts. Experiments on the Traffic and Electricity benchmarks, as well as on a real-world cash-demand dataset, demonstrate that Co-TSFA improves performance under anomalous conditions while maintaining accuracy on normal data. An anonymized GitHub repository with the implementation of Co-TSFA is provided and will be made public upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

29 of 40 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Supervised Contrastive Learningcited by 2,803
  3. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2025DINOv3cited by 1,297
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  12. 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
17 more
  1. 2023A decoder-only foundation model for time-series forecastingcited by 650
  2. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  3. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
  4. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
  5. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
  6. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 143
  7. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  8. 2024TSFM-Bench: A Comprehensive and Unified Benchmark of Foundation Models for Time Series Forecastingcited by 55
  9. 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
  10. 2023Soft Contrastive Learning for Time Seriescited by 49
  11. 2024RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomaliescited by 17
  12. 2022Robust Probabilistic Time Series Forecastingcited by 15
  13. 2022Self-Adaptive Forecasting for Improved Deep Learning on Non-Stationary Time-Seriescited by 14
  14. 2024Rethinking the Power of Timestamps for Robust Time Series Forecasting: A Global-Local Fusion Perspectivecited by 13
  15. 2024Self-Supervised Contrastive Learning for Long-term Forecastingcited by 8
  16. 2025Towards a Learning Theory of Representation Alignmentcited by 5
  17. 2025Patch-Level Kernel Alignment for Dense Self-Supervised Learningcited by 1

Built on by

Not cited yet.