mlsanityData to 14 Oct 2026

OATS: Online Data Augmentation for Time Series Foundation Models

arXiv 2601.19040 ↗First posted 26 Jan 2026cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Time Series Foundation Models (TSFMs) are a powerful paradigm for time series analysis and are often enhanced by synthetic data augmentation to improve the training data quality. Existing augmentation methods, however, typically rely on heuristics and static paradigms. Motivated by dynamic data optimization, which shows that the contribution of samples varies across training stages, we propose OATS (Online Data Augmentation for Time Series Foundation Models), a principled strategy that generates synthetic data tailored to different training steps. OATS leverages valuable training samples as principled guiding signals and dynamically generates high-quality synthetic data conditioned on them. We further design a diffusion-based framework to produce realistic time series and introduce an explore-exploit mechanism to balance efficiency and effectiveness. Experiments on TSFMs demonstrate that OATS consistently outperforms regular training and yields substantial performance gains over static data augmentation baselines across six validation datasets and two TSFM architectures. The code is available at the link https://github.com/microsoft/TimeCraft.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

34 of 43 references.

References · 34

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  6. 2016An overview of gradient descent optimization algorithmscited by 1,033
  7. 2024Chronos: Learning the Language of Time Seriescited by 759
  8. 2023A decoder-only foundation model for time-series forecastingcited by 692
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  11. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  12. 2023Studying Large Language Model Generalization with Influence Functionscited by 326
22 more
  1. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  2. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  3. 2023TRAK: Attributing Model Behavior at Scalecited by 283
  4. 2022Datamodels: Predicting Predictions from Training Datacited by 189
  5. 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 142
  6. 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 131
  7. 2022Deep Learning for Time Series Anomaly Detection: A Surveycited by 131
  8. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
  9. 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
  10. 2024Data Shapley in One Training Runcited by 81
  11. 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
  12. 2019HATS: A Hierarchical Graph Attention Network for Stock Movement Predictioncited by 37
  13. 2024Time Weaver: A Conditional Time Series Generation Modelcited by 37
  14. 2024Capturing the Temporal Dependence of Training Data Influencecited by 35
  15. 2024Towards Neural Scaling Laws for Time Series Foundation Modelscited by 33
  16. 2024MarS: a Financial Market Simulation Engine Powered by Generative Foundation Modelcited by 28
  17. 2025TimeDP: Learning to Generate Multi-Domain Time Series with Domain Promptscited by 21
  18. 2025TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecastingcited by 17
  19. 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Modelscited by 15
  20. 2025Towards Foundation Models for Zero-Shot Time Series Anomaly Detection: Leveraging Synthetic Data and Relative Context Discrepancycited by 10
  21. 2025Causal Time Series Generation via Diffusion Modelscited by 8
  22. 2024Towards Foundation Time Series Model: To Synthesize Or Not To Synthesize?cited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.