mlsanityData to 14 Oct 2026

Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach

arXiv 2505.20446 ↗First posted 26 May 2025cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative models perform under limited supervision remains lacking. In this work, we conduct the first large-scale study evaluating leading generative models in data-scarce settings, revealing a substantial performance gap between full-data and data-scarce regimes. To close this gap, we propose a unified diffusion-based generative framework that can synthesize high-fidelity time series across diverse domains using just a few examples. Our model is pre-trained on a large, heterogeneous collection of time series datasets, enabling it to learn generalizable temporal representations. It further incorporates architectural innovations such as dynamic convolutional layers for flexible channel adaptation and dataset token conditioning for domain-aware generation. Without requiring abundant supervision, our unified model achieves state-of-the-art performance in few-shot settings-outperforming domain-specific baselines across a wide range of subset sizes. Remarkably, it also surpasses all baselines even when tested on full datasets benchmarks, highlighting the strength of pre-training and cross-domain generalization. We hope this work encourages the community to revisit few-shot generative modeling as a key problem in time series research and pursue unified solutions that scale efficiently across domains. Code is available at https://github.com/azencot-group/ImagenFew.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 52 of its 78 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

52 of 78 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2023Segment Anythingcited by 8,234
  10. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  11. 2023Visual Instruction Tuningcited by 7,869
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  7. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  11. 2023A decoder-only foundation model for time-series forecastingcited by 692
  12. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  13. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  14. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  15. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  16. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  17. 2018The UCR Time Series Archivecited by 431
  18. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
  19. 2018The UEA multivariate time series classification archive, 2018cited by 338
  20. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
  21. 2020Time Series Data Augmentation for Deep Learning: A Surveycited by 226
  22. 2024Diffusion-TS: Interpretable Diffusion for General Time Series Generationcited by 184
  23. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  24. 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 142
  25. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 129
  26. 2023Bake off redux: a review and experimental evaluation of recent time series classification algorithmscited by 101
  27. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  28. 2021PSA-GAN: Progressive Self Attention GANs for Synthetic Time Seriescited by 58
  29. 2023On the Constrained Time-Series Generation Problemcited by 54
  30. 2023Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEscited by 49
  31. 2023Causal Recurrent Variational Autoencoder for Medical Time Series Generationcited by 45
  32. 2022GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial Networkscited by 44
  33. 2024Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Seriescited by 43
  34. 2024TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Modelcited by 33
  35. 2020EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressionscited by 11
  36. 2025One-Step Offline Distillation of Diffusion-based Models via Koopman Modelingcited by 9
  37. 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modelingcited by 7
  38. 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributescited by 6

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 10.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation
  2. 2024A Survey of Transformer Enabled Time Series Synthesis
  3. 2023Diffusion Models for Time Series Applications: A Survey
  4. 2025TimeDP: Learning to Generate Multi-Domain Time Series with Domain Prompts
  5. 2024TimeLDM: Latent Diffusion Model for Unconditional Time Series Generation
  6. 2026Unconditional flow-based time series generation with equivariance-regularised latent spaces
  7. 2025T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models
  8. 2025WaveStitch: Flexible and Fast Conditional Time Series Generation with Diffusion Models