mlsanityData to 7 Oct 2026

AIGC for Industrial Time Series: From Deep Generative Models to Large Generative Models

arXiv 2407.11480 ↗First posted 16 Jul 2024cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

With the remarkable success of generative models like ChatGPT, Artificial Intelligence Generated Content (AIGC) is undergoing explosive development. Not limited to text and images, generative models can generate industrial time series data, addressing challenges such as the difficulty of data collection and data annotation. Due to their outstanding generation ability, they have been widely used in Internet of Things, metaverse, and cyber-physical-social systems to enhance the efficiency of industrial production. In this paper, we present a comprehensive overview of generative models for industrial time series from deep generative models (DGMs) to large generative models (LGMs). First, a DGM-based AIGC framework is proposed for industrial time series generation. Within this framework, we survey advanced industrial DGMs and present a multi-perspective categorization. Furthermore, we systematically analyze the critical technologies required to construct industrial LGMs from four aspects: large-scale industrial dataset, LGMs architecture for complex industrial characteristics, self-supervised training for industrial time series, and fine-tuning of industrial downstream tasks. Finally, we conclude the challenges and future directions to enable the development of generative models in industry.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 44 of its 174 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

44 of 174 references.

References · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  11. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  12. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
32 more
  1. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  3. 2022Diffusion Models in Vision: A Surveycited by 1,008
  4. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  5. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  6. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  7. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  8. 2022A Survey on Generative Diffusion Modelcited by 238
  9. 2020IntelliCode Compose: Code Generation Using Transformercited by 225
  10. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
  11. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 213
  12. 2019MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscited by 176
  13. 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
  14. 2022AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuningcited by 137
  15. 2021BRepNet: A topological message passing system for solid modelscited by 92
  16. 2019Generative Models for Effective ML on Private, Decentralized Datasetscited by 85
  17. 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
  18. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  19. 2021Sig-Wasserstein GANs for Time Series Generationcited by 60
  20. 2021PSA-GAN: Progressive Self Attention GANs for Synthetic Time Seriescited by 58
  21. 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
  22. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
  23. 2024Balancing Act: Distribution-Guided Debiasing in Diffusion Modelscited by 50
  24. 2020Generative Adversarial Networks for Spatio-temporal Data: A Surveycited by 35
  25. 2023POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained modelscited by 29
  26. 2019A Novel GAN-based Fault Diagnosis Approach for Imbalanced Industrial Time Seriescited by 24
  27. 2023TSGBench: Time Series Generation Benchmarkcited by 24
  28. 2021Privacy-preserving Spatiotemporal Scenario Generation of Renewable Energies: A Federated Deep Generative Learning Approachcited by 22
  29. 2024Fair Sampling in Diffusion Models through Switching Mechanismcited by 12
  30. 2023Time-Transformer: Integrating Local and Global Features for Better Time Series Generation (Extended Version)cited by 6
  31. 2023Controlled physics-informed data generation for deep learning-based remaining useful life prediction under unseen operation conditionscited by 4
  32. 2022Generating Privacy-Preserving Process Data with Deep Generative Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.