mlsanityData to 7 Oct 2026

A Unified Framework for Generative Data Augmentation: A Comprehensive Survey

arXiv 2310.00277 ↗First posted 30 Sep 2023cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Generative data augmentation (GDA) has emerged as a promising technique to alleviate data scarcity in machine learning applications. This thesis presents a comprehensive survey and unified framework of the GDA landscape. We first provide an overview of GDA, discussing its motivation, taxonomy, and key distinctions from synthetic data generation. We then systematically analyze the critical aspects of GDA - selection of generative models, techniques to utilize them, data selection methodologies, validation approaches, and diverse applications. Our proposed unified framework categorizes the extensive GDA literature, revealing gaps such as the lack of universal benchmarks. The thesis summarises promising research directions, including , effective data selection, theoretical development for large-scale models' application in GDA and establishing a benchmark for GDA. By laying a structured foundation, this thesis aims to nurture more cohesive development and accelerate progress in the vital arena of generative data augmentation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 144 of its 238 references that are in the map. First posted on arXiv 30 Sep 2023.

Builds on

144 of 238 references.

References · 144

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2023GPT-4 Technical Reportcited by 18,132
  8. 2022Training language models to follow instructions with human feedbackcited by 15,712
  9. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  10. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  11. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  12. 2020Denoising Diffusion Implicit Modelscited by 9,655
38 more
  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2016Improved Techniques for Training GANscited by 2,938
  13. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  14. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  15. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  16. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  17. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  18. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  19. 2021Variational Diffusion Modelscited by 1,145
  20. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  21. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  22. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  23. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  24. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  25. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  26. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  27. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  28. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  29. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  30. 2023Instruction Tuning with GPT-4cited by 676
  31. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  32. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  33. 2017Wasserstein GANcited by 635
  34. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  35. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  36. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  37. 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
  38. 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547

50 most cited of 144 All 144 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.

4 papers.