A Unified Framework for Generative Data Augmentation: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
Generative data augmentation (GDA) has emerged as a promising technique to alleviate data scarcity in machine learning applications. This thesis presents a comprehensive survey and unified framework of the GDA landscape. We first provide an overview of GDA, discussing its motivation, taxonomy, and key distinctions from synthetic data generation. We then systematically analyze the critical aspects of GDA - selection of generative models, techniques to utilize them, data selection methodologies, validation approaches, and diverse applications. Our proposed unified framework categorizes the extensive GDA literature, revealing gaps such as the lack of universal benchmarks. The thesis summarises promising research directions, including , effective data selection, theoretical development for large-scale models' application in GDA and establishing a benchmark for GDA. By laying a structured foundation, this thesis aims to nurture more cohesive development and accelerate progress in the vital arena of generative data augmentation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 144 of its 238 references that are in the map. First posted on arXiv 30 Sep 2023.
Builds on
144 of 238 references.
References · 144
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020Denoising Diffusion Implicit Modelscited by 9,655
38 more
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Generative Adversarial Networkscited by 5,603
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2016Improved Techniques for Training GANscited by 2,938
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2021Variational Diffusion Modelscited by 1,145
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2023Instruction Tuning with GPT-4cited by 676
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2017Wasserstein GANcited by 635
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547
50 most cited of 144 All 144 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.
4 papers.
- 2023A Low-Overhead Incorporation-Extrapolation based Few-Shot CSI Feedback Framework for Massive MIMO Systemscited by 1
- 2024"My Kind of Woman": Analysing Gender Stereotypes in AI through The Averageness Theory and EU Lawcited by 1
- 2024If you can describe it, they can see it: Cross-Modal Learning of Visual Concepts from Textual Descriptionscited by 0
- 2026Data Evolution by Wittgenstein's Rule Followingcited by 0
- 2026Data Evolution by Wittgenstein's Rule Following21 Jun 2026
- 2024If you can describe it, they can see it: Cross-Modal Learning of Visual Concepts from Textual Descriptions23 Nov 2024
- 2024"My Kind of Woman": Analysing Gender Stereotypes in AI through The Averageness Theory and EU Law27 Jun 2024
- 2023A Low-Overhead Incorporation-Extrapolation based Few-Shot CSI Feedback Framework for Massive MIMO Systems7 Dec 2023