mlsanityData to 7 Oct 2026

A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot

arXiv 2307.14397 ↗First posted 26 Jul 2023cs.CV cs.LGcited by 19

Not on the map. Why?

Abstract (arXiv)

Generative modeling in machine learning aims to synthesize new data samples that are statistically similar to those observed during training. While conventional generative models such as GANs and diffusion models typically assume access to large and diverse datasets, many real-world applications (e.g. in medicine, satellite imaging, and artistic domains) operate under limited data availability and strict constraints. In this survey, we examine Generative Modeling under Data Constraint (GM-DC), which includes limited-data, few-shot, and zero-shot settings. We present a unified perspective on the key challenges in GM-DC, including overfitting, frequency bias, and incompatible knowledge transfer, and discuss how these issues impact model performance. To systematically analyze this growing field, we introduce two novel taxonomies: one categorizing GM-DC tasks (e.g. unconditional vs. conditional generation, cross-domain adaptation, and subject-driven modeling), and another organizing methodological approaches (e.g. transfer learning, data augmentation, meta-learning, and frequency-aware modeling). Our study reviews over 230 papers, offering a comprehensive view across generative model types and constraint scenarios. We further analyze task-approach-method interactions using a Sankey diagram and highlight promising directions for future work, including adaptation of foundation models, holistic evaluation frameworks, and data-centric strategies for sample selection. This survey provides a timely and practical roadmap for researchers and practitioners aiming to advance generative modeling under limited data. Project website: https://sutd-visual-computing-group.github.io/gmdc-survey/.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 163 of its 227 references that are in the map. First posted on arXiv 26 Jul 2023.

Builds on

163 of 227 references.

References · 163

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  9. 2020Denoising Diffusion Implicit Modelscited by 9,655
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  11. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  12. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
38 more
  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  7. 2017Squeeze-and-Excitation Networkscited by 4,763
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  13. 2022A ConvNet for the 2020scited by 3,545
  14. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  15. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  16. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  17. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  18. 2016Improved Techniques for Training GANscited by 2,938
  19. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  20. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  21. 2016Matching Networks for One Shot Learningcited by 2,246
  22. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  23. 2017Improved Training of Wasserstein GANscited by 2,223
  24. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  25. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  26. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  27. 2018On the Spectral Bias of Neural Networkscited by 1,321
  28. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  29. 2018Demystifying MMD GANscited by 1,268
  30. 2014How transferable are features in deep neural networks?cited by 1,216
  31. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  32. 2021Variational Diffusion Modelscited by 1,145
  33. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
  34. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  35. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  36. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  37. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  38. 2019An Introduction to Variational Autoencoderscited by 997

50 most cited of 163 All 163 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 9; 2025: 7.

19 papers.

Sort:

By area:

  1. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  2. 2024Frequency Masking for Universal Deepfake Detectioncited by 23
  3. 2023Label-Only Model Inversion Attacks via Knowledge Transfercited by 21
  4. 2025Generative Models in Decision Making: A Surveycited by 14
  5. 2024Model Inversion Robustness: Can Transfer Learning Help?cited by 11
  6. 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
  7. 2023On Measuring Fairness in Generative Modelscited by 8
  8. 2024Few-Shot Image Generation by Conditional Relaxing Diffusion Inversioncited by 7
  9. 2024FairQueue: Rethinking Prompt Learning for Fair Text-to-Image Generationcited by 7
  10. 2024Seizing the Means of Production: Exploring the Landscape of Crafting, Adapting and Navigating Generative AI Models in the Visual Artscited by 2
  11. 2025A Diffusive Data Augmentation Framework for Reconstruction of Complex Network Evolutionary Historycited by 2
  12. 2024DomainGallery: Few-shot Domain-driven Image Generation by Attribute-centric Finetuningcited by 1
7 more
  1. 2025Rare event modeling with self-regularized normalizing flows: what can we learn from a single failure?cited by 1
  2. 2025CodeFuse-CommitEval: Towards Benchmarking LLM's Power on Commit Message and Code Change Inconsistency Detectioncited by 1
  3. 2024Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variationscited by 0
  4. 2024Grassmannian Geometry Meets Dynamic Mode Decomposition in DMD-GEN: A New Metric for Mode Collapse in Time Series Generative Modelscited by 0
  5. 2025AIR: Zero-shot Generative Model Adaptation with Iterative Refinementcited by 0
  6. 2025Instruction Tuning of Large Language Models for Tabular Data Generation-in One Daycited by 0
  7. 2025Towards Sustainable Universal Deepfake Detection with Frequency-Domain Maskingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Difficulty Controlled Diffusion Model for Synthesizing Effective Training Data
  2. 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications
  3. 2026Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains
  4. 2023Conditional Image Generation with Pretrained Generative Model
  5. 2025Minimalist Concept Erasure in Generative Models
  6. 2024Moderating the Generalization of Score-based Generative Model
  7. 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
  8. 2025Beyond the Generative Learning Trilemma: Generative Model Assessment in Data Scarcity Domains