mlsanityData to 14 Oct 2026

Training-Free Synthetic Data Generation with Dual IP-Adapter Guidance

arXiv 2509.22635 ↗First posted 26 Sep 2025cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Few-shot image classification remains challenging due to the limited availability of labeled examples. Recent approaches have explored generating synthetic training data using text-to-image diffusion models, but often require extensive model fine-tuning or external information sources. We present a novel training-free approach, called DIPSY, that leverages IP-Adapter for image-to-image translation to generate highly discriminative synthetic images using only the available few-shot examples. DIPSY introduces three key innovations: (1) an extended classifier-free guidance scheme that enables independent control over positive and negative image conditioning; (2) a class similarity-based sampling strategy that identifies effective contrastive examples; and (3) a simple yet effective pipeline that requires no model fine-tuning or external captioning and filtering. Experiments across ten benchmark datasets demonstrate that our approach achieves state-of-the-art or comparable performance, while eliminating the need for generative model adaptation or reliance on external tools for caption generation and image filtering. Our results highlight the effectiveness of leveraging dual image prompting with positive-negative guidance for generating class-discriminative features, particularly for fine-grained classification tasks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 54 of its 65 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

54 of 65 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2013Auto-Encoding Variational Bayescited by 4,053
  12. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2013Describing Textures in the Wildcited by 2,125
  8. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  9. 2022Visual Prompt Tuningcited by 1,681
  10. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  13. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  14. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  15. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  16. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
  17. 2022Is synthetic data from generative models ready for image recognition?cited by 320
  18. 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
  19. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
  20. 2023Self-Consuming Generative Models Go MADcited by 250
  21. 2018Adversarial Audio Synthesiscited by 225
  22. 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
  23. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
  24. 2023Diversify Your Vision Datasets with Automatic Diffusion-Based Augmentationcited by 100
  25. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  26. 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
  27. 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 68
  28. 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
  29. 2023Training on Thin Air: Improve Image Classification with Generated Datacited by 50
  30. 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
  31. 2023One-shot Unsupervised Domain Adaptation with Personalized Diffusion Modelscited by 35
  32. 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 34
  33. 2024DataDream: Few-shot Guided Dataset Generationcited by 29
  34. 2023A Systematic Review of Few-Shot Learning in Medical Imagingcited by 28
  35. 2023An Image is Worth Multiple Words: Discovering Object Level Concepts using Multi-Concept Prompt Learningcited by 15
  36. 2023Image retrieval outperforms diffusion models on data augmentationcited by 14
  37. 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusioncited by 13
  38. 2023Diversified in-domain synthesis with efficient fine-tuning for few-shot classificationcited by 11

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Attributed Synthetic Data Generation for Zero-shot Domain-specific Image Classification
  2. 2023Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images
  3. 2025Can Synthetic Images Serve as Effective and Efficient Class Prototypes?
  4. 2024The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
  5. 2025Augmented Conditioning Is Enough For Effective Training Image Generation
  6. 2024Diverse and Tailored Image Generation for Zero-shot Multi-label Classification
  7. 2023Text-to-Image Diffusion Models are Zero-Shot Classifiers
  8. 2024Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model