Training-Free Synthetic Data Generation with Dual IP-Adapter Guidance
Not on the map. Why?
Abstract (arXiv)
Few-shot image classification remains challenging due to the limited availability of labeled examples. Recent approaches have explored generating synthetic training data using text-to-image diffusion models, but often require extensive model fine-tuning or external information sources. We present a novel training-free approach, called DIPSY, that leverages IP-Adapter for image-to-image translation to generate highly discriminative synthetic images using only the available few-shot examples. DIPSY introduces three key innovations: (1) an extended classifier-free guidance scheme that enables independent control over positive and negative image conditioning; (2) a class similarity-based sampling strategy that identifies effective contrastive examples; and (3) a simple yet effective pipeline that requires no model fine-tuning or external captioning and filtering. Experiments across ten benchmark datasets demonstrate that our approach achieves state-of-the-art or comparable performance, while eliminating the need for generative model adaptation or reliance on external tools for caption generation and image filtering. Our results highlight the effectiveness of leveraging dual image prompting with positive-negative guidance for generating class-discriminative features, particularly for fine-grained classification tasks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 54 of its 65 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
54 of 65 references.
References · 54
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Generative Adversarial Networkscited by 5,627
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2013Describing Textures in the Wildcited by 2,125
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
- 2022Visual Prompt Tuningcited by 1,681
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
- 2022Is synthetic data from generative models ready for image recognition?cited by 320
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2018Adversarial Audio Synthesiscited by 225
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
- 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
- 2023Diversify Your Vision Datasets with Automatic Diffusion-Based Augmentationcited by 100
- 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
- 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 68
- 2024SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?cited by 64
- 2023Training on Thin Air: Improve Image Classification with Generated Datacited by 50
- 2023Explore the Power of Synthetic Data on Few-shot Object Detectioncited by 38
- 2023One-shot Unsupervised Domain Adaptation with Personalized Diffusion Modelscited by 35
- 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 34
- 2024DataDream: Few-shot Guided Dataset Generationcited by 29
- 2023A Systematic Review of Few-Shot Learning in Medical Imagingcited by 28
- 2023An Image is Worth Multiple Words: Discovering Object Level Concepts using Multi-Concept Prompt Learningcited by 15
- 2023Image retrieval outperforms diffusion models on data augmentationcited by 14
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusioncited by 13
- 2023Diversified in-domain synthesis with efficient fine-tuning for few-shot classificationcited by 11
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Attributed Synthetic Data Generation for Zero-shot Domain-specific Image Classification
- 2023Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images
- 2025Can Synthetic Images Serve as Effective and Efficient Class Prototypes?
- 2024The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
- 2025Augmented Conditioning Is Enough For Effective Training Image Generation
- 2024Diverse and Tailored Image Generation for Zero-shot Multi-label Classification
- 2023Text-to-Image Diffusion Models are Zero-Shot Classifiers
- 2024Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model