FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusion
Not on the map. Why?
Abstract (arXiv)
Concept blending is a promising yet underexplored area in generative models. While recent approaches, such as embedding mixing and latent modification based on structural sketches, have been proposed, they often suffer from incompatible semantic information and discrepancies in shape and appearance. In this work, we introduce FreeBlend, an effective, training-free framework designed to address these challenges. To mitigate cross-modal loss and enhance feature detail, we leverage transferred image embeddings as conditional inputs. The framework employs a stepwise increasing interpolation strategy between latents, progressively adjusting the blending ratio to seamlessly integrate auxiliary features. Additionally, we introduce a feedback-driven mechanism that updates the auxiliary latents in reverse order, facilitating global blending and preventing rigid or unnatural outputs. Extensive experiments demonstrate that our method significantly improves both the semantic coherence and visual quality of blended images, yielding compelling and coherent results.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 59 of its 67 references that are in the map. First posted on arXiv 8 Feb 2025.
Builds on
59 of 67 references.
References · 59
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
38 more
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 83
- 2021Learning to Compose Visual Relationscited by 72
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 67
- 2023Zero-shot spatial layout conditioning for text-to-image diffusion modelscited by 64
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
- 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 43
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 8.
8 papers.
- 2025Generate, Refine, and Encode: Leveraging Synthesized Novel Samples for On-the-Fly Fine-Grained Category Discoverycited by 10
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombinationcited by 3
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformercited by 3
- 2025VLM-Guided Adaptive Negative Prompting for Creative Generationcited by 3
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editingcited by 2
- 2025VMDiff: Visual Mixing Diffusion for Limitless Cross-Object Synthesiscited by 1
- 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifactscited by 1
- 2025Blending Concepts with Text-to-Image Diffusion Modelscited by 0
- 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts27 Nov 2025
- 2025VLM-Guided Adaptive Negative Prompting for Creative Generation12 Oct 2025
- 2025VMDiff: Visual Mixing Diffusion for Limitless Cross-Object Synthesis28 Sep 2025
- 2025Generate, Refine, and Encode: Leveraging Synthesized Novel Samples for On-the-Fly Fine-Grained Category Discovery5 Jul 2025
- 2025Blending Concepts with Text-to-Image Diffusion Models30 Jun 2025
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing1 Jun 2025
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer20 May 2025
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination29 Apr 2025