Zero-Shot Visual Concept Blending Without Text Guidance
Not on the map. Why?
Abstract (arXiv)
We propose a novel, zero-shot image generation technique called "Visual Concept Blending" that provides fine-grained control over which features from multiple reference images are transferred to a source image. If only a single reference image is available, it is difficult to isolate which specific elements should be transferred. However, using multiple reference images, the proposed approach distinguishes between common and unique features by selectively incorporating them into a generated output. By operating within a partially disentangled Contrastive Language-Image Pre-training (CLIP) embedding space (from IP-Adapter), our method enables the flexible transfer of texture, shape, motion, style, and more abstract conceptual transformations without requiring additional training or text prompts. We demonstrate its effectiveness across a diverse range of tasks, including style transfer, form metamorphosis, and conceptual transformations, showing how subtle or abstract attributes (e.g., brushstroke style, aerodynamic lines, and dynamism) can be seamlessly combined into a new image. In a user study, participants accurately recognized which features were intended to be transferred. Its simplicity, flexibility, and high-level control make Visual Concept Blending valuable for creative fields such as art, design, and content creation, where combining specific visual qualities from multiple inspirations is crucial.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 41 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
38 of 41 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
26 more
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2015A Neural Algorithm of Artistic Stylecited by 483
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2016A Learned Representation For Artistic Stylecited by 341
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2024Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE)cited by 119
- 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2023Text-To-Concept (and Back) via Cross-Model Alignmentcited by 64
- 2022Disentangling visual and written concepts in CLIPcited by 58
- 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
- 2020TuiGAN: Learning Versatile Image-to-Image Translation with Two Unpaired Imagescited by 23
- 2019ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translationcited by 9
Built on by
Not cited yet.