mlsanityData to 14 Oct 2026

Zero-Shot Visual Concept Blending Without Text Guidance

arXiv 2503.21277 ↗First posted 27 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose a novel, zero-shot image generation technique called "Visual Concept Blending" that provides fine-grained control over which features from multiple reference images are transferred to a source image. If only a single reference image is available, it is difficult to isolate which specific elements should be transferred. However, using multiple reference images, the proposed approach distinguishes between common and unique features by selectively incorporating them into a generated output. By operating within a partially disentangled Contrastive Language-Image Pre-training (CLIP) embedding space (from IP-Adapter), our method enables the flexible transfer of texture, shape, motion, style, and more abstract conceptual transformations without requiring additional training or text prompts. We demonstrate its effectiveness across a diverse range of tasks, including style transfer, form metamorphosis, and conceptual transformations, showing how subtle or abstract attributes (e.g., brushstroke style, aerodynamic lines, and dynamism) can be seamlessly combined into a new image. In a user study, participants accurately recognized which features were intended to be transferred. Its simplicity, flexibility, and high-level control make Visual Concept Blending valuable for creative fields such as art, design, and content creation, where combining specific visual qualities from multiple inspirations is crucial.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 41 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

38 of 41 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  10. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
26 more
  1. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  3. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  4. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  5. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  6. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  7. 2023Zero-shot Image-to-Image Translationcited by 505
  8. 2015A Neural Algorithm of Artistic Stylecited by 483
  9. 2017Universal Style Transfer via Feature Transformscited by 354
  10. 2016A Learned Representation For Artistic Stylecited by 341
  11. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  12. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  13. 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
  14. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  15. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  16. 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
  17. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
  18. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  19. 2024Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE)cited by 119
  20. 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
  21. 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
  22. 2023Text-To-Concept (and Back) via Cross-Model Alignmentcited by 64
  23. 2022Disentangling visual and written concepts in CLIPcited by 58
  24. 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
  25. 2020TuiGAN: Learning Versatile Image-to-Image Translation with Two Unpaired Imagescited by 23
  26. 2019ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translationcited by 9

Built on by

Not cited yet.