VMDiff: Visual Mixing Diffusion for Limitless Cross-Object Synthesis
Not on the map. Why?
Abstract (arXiv)
Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods often face two key challenges: coexistent generation, where multiple objects are simply juxtaposed without true integration, and bias generation, where one object dominates the output due to semantic imbalance. To address these issues, we propose Visual Mixing Diffusion (VMDiff), a simple yet effective diffusion-based framework that synthesizes a single, coherent object by integrating two input images at both noise and latent levels. Our approach comprises: (1) a hybrid sampling process that combines guided denoising, inversion, and spherical interpolation with adjustable parameters to achieve structure-aware fusion, mitigating coexistent generation; and (2) an efficient adaptive adjustment module, which introduces a novel similarity-based score to automatically and adaptively search for optimal parameters, countering semantic bias. Experiments on a curated benchmark of 780 concept pairs demonstrate that our method outperforms strong baselines in visual quality, semantic consistency, and human-rated creativity.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 52 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
44 of 52 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
32 more
- 2024OmniGen: Unified Image Generationcited by 394
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 99
- 2023Equivariant Multi-Modality Image Fusioncited by 99
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2021Learning to Compose Visual Relationscited by 72
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 41
- 2023Neural Preset for Color Style Transfercited by 36
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2023Compositional Inversion for Stable Diffusion Modelscited by 19
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
- 2025Cached Multi-Lora Composition for Multi-Concept Image Generationcited by 13
- 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
- 2023Master: Meta Style Transformer for Controllable Zero-Shot and Few-Shot Artistic Style Transfercited by 9
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2025FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusioncited by 8
- 2025Category-Aware 3D Object Composition with Disentangled Texture and Shape Multi-view Diffusioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.