mlsanityData to 14 Oct 2026

VMDiff: Visual Mixing Diffusion for Limitless Cross-Object Synthesis

arXiv 2509.23605 ↗First posted 28 Sep 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods often face two key challenges: coexistent generation, where multiple objects are simply juxtaposed without true integration, and bias generation, where one object dominates the output due to semantic imbalance. To address these issues, we propose Visual Mixing Diffusion (VMDiff), a simple yet effective diffusion-based framework that synthesizes a single, coherent object by integrating two input images at both noise and latent levels. Our approach comprises: (1) a hybrid sampling process that combines guided denoising, inversion, and spherical interpolation with adjustable parameters to achieve structure-aware fusion, mitigating coexistent generation; and (2) an efficient adaptive adjustment module, which introduces a novel similarity-based score to automatically and adaptively search for optimal parameters, countering semantic bias. Experiments on a curated benchmark of 780 concept pairs demonstrate that our method outperforms strong baselines in visual quality, semantic consistency, and human-rated creativity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 52 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

44 of 52 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  9. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  10. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  11. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  12. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
32 more
  1. 2024OmniGen: Unified Image Generationcited by 394
  2. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  3. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  4. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  5. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  6. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  7. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  8. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  9. 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
  10. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  11. 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
  12. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  13. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  14. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 99
  15. 2023Equivariant Multi-Modality Image Fusioncited by 99
  16. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  17. 2021Learning to Compose Visual Relationscited by 72
  18. 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
  19. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  20. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  21. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  22. 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 41
  23. 2023Neural Preset for Color Style Transfercited by 36
  24. 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
  25. 2023Compositional Inversion for Stable Diffusion Modelscited by 19
  26. 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
  27. 2025Cached Multi-Lora Composition for Multi-Concept Image Generationcited by 13
  28. 2024Novel Object Synthesis via Adaptive Text-Image Harmonycited by 12
  29. 2023Master: Meta Style Transformer for Controllable Zero-Shot and Few-Shot Artistic Style Transfercited by 9
  30. 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
  31. 2025FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusioncited by 8
  32. 2025Category-Aware 3D Object Composition with Disentangled Texture and Shape Multi-view Diffusioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.