mlsanityData to 14 Oct 2026

Towards Generalized Multi-Image Editing for Unified Multimodal Models

arXiv 2601.05572 ↗First posted 9 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Unified Multimodal Models (UMMs) integrate multimodal understanding and generation, yet they are limited to maintaining visual consistency and disambiguating visual cues when referencing details across multiple input images. In this work, we propose a scalable multi-image editing framework for UMMs that explicitly distinguishes image identities and generalizes to variable input counts. Algorithmically, we introduce two innovations: 1) The learnable latent separators explicitly differentiate each reference image in the latent space, enabling accurate and disentangled conditioning. 2) The sinusoidal index encoding assigns visual tokens from the same image a continuous sinusoidal index embedding, which provides explicit image identity while allowing generalization and extrapolation on a variable number of inputs. To facilitate training and evaluation, we establish a high-fidelity benchmark using an inverse dataset construction methodology to guarantee artifact-free, achievable outputs. Experiments show clear improvements in semantic consistency, visual fidelity, and cross-image integration over prior baselines on diverse multi-image editing tasks, validating our advantages on consistency and generalization ability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 71 of its 75 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

71 of 75 references.

References · 71

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Segment Anythingcited by 8,234
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  11. 2025Qwen-Image Technical Reportcited by 1,044
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
38 more
  1. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  3. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  6. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  7. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  8. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  9. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  10. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  11. 2021Unifying Vision-and-Language Tasks via Text Generationcited by 412
  12. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  13. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  14. 2025Seed1.5-VL Technical Reportcited by 373
  15. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  16. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  17. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  18. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  19. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  20. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  21. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  22. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  23. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  24. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  25. 2024Rotary Position Embedding for Vision Transformercited by 236
  26. 2025Transfer between Modalities with MetaQueriescited by 236
  27. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  28. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  29. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  30. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
  31. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
  32. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  33. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
  34. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  35. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  36. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  37. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
  38. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.