Towards Generalized Multi-Image Editing for Unified Multimodal Models
Not on the map. Why?
Abstract (arXiv)
Unified Multimodal Models (UMMs) integrate multimodal understanding and generation, yet they are limited to maintaining visual consistency and disambiguating visual cues when referencing details across multiple input images. In this work, we propose a scalable multi-image editing framework for UMMs that explicitly distinguishes image identities and generalizes to variable input counts. Algorithmically, we introduce two innovations: 1) The learnable latent separators explicitly differentiate each reference image in the latent space, enabling accurate and disentangled conditioning. 2) The sinusoidal index encoding assigns visual tokens from the same image a continuous sinusoidal index embedding, which provides explicit image identity while allowing generalization and extrapolation on a variable number of inputs. To facilitate training and evaluation, we establish a high-fidelity benchmark using an inverse dataset construction methodology to guarantee artifact-free, achievable outputs. Experiments show clear improvements in semantic consistency, visual fidelity, and cross-image integration over prior baselines on diverse multi-image editing tasks, validating our advantages on consistency and generalization ability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 71 of its 75 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
71 of 75 references.
References · 71
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Segment Anythingcited by 8,234
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
38 more
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2021Unifying Vision-and-Language Tasks via Text Generationcited by 412
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2025Seed1.5-VL Technical Reportcited by 373
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2017VITON: An Image-based Virtual Try-on Networkcited by 286
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2024Rotary Position Embedding for Vision Transformercited by 236
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026JewelTry: Mask-Free Scale Aware Jewelry Virtual Try-Oncited by 0
- 2026JewelTry: Mask-Free Scale Aware Jewelry Virtual Try-On15 Sep 2026