MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models
Not on the map. Why?
Abstract (arXiv)
Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related images, existing benchmarks rarely address the challenges of multi-image context generation, focusing mainly on text-to-image or single-image editing tasks. In this work, we introduce MICON-Bench, a comprehensive benchmark covering six tasks that evaluate cross-image composition, contextual reasoning, and identity preservation. We further propose an MLLM-driven Evaluation-by-Checkpoint framework for automatic verification of semantic and visual consistency, where multimodal large language model (MLLM) serves as a verifier. Additionally, we present Dynamic Attention Rebalancing (DAR), a training-free, plug-and-play mechanism that dynamically adjusts attention during inference to enhance coherence and reduce hallucinations. Extensive experiments on various state-of-the-art open-source models demonstrate both the rigor of MICON-Bench in exposing multi-image reasoning challenges and the efficacy of DAR in improving generation quality and cross-image coherence. Github: https://github.com/Angusliuuu/MICON-Bench.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
39 of 46 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Qwen-Image Technical Reportcited by 973
27 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 55
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
- 2025Generating Multi-Image Synthetic Data for Text-to-Image Customizationcited by 25
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
- 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learningcited by 22
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 16
- 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoningcited by 15
- 2025GenSpace: Benchmarking Spatially-Aware Image Generationcited by 9
- 2025MultiRef: Controllable Image Generation with Multiple Visual Referencescited by 9
- 2024IDEA-Bench: How Far are Generative Models from Professional Designing?cited by 7
- 2024TraDiffusion: Trajectory-Based Training-Free Image Generationcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MultiBind: A Benchmark for Attribute Misbinding in Multi-Subject Generationcited by 3
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026MIEScore: Human-Aligned Evaluation for Multi-Source Image Editingcited by 1
- 2026StructGen: Disambiguating Multi-Reference Image Generation via Structured Context Modelingcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generationcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation17 Aug 2026
- 2026MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing3 Aug 2026
- 2026StructGen: Disambiguating Multi-Reference Image Generation via Structured Context Modeling17 Jul 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026MultiBind: A Benchmark for Attribute Misbinding in Multi-Subject Generation23 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark
- 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
- 2024MIBench: Evaluating Multimodal Large Language Models over Multiple Images
- 2025Zoomer: Adaptive Image Focus Optimization for Black-box MLLM
- 2025True Multimodal In-Context Learning Needs Attention to the Visual Context
- 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Models
- 2026COHERENCE: Benchmarking Fine-Grained Image-Text Alignment in Interleaved Multimodal Contexts
- 2024MileBench: Benchmarking MLLMs in Long Context