Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners
Not on the map. Why?
Abstract (arXiv)
Recent unified models integrate multimodal understanding and generation within a single framework. However, an "understanding-generation gap" persists, where models can capture user intent but often fail to translate this semantic knowledge into precise pixel-level manipulation. This gap results in two bottlenecks in anything-to-image task (X2I): the attention entanglement bottleneck, where blind planning struggles with complex prompts, and the visual refinement bottleneck, where unstructured feedback fails to correct imperfections efficiently. In this paper, we propose a novel framework that empowers unified models to autonomously switch between generation strategies based on instruction complexity and model capability. To achieve this, we construct a hierarchical data pipeline that constructs execution paths across three adaptive modes: direct generation for simple cases, self-reflection for quality refinement, and multi-step planning for decomposing complex scenarios. Building on this pipeline, we contribute a high-quality dataset with over 50,000 samples and implement a two-stage training strategy comprising SFT and RL. Specifically, we design step-wise reasoning rewards to ensure logical consistency and intra-group complexity penalty to prevent redundant computational overhead. Extensive experiments demonstrate that our method outperforms existing baselines on X2I, achieving superior generation fidelity among simple-to-complex instructions. The code is released at https://github.com/WeChatCV/Interleaved_Visual_Reasoner.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 71 of its 85 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
71 of 85 references.
References · 71
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024GPT-4o System Cardcited by 4,588
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
38 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2025Unified Multimodal Discrete Diffusioncited by 49
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
- 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 41
- 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 29
- 2025An Empirical Study of GPT-4o Image Generation Capabilitiescited by 26
- 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
- 2023GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generationcited by 25
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.