mlsanityData to 14 Oct 2026

Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners

arXiv 2605.14709 ↗First posted 14 May 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Recent unified models integrate multimodal understanding and generation within a single framework. However, an "understanding-generation gap" persists, where models can capture user intent but often fail to translate this semantic knowledge into precise pixel-level manipulation. This gap results in two bottlenecks in anything-to-image task (X2I): the attention entanglement bottleneck, where blind planning struggles with complex prompts, and the visual refinement bottleneck, where unstructured feedback fails to correct imperfections efficiently. In this paper, we propose a novel framework that empowers unified models to autonomously switch between generation strategies based on instruction complexity and model capability. To achieve this, we construct a hierarchical data pipeline that constructs execution paths across three adaptive modes: direct generation for simple cases, self-reflection for quality refinement, and multi-step planning for decomposing complex scenarios. Building on this pipeline, we contribute a high-quality dataset with over 50,000 samples and implement a two-stage training strategy comprising SFT and RL. Specifically, we design step-wise reasoning rewards to ensure logical consistency and intra-group complexity penalty to prevent redundant computational overhead. Extensive experiments demonstrate that our method outperforms existing baselines on X2I, achieving superior generation fidelity among simple-to-complex instructions. The code is released at https://github.com/WeChatCV/Interleaved_Visual_Reasoner.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 71 of its 85 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

71 of 85 references.

References · 71

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  11. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
38 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  2. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  4. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  5. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  7. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  8. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  9. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  11. 2025Transfer between Modalities with MetaQueriescited by 236
  12. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  13. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  14. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  15. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
  16. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  17. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
  18. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  19. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  20. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  21. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  22. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
  23. 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
  24. 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
  25. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
  26. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
  27. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  28. 2025Unified Multimodal Discrete Diffusioncited by 49
  29. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
  30. 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 41
  31. 2025ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoningcited by 37
  32. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 29
  33. 2025An Empirical Study of GPT-4o Image Generation Capabilitiescited by 26
  34. 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
  35. 2023GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generationcited by 25
  36. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
  37. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
  38. 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.