Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward
Not on the map. Why?
Abstract (arXiv)
Recent years have witnessed significant progress in Unified Multimodal Models, yet a fundamental question remains: Does understanding truly inform generation in Unified Multimodal Models? To investigate this, we introduce UniSandbox, a decoupled evaluation framework paired with controlled, synthetic datasets to avoid data leakage and enable detailed analysis. Our findings reveal a significant understanding-generation gap, which is mainly reflected in two key dimensions: reasoning generation and knowledge transfer. Specifically, for reasoning generation tasks, we observe that explicit Chain-of-Thought (CoT) in the understanding module effectively bridges the gap, and further demonstrate that a self-training approach can successfully internalize this ability, enabling implicit reasoning during generation. Additionally, for knowledge transfer tasks, we find that CoT assists the generative process by helping retrieve newly learned knowledge, and also discover that query-based architectures inherently exhibit latent CoT-like properties that affect this transfer. UniSandbox provides preliminary insights for designing future unified architectures and training strategies that truly bridge the understanding-generation gap.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 48 of its 55 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
48 of 55 references.
References · 48
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
36 more
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 109
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2025Ovis-U1 Technical Reportcited by 67
- 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 63
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 55
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 46
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 32
- 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPOcited by 30
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 29
- 2025Ming-UniVision: Joint Image Understanding and Generation with a Unified Continuous Tokenizercited by 28
- 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
- 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learningcited by 24
- 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 22
- 2024PUMA: Empowering Unified MLLM with Multi-granular Visual Generationcited by 20
- 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 18
- 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
- 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoningcited by 15
- 2025LangBridge: Interpreting Image as a Combination of Language Embeddingscited by 10
- 2025Turning Internal Gap into Self-Improvement: Promoting the Generation-Understanding Unification in MLLMscited by 10
- 2025TBAC-UniImage: Unified Understanding and Generation by Ladder-Side Diffusion Tuningcited by 10
- 2025Multimodal Language Models as Text-to-Image Model Evaluatorscited by 3
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 18
- 2026UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Modelscited by 7
- 2026iFSQ: Improving FSQ for Image Generation with 1 Line of Codecited by 4
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Rewardcited by 4
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generationcited by 4
- 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipescited by 3
- 2026MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Concept Customizationcited by 1
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
- 2026OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?cited by 0
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation29 Sep 2026
- 2026OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?29 Sep 2026
- 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes5 Aug 2026
- 2026MetaPoint: Unlocking Precise Spatial Control in Agentic Visual Generation3 Jun 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward12 May 2026
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation27 Apr 2026
- 2026MoKus: Leveraging Cross-Modal Knowledge Transfer for Knowledge-Aware Concept Customization13 Mar 2026
- 2026UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Models9 Feb 2026
- 2026iFSQ: Improving FSQ for Image Generation with 1 Line of Code23 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
- 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
- 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?
- 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
- 2025Understanding-in-Generation: Reinforcing Generative Capability of Unified Model via Infusing Understanding into Generation
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing
- 2025UniHetero: Could Generation Enhance Understanding for Vision-Language-Model at Large Data Scale?