mlsanityData to 14 Oct 2026

Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward

arXiv 2511.20561 ↗First posted 25 Nov 2025cs.CV cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Recent years have witnessed significant progress in Unified Multimodal Models, yet a fundamental question remains: Does understanding truly inform generation in Unified Multimodal Models? To investigate this, we introduce UniSandbox, a decoupled evaluation framework paired with controlled, synthetic datasets to avoid data leakage and enable detailed analysis. Our findings reveal a significant understanding-generation gap, which is mainly reflected in two key dimensions: reasoning generation and knowledge transfer. Specifically, for reasoning generation tasks, we observe that explicit Chain-of-Thought (CoT) in the understanding module effectively bridges the gap, and further demonstrate that a self-training approach can successfully internalize this ability, enabling implicit reasoning during generation. Additionally, for knowledge transfer tasks, we find that CoT assists the generative process by helping retrieve newly learned knowledge, and also discover that query-based architectures inherently exhibit latent CoT-like properties that affect this transfer. UniSandbox provides preliminary insights for designing future unified architectures and training strategies that truly bridge the understanding-generation gap.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 48 of its 55 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

48 of 55 references.

References · 48

  1. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  2. 2025Qwen-Image Technical Reportcited by 1,044
  3. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  4. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  5. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  6. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  7. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  8. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  9. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  10. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  11. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  12. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
36 more
  1. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  2. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  3. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
  4. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  5. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  6. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  7. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  8. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
  9. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 109
  10. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
  11. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  12. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
  13. 2025Ovis-U1 Technical Reportcited by 67
  14. 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 63
  15. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
  16. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Modelcited by 55
  17. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  18. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 49
  19. 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 46
  20. 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
  21. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
  22. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 32
  23. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPOcited by 30
  24. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 29
  25. 2025Ming-UniVision: Joint Image Understanding and Generation with a Unified Continuous Tokenizercited by 28
  26. 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
  27. 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learningcited by 24
  28. 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 22
  29. 2024PUMA: Empowering Unified MLLM with Multi-granular Visual Generationcited by 20
  30. 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 18
  31. 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
  32. 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoningcited by 15
  33. 2025LangBridge: Interpreting Image as a Combination of Language Embeddingscited by 10
  34. 2025Turning Internal Gap into Self-Improvement: Promoting the Generation-Understanding Unification in MLLMscited by 10
  35. 2025TBAC-UniImage: Unified Understanding and Generation by Ladder-Side Diffusion Tuningcited by 10
  36. 2025Multimodal Language Models as Text-to-Image Model Evaluatorscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
  2. 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
  3. 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
  4. 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?
  5. 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
  6. 2025Understanding-in-Generation: Reinforcing Generative Capability of Unified Model via Infusing Understanding into Generation
  7. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing
  8. 2025UniHetero: Could Generation Enhance Understanding for Vision-Language-Model at Large Data Scale?