mlsanityData to 14 Oct 2026

Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark

arXiv 2510.13759 ↗First posted 15 Oct 2025cs.CVcited by 29

Not on the map. Why?

Abstract (arXiv)

Unified multimodal models aim to jointly enable visual understanding and generation, yet current benchmarks rarely examine their true integration. Existing evaluations either treat the two abilities in isolation or overlook tasks that inherently couple them. To address this gap, we present Uni-MMMU, a comprehensive and discipline-aware benchmark that systematically unfolds the bidirectional synergy between generation and understanding across eight reasoning-centric domains, including science, coding, mathematics, and puzzles. Each task is bidirectionally coupled, demanding models to (i) leverage conceptual understanding to guide precise visual synthesis, or (ii) utilize generation as a cognitive scaffold for analytical reasoning. Uni-MMMU incorporates verifiable intermediate reasoning steps, unique ground truths, and a reproducible scoring protocol for both textual and visual outputs. Through extensive evaluation of state-of-the-art unified, generation-only, and understanding-only models, we reveal substantial performance disparities and cross-modal dependencies, offering new insights into when and how these abilities reinforce one another, and establishing a reliable foundation for advancing unified models.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 15 Oct 2025.

Builds on

16 of 35 references.

References · 16

  1. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  4. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  5. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  6. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  7. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  8. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
  9. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
  10. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 45
  11. 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
  12. 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 41
4 more
  1. 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 31
  2. 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
  3. 2024Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessmentcited by 21
  4. 2025The Telephone Game: Evaluating Semantic Drift in Unified Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 26.

29 papers.

Sort:

By area:

  1. 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 32
  2. 2026MMDeepResearch-Bench: A Benchmark for Multimodal Deep Research Agentscited by 22
  3. 2026Visual Generation Unlocks Human-Like Reasoning through Multimodal World Modelscited by 19
  4. 2026Demystifying Video Reasoningcited by 14
  5. 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 12
  6. 2025Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forwardcited by 10
  7. 2026UEval: A Benchmark for Unified Multimodal Generationcited by 9
  8. 2026Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomaliescited by 8
  9. 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 7
  10. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 6
  11. 2026Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Taskscited by 4
  12. 2025Envision: Benchmarking Unified Understanding & Generation for Causal World Process Insightscited by 2
17 more
  1. 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
  2. 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Modelscited by 2
  3. 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?cited by 2
  4. 2025AIA: Rethinking Architecture Decoupling Strategy In Unified Multimodal Modelcited by 1
  5. 2026EchoGen: Cycle-Consistent Learning for Unified Layout-Image Generation and Understandingcited by 1
  6. 2026Pseudo-Unification: Entropy Probing Reveals Divergent Information Patterns in Unified Multimodal Modelscited by 1
  7. 2026LatentUMM: Dual Latent Alignment for Unified Multimodal Modelscited by 1
  8. 2026DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Modelscited by 1
  9. 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generationcited by 1
  10. 2026The CompMath-MCQ Dataset: Are LLMs Ready for Higher-Level Math?cited by 0
  11. 2026SketchVLM: Vision language models can annotate images to explain thoughts and guide userscited by 0
  12. 2026The Cartesian Shortcut: Re-evaluate Vision Reasoning in Polar Coordinate Spacecited by 0
  13. 2026InterSketch: An Interleaved Reasoning Model with Self-correcting Visual Sketch and Stepwise Rewardcited by 0
  14. 2026IMUG-Bench: Benchmarking Unified Multimodal Models on Interleaved Understanding and Generationcited by 0
  15. 2026UniVR: Thinking in Visual Space for Unified Visual Reasoningcited by 0
  16. 2026V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learningcited by 0
  17. 2026What Comes Next? Omni-StoryBench for Evaluating Story-Grounded Omnimodal Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
  2. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
  3. 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
  4. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing
  5. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
  6. 2025Thinking with Generated Images
  7. 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
  8. 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?