mlsanityData to 14 Oct 2026

When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?

arXiv 2608.22174 ↗First posted 23 Aug 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding? Existing evaluations provide mixed evidence, but confound task difficulty, reasoning paradigms, and the closed-loop interaction between generation and understanding. We introduce VGAU-Diag, a fine-grained evaluation framework for vision generation-assisted understanding. It stratifies samples by difficulty, enables unified evaluation of multiple reasoning paradigms, and uses Oracle-Assisted Reference Protocols. Our analysis shows that generated visual aids help on easier instances but become unreliable as reasoning complexity increases. Oracle-assisted diagnosis further reveals that the main bottleneck often lies on the visual-understanding side rather than the visual-generation side, as current UMMs struggle to leverage even faithful visual aids. We also show that effective visual generation should target visual-understanding bottlenecks rather than add more reasoning steps, and identify a three-stage transition from task-irrelevant noise, to misleading plausible guidance, and finally to useful assistance. These findings would be useful to guide the development of better UMMs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

19 of 30 references.

References · 19

  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  2. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  3. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  4. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  5. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
  6. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
  7. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
  8. 2025The LLM Already Knows: Estimating LLM-Perceived Question Difficulty via Hidden Representationscited by 29
  9. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 29
  10. 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
  11. 2025Autoregressive Semantic Visual Reconstruction Helps VLMs Understand Bettercited by 17
  12. 2025ViC-Bench: Benchmarking Visual-Interleaved Chain-of-Thought Capability in MLLMs with Free-Style Intermediate State Representationscited by 12
7 more
  1. 2025CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generationcited by 10
  2. 2025MammothModa2: A Unified AR-Diffusion Framework for Multimodal Understanding and Generationcited by 9
  3. 2026MentisOculi: Revealing the Limits of Reasoning with Mental Imagerycited by 7
  4. 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?cited by 7
  5. 2025Anchoring Values in Temporal and Group Dimensions for Flow Matching Model Alignmentcited by 6
  6. 2025STAR: STacked AutoRegressive Scheme for Unified Multimodal Learningcited by 6
  7. 2025See Different, Think Better: Visual Variations Mitigating Hallucinations in LVLMscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Thinking with Generated Images
  2. 2026Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
  3. 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
  4. 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?
  5. 2026Forge-and-Quench: Enhancing Image Generation for Higher Fidelity in Unified Multimodal Models
  6. 2026A Model-Internal Protocol for Assessing Multimodal Models as Integrated Systems
  7. 2026See2Think: Do Multimodal Models Really Use Intermediate Visual States?
  8. 2025Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward