Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Unified multimodal models (UMMs) with interleaved reasoning, which generate both textual and visual steps as part of intermediate reasoning traces, have demonstrated great potential for visual mathematical reasoning tasks. However, we identify a key insight in this paradigm: generating intermediate visual reasoning steps is not always beneficial and can even be harmful, as self-generated visual steps may introduce erroneous visual evidence that misleads subsequent reasoning. Moreover, frequently triggering visual steps during reasoning incurs substantial computational and memory overhead, degrading inference efficiency. To address these accuracy and efficiency challenges, we observe that the model's internal signals can indicate whether a visual step will benefit reasoning before the entire visual generation is completed. Specifically, this work identifies two internal signals: 1) Generation Intent, which reflects whether the model has a concrete textual plan for what to draw, and 2) Visual Fidelity, which measures whether the visual generation remains grounded in the original input image. Leveraging these internal signals, we propose AdaViG, a training-free adaptive visual gating method for unified multimodal reasoning. AdaViG dynamically evaluates each triggered visual step at an early visual generation stage and aborts it when both signals are weak, thereby preventing misleading visual evidence from entering the reasoning trace while avoiding unnecessary computation. Comprehensive experiments demonstrate that AdaViG improves accuracy by up to 5.7% while reducing visual generation FLOPs by 25.0%-91.0% and wall-clock latency by 15.4%-45.6%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 43 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
29 of 43 references.
Closest ancestors · 15
Same direction, newest first
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space14 Dec
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct
- 2025CodePlot-CoT: Mathematical Visual Reasoning by Thinking with Code-Driven Images13 Oct
- 2025AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning30 Sep
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step23 Jan
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2024DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models29 Oct
3 more
Other references · 14
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
- 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
- 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learningcited by 24
- 2024ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Modelscited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
- 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2026See2Think: Do Multimodal Models Really Use Intermediate Visual States?
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
- 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- 2026Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning