Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Current visual reasoning methods mainly focus on exploring specific reasoning modes. Although improvements can be achieved in particular domains, they struggle to develop general reasoning capabilities. Inspired by this, we propose a novel adaptive reasoning paradigm, Mixture-of-Visual-Thoughts (MoVT), which unifies different reasoning modes within a single model and guides it to select the appropriate mode based on context. To achieve this, we introduce AdaVaR, a two-stage Adaptive Visual Reasoning learning framework: different modes are unified and learned during the supervised cold-start stage, and the mode selection capability is induced via an RL process with a carefully designed AdaGRPO algorithm. Extensive experiments show that AdaVaR effectively guides the model to learn and differentiate multiple modes and perform context-adaptive mode selection, achieving consistent improvement across various scenarios, highlighting MoVT as an effective solution for building general visual reasoning models.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 67 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
41 of 67 references.
Closest ancestors · 23
Same direction, newest first
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025Grounded Reinforcement Learning for Visual Reasoning29 May
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
11 more
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
6 more
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 103
- 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
- 2025One RL to See Them All: Visual Triple Unified Reinforcement Learningcited by 30
- 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoningcited by 25
- 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligencecited by 24
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decodingcited by 12
- 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environmentscited by 5
- 2026AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Processcited by 3
- 2026PersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoningcited by 0
- 2026Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learningcited by 0
- 2026Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsingcited by 0
- 2026Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsing20 Sep 2026
- 2026Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning9 Jul 2026
- 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments15 Apr 2026
- 2026Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding9 Mar 2026
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception12 Feb 2026
- 2026AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Process2 Feb 2026
- 2026PersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoning13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning Adaptive Reasoning Paths for Efficient Visual Reasoning
- 2025Reinforced Visual Perception with Tools
- 2025VGR: Visual Grounded Reasoning
- 2024Take A Step Back: Rethinking the Two Stages in Visual Reasoning
- 2025Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models
- 2025A Cognitive Paradigm Approach to Probe the Perception-Reasoning Interface in VLMs
- 2023One Self-Configurable Model to Solve Many Abstract Visual Reasoning Problems
- 2026Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning