mlsanityData to 14 Oct 2026

Mixture-of-Visual-Thoughts: Exploring Context-Adaptive Reasoning Mode Selection for General Visual Reasoning

arXiv 2509.22746 ↗First posted 26 Sep 2025cs.AI cs.CVcited by 7

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Current visual reasoning methods mainly focus on exploring specific reasoning modes. Although improvements can be achieved in particular domains, they struggle to develop general reasoning capabilities. Inspired by this, we propose a novel adaptive reasoning paradigm, Mixture-of-Visual-Thoughts (MoVT), which unifies different reasoning modes within a single model and guides it to select the appropriate mode based on context. To achieve this, we introduce AdaVaR, a two-stage Adaptive Visual Reasoning learning framework: different modes are unified and learned during the supervised cold-start stage, and the mode selection capability is induced via an RL process with a carefully designed AdaGRPO algorithm. Extensive experiments show that AdaVaR effectively guides the model to learn and differentiate multiple modes and perform context-adaptive mode selection, achieving consistent improvement across various scenarios, highlighting MoVT as an effective solution for building general visual reasoning models.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 67 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

41 of 67 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  2. 2025Grounded Reinforcement Learning for Visual Reasoning29 May
  3. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
  4. 2025GRIT: Teaching MLLMs to Think with Images21 May
  5. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
  6. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  7. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  8. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  9. 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
  10. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  11. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  12. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
11 more
  1. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  2. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  3. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  4. 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLM3 Jan
  5. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  6. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct
  7. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  8. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May
  9. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  10. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  11. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 18

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  9. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  10. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  11. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  12. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
6 more
  1. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
  2. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 103
  3. 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
  4. 2025One RL to See Them All: Visual Triple Unified Reinforcement Learningcited by 30
  5. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoningcited by 25
  6. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligencecited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Adaptive Reasoning Paths for Efficient Visual Reasoning
  2. 2025Reinforced Visual Perception with Tools
  3. 2025VGR: Visual Grounded Reasoning
  4. 2024Take A Step Back: Rethinking the Two Stages in Visual Reasoning
  5. 2025Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models
  6. 2025A Cognitive Paradigm Approach to Probe the Perception-Reasoning Interface in VLMs
  7. 2023One Self-Configurable Model to Solve Many Abstract Visual Reasoning Problems
  8. 2026Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning