Adaptive Look, Flexible Thought: Learning How and How Long to Think in Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
The introduction of long chain-of-thought (CoT) reasoning and external tools has substantially improved the performance of multimodal large language models (MLLMs) on general and reasoning tasks. However, existing fast-slow reasoning paradigms mainly regulate textual reasoning length, while visual computation introduced by external tools or visual tokens is often treated as an auxiliary component. This separation prevents MLLMs from jointly optimizing visual perception and textual reasoning. To address this issue, we propose L2T (adaptive Look, flexible Thought), a unified reasoning framework that jointly optimizes the form and depth of computation. L2T first discretizes tool-produced visual states into visual tokens, bringing visual perception and textual reasoning into a shared autoregressive space. Based on this unified representation, L2T introduces a modality-aware routing reward to select appropriate reasoning modes and a difficulty-aware fast-slow strategy to adapt reasoning depth according to task complexity. Experiments on general perception and reasoning-intensive tasks demonstrate the effectiveness of L2T. Compared with explicit tool-calling approaches, L2T maintains competitive performance while achieving 1.7--3.6 times higher throughput.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 47 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
37 of 47 references.
Closest ancestors · 14
Same direction, newest first
- 2026Latent Visual States for Efficient Multimodal Reasoning23 Jun
- 2026ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both14 May
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models30 Sep
- 2025Thyme: Think Beyond Images15 Aug
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning18 Nov
2 more
Other references · 23
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023Let's Verify Step by Stepcited by 3,789
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 303
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
11 more
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 161
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Modelscited by 158
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
- 2025Think When You Need: Self-Adaptive Chain-of-Thought Learningcited by 38
- 2025Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoningcited by 36
- 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoningcited by 34
- 2025Mull-Tokens: Modality-Agnostic Latent Thinkingcited by 19
- 2026Same Signal, Opposite Meaning: Direction-Informed Adaptive Learning for LLM Agentscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2026UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
- 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstraction
- 2026Distilling Visual Reasoning into Text Space
- 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMs
- 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
- 2026TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding