AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capability significantly improves performance on challenging tasks, current models apply such deep reasoning uniformly to all questions, resulting in unnecessary computational overhead for simple task. This not only degrades user experience but also negatively impact accuracy on benchmark datasets. We identify the critical need for adaptive thinking mechanisms that can intelligently determine when to engage reasoning based on question complexity. To address this, we propose AdaThinking-E, a novel reinforcement learning framework that learns adaptive thinking through one-token entropy regulation. Our key insight is that model confidence in the decision to engage thinking (or not) can be quantified through entropy analysis of the predicted probability distribution at critical decision tokens. This observation motivates our entropy-governed reward mechanism: the training process naturally transitions from high-entropy exploration, where the model experiments with different thinking strategies, to low-entropy convergence with confident, generalizable decision-making policies. Crucially, this approach enables models to intrinsically discover when to think without requiring manual intervention or external difficulty labels. Extensive experiments demonstrate that our approach enables models to be both accurate on complex problems and efficient on simple ones across diverse document tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 59 of its 108 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
59 of 108 references.
Closest ancestors · 21
Same direction, newest first
- 2025ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping9 Oct
- 2025ReCUT: Balancing Reasoning Length and Accuracy in LLMs via Stepwise Trails and Preference Optimization12 Jun
- 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learning5 Jun
- 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models4 Jun
- 2025Done Is Better than Perfect: Unlocking Efficient Reasoning by Structured Multi-Turn Decomposition26 May
- 2025The Overthinker's DIET: Cutting Token Calories with DIfficulty-AwarE Training25 May
- 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
- 2025Incentivizing Dual Process Thinking for Efficient Large Language Model Reasoning22 May
- 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
9 more
- 2025Llama-Nemotron: Efficient Reasoning Models2 May
- 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities23 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2024OpenAI o1 System Cardcited by 1,244
26 more
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2025Kimi-VL Technical Reportcited by 388
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 183
- 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cyclescited by 124
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025MiMo-VL Technical Reportcited by 115
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
- 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoningcited by 25
- 2024Token-level Correlation-guided Compression for Efficient Multimodal Document Understandingcited by 22
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
- 2025A Token-level Text Image Foundation Model for Document Understandingcited by 14
- 2025AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Document Understandingcited by 9
- 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Modelscited by 4
- 2026ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answeringcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Explore Briefly, Then Decide: Mitigating LLM Overthinking via Cumulative Entropy Regulation
- 2026Reinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
- 2025Reasoning with Exploration: An Entropy Perspective
- 2025AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
- 2025Revisiting Entropy in Reinforcement Learning for Large Reasoning Models
- 2025Rethinking Entropy Interventions in RLVR: An Entropy Change Perspective
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2025PEAR: Phase Entropy Aware Reward for Efficient Reasoning