mlsanityData to 14 Oct 2026

AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking

arXiv 2608.26141 ↗First posted 26 Jun 2026cs.CL cs.LGcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capability significantly improves performance on challenging tasks, current models apply such deep reasoning uniformly to all questions, resulting in unnecessary computational overhead for simple task. This not only degrades user experience but also negatively impact accuracy on benchmark datasets. We identify the critical need for adaptive thinking mechanisms that can intelligently determine when to engage reasoning based on question complexity. To address this, we propose AdaThinking-E, a novel reinforcement learning framework that learns adaptive thinking through one-token entropy regulation. Our key insight is that model confidence in the decision to engage thinking (or not) can be quantified through entropy analysis of the predicted probability distribution at critical decision tokens. This observation motivates our entropy-governed reward mechanism: the training process naturally transitions from high-entropy exploration, where the model experiments with different thinking strategies, to low-entropy convergence with confident, generalizable decision-making policies. Crucially, this approach enables models to intrinsically discover when to think without requiring manual intervention or external difficulty labels. Extensive experiments demonstrate that our approach enables models to be both accurate on complex problems and efficient on simple ones across diverse document tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 59 of its 108 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

59 of 108 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping9 Oct
  2. 2025ReCUT: Balancing Reasoning Length and Accuracy in LLMs via Stepwise Trails and Preference Optimization12 Jun
  3. 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learning5 Jun
  4. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models4 Jun
  5. 2025Done Is Better than Perfect: Unlocking Efficient Reasoning by Structured Multi-Turn Decomposition26 May
  6. 2025The Overthinker's DIET: Cutting Token Calories with DIfficulty-AwarE Training25 May
  7. 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
  8. 2025Incentivizing Dual Process Thinking for Efficient Large Language Model Reasoning22 May
  9. 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
  10. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
  11. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
  12. 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
9 more
  1. 2025Llama-Nemotron: Efficient Reasoning Models2 May
  2. 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities23 Mar
  3. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  4. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  5. 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
  6. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  7. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
  8. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  9. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec

Other references · 38

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  7. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  10. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  11. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  12. 2024OpenAI o1 System Cardcited by 1,244
26 more
  1. 2016A Diagram Is Worth A Dozen Imagescited by 804
  2. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  3. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  4. 2025Kimi-VL Technical Reportcited by 388
  5. 2025Seed1.5-VL Technical Reportcited by 373
  6. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  7. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  8. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
  9. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
  10. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  11. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
  12. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
  13. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 183
  14. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 174
  15. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cyclescited by 124
  16. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  17. 2025MiMo-VL Technical Reportcited by 115
  18. 2025Kwai Keye-VL Technical Reportcited by 47
  19. 2024TextHawk2: A Large Vision-Language Model Excels in Bilingual OCR and Grounding with 16x Fewer Tokenscited by 32
  20. 2025OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoningcited by 25
  21. 2024Token-level Correlation-guided Compression for Efficient Multimodal Document Understandingcited by 22
  22. 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
  23. 2025A Token-level Text Image Foundation Model for Document Understandingcited by 14
  24. 2025AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Document Understandingcited by 9
  25. 2023Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Modelscited by 4
  26. 2026ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answeringcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Explore Briefly, Then Decide: Mitigating LLM Overthinking via Cumulative Entropy Regulation
  2. 2026Reinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
  3. 2025Reasoning with Exploration: An Entropy Perspective
  4. 2025AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
  5. 2025Revisiting Entropy in Reinforcement Learning for Large Reasoning Models
  6. 2025Rethinking Entropy Interventions in RLVR: An Entropy Change Perspective
  7. 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
  8. 2025PEAR: Phase Entropy Aware Reward for Efficient Reasoning