mlsanityData to 14 Oct 2026

Exploring Efficiency Frontiers of Thinking Budget in Medical Reasoning: Scaling Laws between Computational Resources and Reasoning Quality

arXiv 2508.12140 ↗First posted 16 Aug 2025cs.CLcited by 6

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

This study presents the first comprehensive evaluation of thinking budget mechanisms in medical reasoning tasks, revealing fundamental scaling laws between computational resources and reasoning quality. We systematically evaluated two major model families, Qwen3 (1.7B to 235B parameters) and DeepSeek-R1 (1.5B to 70B parameters), across 15 medical datasets spanning diverse specialties and difficulty levels. Through controlled experiments with thinking budgets ranging from zero to unlimited tokens, we establish logarithmic scaling relationships where accuracy improvements follow a predictable pattern with both thinking budget and model size. Our findings identify three distinct efficiency regimes: high-efficiency (0 to 256 tokens) suitable for real-time applications, balanced (256 to 512 tokens) offering optimal cost-performance tradeoffs for routine clinical support, and high-accuracy (above 512 tokens) justified only for critical diagnostic tasks. Notably, smaller models demonstrate disproportionately larger benefits from extended thinking, with 15 to 20% improvements compared to 5 to 10% for larger models, suggesting a complementary relationship where thinking budget provides greater relative benefits for capacity-constrained models. Domain-specific patterns emerge clearly, with neurology and gastroenterology requiring significantly deeper reasoning processes than cardiovascular or respiratory medicine. The consistency between Qwen3 native thinking budget API and our proposed truncation method for DeepSeek-R1 validates the generalizability of thinking budget concepts across architectures. These results establish thinking budget control as a critical mechanism for optimizing medical AI systems, enabling dynamic resource allocation aligned with clinical needs while maintaining the transparency essential for healthcare deployment.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 45 of its 91 references that are in the map. First posted on arXiv 16 Aug 2025.

Builds on

45 of 91 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2020Scaling Laws for Neural Language Modelscited by 6,586
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2023Let's Verify Step by Stepcited by 3,789
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  11. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  12. 2023Qwen Technical Reportcited by 3,344
33 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  2. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  3. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  4. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  5. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  6. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  7. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  8. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  10. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  11. 2023A Comprehensive Overview of Large Language Modelscited by 648
  12. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  13. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  14. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
  15. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 331
  16. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
  17. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  18. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
  19. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
  20. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  21. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  22. 2024Capabilities of Gemini Models in Medicinecited by 237
  23. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
  24. 2024Empowering Biomedical Discovery with AI Agentscited by 118
  25. 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 116
  26. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 92
  27. 2023PMC-LLaMA: Towards Building Open-source Language Models for Medicinecited by 88
  28. 2023Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agentscited by 72
  29. 2023Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encodingcited by 71
  30. 2019Exploring large scale public medical image datasetscited by 37
  31. 2025Steering LLM Thinking with Budget Guidancecited by 33
  32. 2023Ethical Framework for Harnessing the Power of AI in Healthcare and Beyondcited by 6
  33. 2025Rare Disease Differential Diagnosis with Large Language Models at Scale: From Abdominal Actinomycosis to Wilson's Diseasecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models
  2. 2025O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoning
  3. 2026MedCoG: Maximizing LLM Inference Density in Medical Reasoning via Meta-Cognitive Regulation
  4. 2025Knowledge or Reasoning? A Close Look at How LLMs Think Across Domains
  5. 2025Increasing the Thinking Budget is Not All You Need
  6. 2026Scaling Clinical Judgment to Evaluate Medical AI
  7. 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
  8. 2026Medical Reasoning with Large Language Models: A Survey and MR-Bench