mlsanityData to 7 Oct 2026

Batch Prompting Suppresses Overthinking Reasoning Under Constraint: How Batch Prompting Suppresses Overthinking in Reasoning Models

arXiv 2511.04108 ↗First posted 6 Nov 2025cs.CLcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) achieve strong performance through explicit chain-of-thought reasoning but suffer from textitoverthinking: generating excessive reasoning tokens even for trivial queries. Beyond inflating cost, overthinking can be self-defeating: models enter recursive self-doubt loops that exhaust token budgets without producing an answer, causing API timeouts that directly hurt accuracy. We present an empirical study showing that batch prompting, originally introduced for throughput optimization, effectively suppresses overthinking at inference time. Across 13 diverse benchmarks with DeepSeek-R1 and OpenAI-o1, batch prompting reduces reasoning tokens by 76% (2,950mapsto710), on average, while preserving or improving accuracy. Through behavioral analysis, we find that batching induces three beneficial effects: (1) it reduces per-query reasoning effort when multiple queries share a context; (2) it enables pattern induction, where models generalize from earlier examples to solve later ones; and (3) it suppresses hedging behavior (e.g., ``textttwait,'' ``textttlet me double-check'') that signals metacognitive loops. We also show that explicit prompt constraints (``textttUse no more than 100 tokens in thinking.'') fail to reduce overthinking; models either ignore them or sacrifice accuracy. These findings reframe batch prompting as more than a cost optimization: it is a practical inference-time technique that improves efficiency and reliability without model modification.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 26 of its 29 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

26 of 29 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025DRQA: Dynamic Reasoning Quota Allocation for Controlling Overthinking in Reasoning Large Language Models25 Aug
  2. 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis25 Aug
  3. 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steering28 May
  4. 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
  5. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May

Other references · 19

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  6. 2023Large Language Models as Optimizerscited by 830
  7. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  8. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  9. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  10. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
  11. 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
  12. 2025BIG-Bench Extra Hardcited by 123
7 more
  1. 2023Batch Prompting: Efficient Inference with Large Language Model APIscited by 84
  2. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 76
  3. 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
  4. 2025Instruction-Tuning LLMs for Event Extraction with Annotation Guidelinescited by 18
  5. 2023Instances Need More Care: Rewriting Prompts for Instances with LLMs in the Loop Yields Better Zero-Shot Performancecited by 9
  6. 2025Revisiting Prompt Optimization with Large Reasoning Models-A Case Study on Event Extractioncited by 6
  7. 2025Multimodal Event Detection: Current Approaches and Defining the New Playground through LLMs and VLMscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models
  2. 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning
  3. 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
  4. 2025Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt
  5. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models
  6. 2026RATIO: Reasoning Analysis and Token-level Inference Optimization for Quantized Reasoning Models
  7. 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models
  8. 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning