Precedent-Informed Reasoning: Mitigating Overthinking in Large Reasoning Models via Test-Time Precedent Learning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Reasoning in Large Language Models (LLMs) often suffers from inefficient long chain-of-thought traces with redundant self-exploration and validation, which inflate computational costs and even degrade performance. Inspired by human reasoning patterns where people solve new problems by leveraging past related cases to constrain search spaces and reduce trial-and-error, we propose Precedent Informed Reasoning (PIR) transforming LRMs'reasoning paradigm from exhaustive self-exploration to guided learning from precedents. PIR addresses two key challenges: what precedents to adopt and how to utilize them. First, Adaptive Precedent Selection (APS) constructs, for each question and LRM, a compact set of precedents that are both semantically related and informative for the model. It ranks examples by a joint score with semantic similarity and model perplexity, then adapts the amount of precedents to maximize perplexity reduction. Second, Test-time Experience Internalization (TEI) is treated as the test-time learning on precedent-informed instruction, updating lightweight adapters to internalize solution patterns and use them as a prior during subsequent reasoning. Experiments across mathematical reasoning, scientific QA, and code generation demonstrate that PIR consistently shortens reasoning traces while maintaining or improving final accuracy across LLMs, yielding outstanding accuracy-efficiency trade-offs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 45 references that are in the map. First posted on arXiv 16 Feb 2026.
Builds on
15 of 45 references.
Closest ancestors · 7
Same direction, newest first
- 2025Beyond Fast and Slow: Cognitive-Inspired Elastic Reasoning for Large Language Models17 Dec
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
- 2025Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time12 Apr
- 2025SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning10 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025LightThinker: Thinking Step-by-Step Compression21 Feb
- 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
Other references · 8
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024OpenAI o1 System Cardcited by 1,220
- 2025ThetaEvolve: Test-time Learning on Open Problemscited by 52
- 2023Test-Time Training on Video Streamscited by 37
- 2025Fine-Tuned In-Context Learners for Efficient Adaptationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025T2: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering
- 2025Rethinking the Unsolvable: When In-Context Search Meets Test-Time Scaling
- 2025ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Search
- 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis
- 2025From Long to Short: LLMs Excel at Trimming Own Reasoning Chains
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
- 2024Large Language Models Can Self-Improve in Long-context Reasoning
- 2026Probing the Trajectories of Reasoning Traces in Large Language Models