DeepLook: Deeper Thinking with Lookahead
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Inference-time scaling has emerged as a powerful paradigm for improving large language model reasoning, often delivering larger gains on difficult reasoning tasks than parameter scaling alone. However, existing approaches remain inefficient in how compute is allocated within a reasoning trace. Motivated by the observation that reasoning failures often exhibit an early onset of uncertainty before a wrong answer become explicit, we introduce DeepLook, a training-free monitor-and-intervene decoding framework that concentrates lookahead compute at uncertainty bottlenecks. DeepLook aggregates token-level confidence into segment-level signals, triggers when confidence drops relative to recent history, and explores candidate continuations with fixed-horizon lookahead. Branches are ranked by Average Lookahead Confidence (ALC), the average segment-level confidence over rollout continuations, then pruned and aggregated through voting. On four competition-style mathematics benchmarks across DeepSeek-R1-8B, Qwen3-32B, GPT-OSS-20B, and GPT-OSS-120B, DeepLook shifts the accuracy--token-cost Pareto frontier: it improves accuracy over DeepConf-low in 11 of 16 settings while reducing dataset-level token generation by 87.3% on average, including gains of +3.1 on AIME25 with Qwen3-32B and +8.8 on BRUMO25 with GPT-OSS-20B. These results show that selective, future-aware intervention yields substantially stronger accuracy--cost trade-offs than uniformly scaling complete reasoning trajectories. Code is available here.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 26 of its 41 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
26 of 41 references.
Closest ancestors · 17
Same direction, newest first
- 2025DeepPrune: Parallel Scaling without Inter-trace Redundancy9 Oct
- 2025MITS: Enhanced Tree Search Reasoning for LLMs via Pointwise Mutual Information4 Oct
- 2025Deep Think with Confidence21 Aug
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Efficient Reasoning Models: A Survey15 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Efficient Inference for Large Reasoning Models: A Survey29 Mar
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond27 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025φ-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation17 Mar
5 more
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 9
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2024Non-myopic Generation of Language Models for Reasoning and Planningcited by 25
- 2024Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systemscited by 24
- 2025Lookahead Tree-Based Rollouts for Enhanced Trajectory-Level Exploration in Reinforcement Learning with Verifiable Rewardscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking Tokens
- 2026Thinking by Subtraction: Confidence-Driven Contrastive Decoding for LLM Reasoning
- 2025ThinkBrake: Efficient Reasoning via Log-Probability Margin Guided Decoding
- 2025Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention
- 2025First Finish Search: Efficient Test-Time Scaling in Large Language Models
- 2026Parason: Revealing Subtask and Trial Parallelism in LLM Reasoning
- 2025Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights
- 2026ThinkBooster: A Unified Framework for Seamless Test-Time Scaling of LLM Reasoning