Recursive Agentic Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Test-time reasoning methods such as iterative refinement, decomposition, and repeated sampling are often evaluated in isolation, making their gains difficult to compare across models, benchmarks, and evaluation pipelines. We introduce a unified view of these methods as recursion operators over an agent's reasoning trace: GROW, which deepens a single reasoning path; PRUNE, which decomposes and recomposes the problem; and BRANCH, which samples alternative reasoning paths and selects among them. We evaluate all three operators against a single-pass chain-of-thought baseline under a shared harness with identical prompts, token budgets, and grading code. Across five benchmarks and three frontier models, comprising 14 model-benchmark settings, 49,327 graded items, and 151,876 model calls, BRANCH improves accuracy in all 14 settings by an average of 5.98 percentage points and is the best-performing operator in 12. In contrast, GROW yields a mean gain of 2.18 points and degrades performance in two settings, while PRUNE improves accuracy by 0.94 points on average. Analysis shows that BRANCH's advantage arises not only from exploring multiple reasoning paths, but also from recovering from truncation: its gains strongly correlate with the baseline rate of empty, budget-exhausted outputs (r = 0.72). These results weaken the hypothesis that different problems require routing among test-time reasoning operators; at this level of abstraction, repeated branching is consistently dominant. Finally, we show that unpaired evaluation and treating scoring-pipeline failures as model errors can materially change, and even reverse, comparative conclusions, motivating paired scoring as a standard protocol for test-time-compute evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 24 of its 25 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
24 of 25 references.
References · 24
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
12 more
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2025Humanity's Last Examcited by 491
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 284
- 2025BIG-Bench Extra Hardcited by 125
- 2025Every Rollout Counts: Optimal Resource Allocation for Efficient Test-Time Scalingcited by 15
- 2025Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Modelscited by 10
- 2025Policy Guided Tree Search for Enhanced LLM Reasoningcited by 9
- 2026Recursive Models for Long-Horizon Reasoningcited by 9
- 2025SSR: Socratic Self-Refine for Large Language Model Reasoningcited by 7
- 2026Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and Reproducibilitycited by 6
- 2026Recursive Agent Optimizationcited by 5
- 2026What If We Allocate Test-Time Compute Adaptively?cited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026What Limits Recursive Reasoning Models: Optimization, Architecture and Test-Time Scaling
- 2025ProRefine: Inference-Time Prompt Refinement with Textual Feedback
- 2026Agentic Systems as Boosting Weak Reasoning Models
- 2026Inducing Reasoning Primitives from Agent Traces
- 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
- 2025MARINE: Theoretical Optimization and Design for Multi-Agent Recursive IN-context Enhancement
- 2026AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks
- 2026Branch2Skill: Efficient Skill Evolution Through Reasoning Trees