Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Software engineering coding agents
Abstract (arXiv)
As agents take on longer and more complex problems, controlling the execution becomes a task in its own right. Each step in the run brings new control choices, like which partial work to build on, whether to start fresh, or when to stop. We introduce agentic meta-reasoning, an inference-time harness that makes these choices an explicit and structured reasoning process. Workers carry out the task-level computation, while a controller consolidates what the run has established, explores next options, assesses what each option is worth under the remaining budget, and dispatches the chosen work with context drawn from persistent memory. Between decisions the controller carries only a compact account of the run rather than replaying its full history. Our baselines span production coding agents and research harnesses, together with a Direct Control Agent using the same workers and compute budget allowance. On ProgramBench, which tests long-horizon agentic capability through program reconstruction, meta-reasoning achieves 71.5% with GPT-5.5 against 58.0% for Codex; with Opus 4.8 it achieves 67.2% against 65.5% for Claude Code. On the other benchmarks, spanning abstract reasoning, multi-domain long-horizon reasoning, and proof generation, it gains between 3.6 and 4.2 points over direct control, averaged across three frontier models. It keeps improving over the tested budget ranges where direct control plateaus, though its overhead can hurt at small budgets. Artifact-graph analysis reveals more reuse of earlier work, higher coverage of correct solutions in most settings, and nonuniform gains in final selection. These results indicate that spending computation on structured control becomes more important as agents scale to longer runs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 42 of its 50 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
42 of 50 references.
Closest ancestors · 3
Same direction, newest first
- 2025Learning to Orchestrate Agents in Natural Language with the Conductor4 Dec
- 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol14 Jun
- 2024Language Agents as Optimizable Graphs26 Feb
Other references · 39
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
27 more
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 172
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 171
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
- 2025Towards Robust Mathematical Reasoningcited by 67
- 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 63
- 2026ProgramBench: Can Language Models Rebuild Programs From Scratch?cited by 47
- 2026Rethinking the Evaluation of Harness Evolution for Agentscited by 39
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 33
- 2025Adaptive Tool Use in Large Language Models with Meta-Cognition Triggercited by 29
- 2025Shrinking the Generation-Verification Gap with Weak Verifierscited by 21
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 13
- 2026Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causescited by 11
- 2026Failure as a Process: An Anatomy of CLI Coding Agent Trajectoriescited by 11
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoningcited by 9
- 2025Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundariescited by 8
- 2026ROI-Reasoning: Rational Optimization for Inference via Pre-Computation Meta-Cognitioncited by 8
- 2026AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Trackingcited by 8
- 2025Meta-R1: Empowering Large Reasoning Models with Metacognitioncited by 6
- 2026Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failurescited by 6
- 2025TRINITY: An Evolved LLM Coordinatorcited by 5
- 2026When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoningcited by 5
- 2025Monitor-Generate-Verify (MGV): Formalising Metacognitive Theory for Language Model Reasoningcited by 4
- 2026LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scalingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Second Thought: Reasoning in Parallel as LLM Agents Act and Observe
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents
- 2026Deep Reasoning in General Purpose Agents via Structured Meta-Cognition
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2026Don't Overthink, Don't Underthink: Toward Adaptive Reasoning in Agentic AI
- 2026Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning
- 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
- 2026Adaptive Latent Agentic Reasoning