Agentic Systems as Boosting Weak Reasoning Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
How much of the capability of a reasoning model exposed by repeated sampling can an imperfect selector recover? We study this problem as em inference-time amplification, separating em coverage---whether a useful candidate is generated---from em identifiability---whether it can be recognized among the alternatives. We show that better coverage alone does not guarantee better selection, while even imperfect local selection signals can be amplified through repetition. We also characterize proposal-side blind spots that additional sampling cannot overcome. On SWE-bench Verified, a single GPT-5.4 nano trajectory solves 67.0% of tasks, while eight proposals contain a correct patch on 79.0%; critic--comparator selection reaches 76.4%, recovering 78.3% of the oracle-exposed gain. The same pattern appears across proposer families and in mathematical reasoning, competitive programming, and formal proof. On MATH L4--5 and GSM-Plus, our selector recovers 85% and 77% of the oracle gap and substantially outperforms majority vote. Holding proposal coverage fixed, providing the selector with additional repository information also improves recovery. Conversely, when the available selection signal is weak, redundant, or misaligned, amplification can diminish or fail. These results identify selection quality as the key factor governing how much capability exposed by repeated sampling can actually be recovered.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 45 of its 57 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
45 of 57 references.
Closest ancestors · 5
Same direction, newest first
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
- 2023Reasoning with Language Model is Planning with World Model24 May
- 2022Competition-Level Code Generation with AlphaCode8 Feb
Other references · 40
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
28 more
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 480
- 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
- 2018AI safety via debatecited by 384
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
- 2023Universal Self-Consistency for Large Language Model Generationcited by 198
- 2024More Agents Is All You Needcited by 174
- 2018Supervising strong learners by amplifying weak expertscited by 139
- 2024On scalable oversight with weak LLMs judging strong LLMscited by 94
- 2025Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignmentcited by 91
- 2024Prover-Verifier Games improve legibility of LLM outputscited by 79
- 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
- 2025Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifierscited by 58
- 2023Scalable AI Safety via Doubly-Efficient Debatecited by 54
- 2021Learning to Give Checkable Answers with Prover-Verifier Gamescited by 29
- 2023Language models are weak learnerscited by 21
- 2025LLMBoost: Make Large Language Models Stronger with Boostingcited by 8
- 2026FUSE: Ensembling Verifiers with Zero Labeled Datacited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Before Reasoning Can Fail: Pre-Evidence Procedural Failures in Agentic RAG
- 2026Woodpecker Distillation: Weak Models Diagnose Reasoning Bugs in Strong Models
- 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
- 2026Inducing Reasoning Primitives from Agent Traces
- 2026Viva La Vida: Verification and Accumulation Failures in Multi-Agent Proof Search
- 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
- 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning
- 2026Can Small Agents Collaborate to Beat a Single Large Language Model?