mlsanityData to 7 Oct 2026

Agentic Systems as Boosting Weak Reasoning Models

arXiv 2605.14163 ↗First posted 13 May 2026cs.AIcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

How much of the capability of a reasoning model exposed by repeated sampling can an imperfect selector recover? We study this problem as em inference-time amplification, separating em coverage---whether a useful candidate is generated---from em identifiability---whether it can be recognized among the alternatives. We show that better coverage alone does not guarantee better selection, while even imperfect local selection signals can be amplified through repetition. We also characterize proposal-side blind spots that additional sampling cannot overcome. On SWE-bench Verified, a single GPT-5.4 nano trajectory solves 67.0% of tasks, while eight proposals contain a correct patch on 79.0%; critic--comparator selection reaches 76.4%, recovering 78.3% of the oracle-exposed gain. The same pattern appears across proposer families and in mathematical reasoning, competitive programming, and formal proof. On MATH L4--5 and GSM-Plus, our selector recovers 85% and 77% of the oracle gap and substantially outperforms majority vote. Holding proposal coverage fixed, providing the selector with additional repository information also improves recovery. Conversely, when the available selection signal is weak, redundant, or misaligned, amplification can diminish or fail. These results identify selection quality as the key factor governing how much capability exposed by repeated sampling can actually be recovered.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 45 of its 57 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

45 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  2. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
  4. 2023Reasoning with Language Model is Planning with World Model24 May
  5. 2022Competition-Level Code Generation with AlphaCode8 Feb

Other references · 40

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  8. 2023Let's Verify Step by Stepcited by 3,598
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  10. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  12. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
28 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  4. 2024A Survey on LLM-as-a-Judgecited by 1,384
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  9. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  10. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  11. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 480
  12. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
  13. 2018AI safety via debatecited by 384
  14. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
  15. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
  16. 2023Universal Self-Consistency for Large Language Model Generationcited by 198
  17. 2024More Agents Is All You Needcited by 174
  18. 2018Supervising strong learners by amplifying weak expertscited by 139
  19. 2024On scalable oversight with weak LLMs judging strong LLMscited by 94
  20. 2025Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignmentcited by 91
  21. 2024Prover-Verifier Games improve legibility of LLM outputscited by 79
  22. 2024Archon: An Architecture Search Framework for Inference-Time Techniquescited by 59
  23. 2025Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifierscited by 58
  24. 2023Scalable AI Safety via Doubly-Efficient Debatecited by 54
  25. 2021Learning to Give Checkable Answers with Prover-Verifier Gamescited by 29
  26. 2023Language models are weak learnerscited by 21
  27. 2025LLMBoost: Make Large Language Models Stronger with Boostingcited by 8
  28. 2026FUSE: Ensembling Verifiers with Zero Labeled Datacited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Before Reasoning Can Fail: Pre-Evidence Procedural Failures in Agentic RAG
  2. 2026Woodpecker Distillation: Weak Models Diagnose Reasoning Bugs in Strong Models
  3. 2025Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
  4. 2026Inducing Reasoning Primitives from Agent Traces
  5. 2026Viva La Vida: Verification and Accumulation Failures in Multi-Agent Proof Search
  6. 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
  7. 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning
  8. 2026Can Small Agents Collaborate to Beat a Single Large Language Model?