Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
We study parallel test-time scaling for long-horizon agentic tasks such as agentic search and deep research, where multiple rollouts are generated in parallel and aggregated into a final response. While such scaling has proven effective for chain-of-thought reasoning, agentic tasks pose unique challenges: trajectories are long, multi-turn, and tool-augmented, and outputs are often open-ended. Aggregating only final answers discards rich information from trajectories, while concatenating all trajectories exceeds the model's context window. To address this, we propose AggAgent, an aggregation agent that treats parallel trajectories as an environment. We equip it with lightweight tools to inspect candidate solutions and search across trajectories, enabling it to navigate and synthesize information on demand. Across six benchmarks and three model families (GLM-4.7, Qwen3.5, MiniMax-M2.5), AggAgent outperforms all existing aggregation methods-by up to 5.3% absolute on average and 10.3% on two deep research tasks-while adding minimal overhead, as the aggregation cost remains bounded by a single agentic rollout. Our findings establish agentic aggregation as an effective and cost-efficient approach to parallel test-time scaling.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 56 of its 71 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
56 of 71 references.
Closest ancestors · 1
Same direction, newest first
Other references · 55
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
38 more
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025s1: Simple test-time scalingcited by 1,311
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2025Deep Think with Confidencecited by 199
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 98
- 2025Recursive Language Modelscited by 94
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 80
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 53
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
- 2025The Majority is not always right: RL training for solution aggregationcited by 46
- 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agentscited by 44
- 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agentscited by 43
- 2025Web-Shepherd: Advancing PRMs for Reinforcing Web Agentscited by 41
- 2025Scaling Agents via Continual Pre-trainingcited by 39
- 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
- 2025Learning to Reason Across Parallel Samples for LLM Reasoningcited by 32
- 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 32
- 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19
- 2026PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoningcited by 17
- 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seekingcited by 14
- 2025Step-DeepResearch Technical Reportcited by 12
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026Self-Compacting Language Model Agentscited by 11
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Tracescited by 8
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Searchcited by 4
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanismcited by 4
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systemscited by 2
- 2026Beyond Parallel Sampling: Diverse Query Initialization for Agentic Searchcited by 2
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Searchcited by 1
- 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Searchcited by 1
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
6 more
- 2026Process-Reward Tactic Evolution for Long-Horizon Bioinformatics Workflowscited by 0
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Groundingcited by 0
- 2026Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learningcited by 0
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agentscited by 0
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Taskscited by 0
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimizationcited by 0
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization1 Oct 2026
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks1 Oct 2026
- 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agents30 Sep 2026
- 2026Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learning28 Sep 2026
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution26 Aug 2026
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding25 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search9 Jul 2026
- 2026Self-Compacting Language Model Agents22 Jun 2026
- 2026Process-Reward Tactic Evolution for Long-Horizon Bioinformatics Workflows18 Jun 2026
- 2026Beyond Parallel Sampling: Diverse Query Initialization for Agentic Search15 Jun 2026
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search30 May 2026
6 more
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanism29 May 2026
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems28 May 2026
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning23 May 2026
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents15 May 2026
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces11 May 2026
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Search7 May 2026
- 2026Self-Compacting Language Model Agentscited by 11
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Tracescited by 8
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Searchcited by 4
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systemscited by 2
- 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Searchcited by 1
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
- 2026Process-Reward Tactic Evolution for Long-Horizon Bioinformatics Workflowscited by 0
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Taskscited by 0
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimizationcited by 0
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization1 Oct 2026
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks1 Oct 2026
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution26 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search9 Jul 2026
- 2026Self-Compacting Language Model Agents22 Jun 2026
- 2026Process-Reward Tactic Evolution for Long-Horizon Bioinformatics Workflows18 Jun 2026
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems28 May 2026
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning23 May 2026
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents15 May 2026
- 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces11 May 2026
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Search7 May 2026
- 2026Beyond Parallel Sampling: Diverse Query Initialization for Agentic Searchcited by 2
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Searchcited by 1
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Groundingcited by 0
- 2026Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learningcited by 0
- 2026Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learning28 Sep 2026
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding25 Aug 2026
- 2026Beyond Parallel Sampling: Diverse Query Initialization for Agentic Search15 Jun 2026
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search30 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Hive: A Multi-Agent Infrastructure for Algorithm- and Task-Level Scaling
- 2026ATLAS: Agentic Test-time Learning-to-Allocate Scaling
- 2026Scaling Test-Time Compute for Agentic Coding
- 2026AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG
- 2026Multi-Agent Reasoning Improves Compute Efficiency: Pareto-Optimal Test-Time Scaling
- 2026ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scaling
- 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness