mlsanityData to 7 Oct 2026

Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks

arXiv 2604.11753 ↗First posted 13 Apr 2026cs.CLcited by 18

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

We study parallel test-time scaling for long-horizon agentic tasks such as agentic search and deep research, where multiple rollouts are generated in parallel and aggregated into a final response. While such scaling has proven effective for chain-of-thought reasoning, agentic tasks pose unique challenges: trajectories are long, multi-turn, and tool-augmented, and outputs are often open-ended. Aggregating only final answers discards rich information from trajectories, while concatenating all trajectories exceeds the model's context window. To address this, we propose AggAgent, an aggregation agent that treats parallel trajectories as an environment. We equip it with lightweight tools to inspect candidate solutions and search across trajectories, enabling it to navigate and synthesize information on demand. Across six benchmarks and three model families (GLM-4.7, Qwen3.5, MiniMax-M2.5), AggAgent outperforms all existing aggregation methods-by up to 5.3% absolute on average and 10.3% on two deep research tasks-while adding minimal overhead, as the aggregation cost remains bounded by a single agentic rollout. Our findings establish agentic aggregation as an effective and cost-efficient approach to parallel test-time scaling.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 56 of its 71 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

56 of 71 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul

Other references · 55

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  10. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  12. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
38 more
  1. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  2. 2025s1: Simple test-time scalingcited by 1,311
  3. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  5. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  6. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  7. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  9. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  10. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  11. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  12. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  13. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
  14. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
  15. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
  16. 2025Deep Think with Confidencecited by 199
  17. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
  18. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
  19. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  20. 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
  21. 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 98
  22. 2025Recursive Language Modelscited by 94
  23. 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 80
  24. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
  25. 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 53
  26. 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
  27. 2025The Majority is not always right: RL training for solution aggregationcited by 46
  28. 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agentscited by 44
  29. 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agentscited by 43
  30. 2025Web-Shepherd: Advancing PRMs for Reinforcing Web Agentscited by 41
  31. 2025Scaling Agents via Continual Pre-trainingcited by 39
  32. 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
  33. 2025Learning to Reason Across Parallel Samples for LLM Reasoningcited by 32
  34. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 32
  35. 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19
  36. 2026PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoningcited by 17
  37. 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seekingcited by 14
  38. 2025Step-DeepResearch Technical Reportcited by 12

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 18.

18 papers.

Sort:

By area:

  1. 2026Self-Compacting Language Model Agentscited by 11
  2. 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
  3. 2026Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Tracescited by 8
  4. 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Searchcited by 4
  5. 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
  6. 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanismcited by 4
  7. 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
  8. 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systemscited by 2
  9. 2026Beyond Parallel Sampling: Diverse Query Initialization for Agentic Searchcited by 2
  10. 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Searchcited by 1
  11. 2026WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Searchcited by 1
  12. 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
6 more
  1. 2026Process-Reward Tactic Evolution for Long-Horizon Bioinformatics Workflowscited by 0
  2. 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Groundingcited by 0
  3. 2026Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learningcited by 0
  4. 2026TRACE: Trajectory Selection for Parallel Scaling of Search Agentscited by 0
  5. 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Taskscited by 0
  6. 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Hive: A Multi-Agent Infrastructure for Algorithm- and Task-Level Scaling
  2. 2026ATLAS: Agentic Test-time Learning-to-Allocate Scaling
  3. 2026Scaling Test-Time Compute for Agentic Coding
  4. 2026AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG
  5. 2026Multi-Agent Reasoning Improves Compute Efficiency: Pareto-Optimal Test-Time Scaling
  6. 2026ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling
  7. 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scaling
  8. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness