ParallelMuse: Agentic Parallel Thinking for Deep Information Seeking
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Parallel thinking expands exploration breadth, complementing the deep exploration of information-seeking (IS) agents to further enhance problem-solving capability. However, conventional parallel thinking faces two key challenges in this setting: inefficiency from repeatedly rolling out from scratch, and difficulty in integrating long-horizon reasoning trajectories during answer generation, as limited context capacity prevents full consideration of the reasoning process. To address these issues, we propose ParallelMuse, a two-stage paradigm designed for deep IS agents. The first stage, Functionality-Specified Partial Rollout, partitions generated sequences into functional regions and performs uncertainty-guided path reuse and branching to enhance exploration efficiency. The second stage, Compressed Reasoning Aggregation, exploits reasoning redundancy to losslessly compress information relevant to answer derivation and synthesize a coherent final answer. Experiments across multiple open-source agents and benchmarks demonstrate up to 62% performance improvement with a 10--30% reduction in exploratory token consumption.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 43 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
30 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning16 Sep
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL12 Sep
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents8 Sep
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RL11 Aug
- 2025EvolveSearch: An Iterative Self-Evolving Search Agent28 May
Other references · 25
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2025Humanity's Last Examcited by 467
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025Deep Think with Confidencecited by 199
- 2025Agentic Reinforced Policy Optimizationcited by 166
13 more
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
- 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
- 2024LLM Multi-Agent Systems: Challenges and Open Problemscited by 119
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
- 2025TreeRL: LLM Reinforcement Learning with On-Policy Tree Searchcited by 75
- 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 60
- 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
- 2025Mind the Confidence Gap: Overconfidence, Calibration, and Distractor Effects in Large Language Modelscited by 39
- 2025Scaling Agents via Continual Pre-trainingcited by 39
- 2024SCOPE: Optimizing Key-Value Cache Compression in Long-context Generationcited by 20
- 2025Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verificationcited by 12
- 2025A Survey on Parallel Reasoningcited by 11
Built on by
Citing papers per year: 2025: 1; 2026: 13.
14 papers.
Sort:
By area:
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Taskscited by 18
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agentscited by 9
- 2026GISA: A Benchmark for General Information-Seeking Assistantcited by 6
- 2025Nested Browser-Use Learning for Agentic Information Seekingcited by 5
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
- 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agentcited by 3
- 2026Reasoning over mathematical objects: on-policy reward modeling and test time aggregationcited by 3
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
- 2026Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agentscited by 2
- 2026On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiencycited by 1
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Searchcited by 1
- 2026Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seekingcited by 0
- 2026Last Step Matters: Early Uncertainty Cannot Predict Failure in Long-Horizon Agents30 Aug 2026
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding25 Aug 2026
- 2026Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows12 Jun 2026
- 2026Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking5 Jun 2026
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search30 May 2026
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning23 May 2026
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents15 May 2026
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr 2026
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agents29 Mar 2026
- 2026Reasoning over mathematical objects: on-policy reward modeling and test time aggregation19 Mar 2026
- 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agent12 Feb 2026
- 2026GISA: A Benchmark for General Information-Seeking Assistant9 Feb 2026
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agentscited by 9
- 2025Nested Browser-Use Learning for Agentic Information Seekingcited by 5
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 4
- 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agentcited by 3
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
- 2026Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflowscited by 0
- 2026Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows12 Jun 2026
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning23 May 2026
- 2026Argus: Evidence Assembly for Scalable Deep Research Agents15 May 2026
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agents29 Mar 2026
- 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agent12 Feb 2026
- 2025Nested Browser-Use Learning for Agentic Information Seeking29 Dec 2025
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Taskscited by 18
- 2026Reasoning over mathematical objects: on-policy reward modeling and test time aggregationcited by 3
- 2026On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiencycited by 1
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Searchcited by 1
- 2026Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seekingcited by 0
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Groundingcited by 0
- 2026Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding25 Aug 2026
- 2026Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking5 Jun 2026
- 2026FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search30 May 2026
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr 2026
- 2026Reasoning over mathematical objects: on-policy reward modeling and test time aggregation19 Mar 2026
- 2026On the Overscaling Curse of Parallel Thinking: System Efficacy Contradicts Sample Efficiency29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
- 2025DeepWideSearch: Benchmarking Depth and Width in Agentic Information Seeking
- 2026W&D:Scaling Parallel Tool Calling for Efficient Deep Research Agents
- 2026InfoSeeker: A Scalable Hierarchical Parallel Agent Framework for Web Information Seeking
- 2025Atom-Searcher: Enhancing Agentic Deep Research via Fine-Grained Atomic Thought Reward
- 2026Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Execution