AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
As large language models (LLMs) evolve into autonomous agents for long-horizon information-seeking, managing finite context capacity has become a critical bottleneck. Existing context management methods typically commit to a single fixed strategy throughout the entire trajectory. Such static designs may work well in some states, but they cannot adapt as the usefulness and reliability of the accumulated context evolve during long-horizon search. To formalize this challenge, we introduce a probabilistic framework that characterizes long-horizon success through two complementary dimensions: search efficiency and terminal precision. Building on this perspective, we propose AgentSwing, a state-aware adaptive parallel context management routing framework. At each trigger point, AgentSwing expands multiple context-managed branches in parallel and uses lookahead routing to select the most promising continuation. Experiments across diverse benchmarks and agent backbones show that AgentSwing consistently outperforms strong static context management methods, often matching or exceeding their performance with up to 3× fewer interaction turns while also improving the ultimate performance ceiling of long-horizon web agents. Beyond the empirical gains, the proposed probabilistic framework provides a principled lens for analyzing and designing future context management strategies for long-horizon agents.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 24 of its 36 references that are in the map. First posted on arXiv 29 Mar 2026.
Builds on
24 of 36 references.
Closest ancestors · 1
Same direction, newest first
- 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rollouts28 Jan
Other references · 23
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 144
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
- 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 120
11 more
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 86
- 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 66
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learningcited by 59
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
- 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 45
- 2025Scaling Agents via Continual Pre-trainingcited by 39
- 2025SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agentscited by 29
- 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19
- 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seekingcited by 14
- 2025Environment Scaling for Interactive Agentic Experience Collection: A Surveycited by 13
- 2025Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verificationcited by 12
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026SWE-MeM: Learning Adaptive Memory Management for Long-Horizon Coding Agentscited by 12
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agentcited by 10
- 2026Decentralized Multi-Agent Systems with Shared Contextcited by 7
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanismcited by 4
- 2026CoACT: Action-Preserving Observation Compression for Coding Agentscited by 4
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoningcited by 3
- 2026TokenPilot: Cache-Efficient Context Management for LLM Agentscited by 3
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioceptioncited by 3
- 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memorycited by 0
- 2026PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory4 Aug 2026
- 2026CoACT: Action-Preserving Observation Compression for Coding Agents3 Jul 2026
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception29 Jun 2026
- 2026SWE-MeM: Learning Adaptive Memory Management for Long-Horizon Coding Agents26 Jun 2026
- 2026TokenPilot: Cache-Efficient Context Management for LLM Agents15 Jun 2026
- 2026Decentralized Multi-Agent Systems with Shared Context9 Jun 2026
- 2026Masking Stale Observations Helps Search Agents -- Until It Doesn't: A Regime Map and Its Mechanism29 May 2026
- 2026AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning23 May 2026
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent23 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026InfoSeeker: A Scalable Hierarchical Parallel Agent Framework for Web Information Seeking
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents
- 2025Evaluating Long-Context Reasoning in LLM-Based WebAgents
- 2026ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL
- 2026GenericAgent: A Token-Efficient Self-Evolving LLM Agent via Contextual Information Density Maximization (V1.0)
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Management
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Search
- 2026ACM: Agentic Context Management for Long Horizon Tasks