Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, enabling powerful applications like deep research systems. In this work, we show that popular agentic search frameworks struggle to scale to long trajectories primarily due to context limitations--they accumulate long, noisy content, hit context window and tool budgets, or stop early. We therefore introduce SLIM (Simple Lightweight Information Management), a simple framework that separates retrieval into distinct search and browse tools, and periodically summarizes the trajectory, keeping context concise while enabling longer, more focused searches. Across a wide range of long-horizon tasks, SLIM achieves comparable performance at substantially lower cost and far fewer tool calls than strong open-source frameworks with both proprietary and open-weight models, including RL-trained models for deep research. Specifically, with o3 as the base model, SLIM achieves 56% on BrowseComp and 33% on HLE, outperforming all open-source frameworks by 8 and 6 absolute points, respectively, while incurring 4-6x fewer tool calls. With GLM-4.7 Flash, SLIM achieves 10 points improvement over the next best open-source framework, Search-o1, on BrowseComp using a third of the cost. To systematically understand failure modes in long-horizon agentic search, we develop an automated fine-grained trajectory analysis pipeline and error taxonomy, and find that SLIM exhibits significantly fewer hallucinations than prior systems. We hope our analysis framework and simple tool design inform future long-horizon agents.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 45 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
30 of 45 references.
Closest ancestors · 6
Same direction, newest first
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents8 Sep
- 2025Universal Deep Research: Bring Your Own Model and Strategy29 Aug
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
- 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agents21 May
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan
- 2024Infogent: An Agent-Based Framework for Web Information Aggregation24 Oct
Other references · 24
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
12 more
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 161
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
- 2024HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughlycited by 125
- 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
- 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 112
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
- 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
- 2025SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agentscited by 31
- 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025Budget-Aware Tool Use Enables Effective Agent Scalingcited by 44
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Taskscited by 18
- 2026On Training Large Language Models for Long-Horizon Tasks: An Empirical Study of Horizon Lengthcited by 6
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Searchcited by 6
- 2025PRInTS: Reward Modeling for Long-Horizon Information Seekingcited by 5
- 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generationcited by 3
- 2026Diagnosing and Mitigating Context Rot in Long-horizon Searchcited by 3
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioceptioncited by 3
- 2026RecaLLM: Addressing the Lost-in-Thought Phenomenon with Explicit In-Context Retrievalcited by 1
- 2026WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruningcited by 0
- 2026Signal-Driven Observation for Long-Horizon Web Agentscited by 0
- 2026Programmatic Search Agents: Extending Agentic Search Beyond Query Reformulationcited by 0
- 2026Programmatic Search Agents: Extending Agentic Search Beyond Query Reformulation5 Oct 2026
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception29 Jun 2026
- 2026Diagnosing and Mitigating Context Rot in Long-horizon Search29 Jun 2026
- 2026Signal-Driven Observation for Long-Horizon Web Agents4 Jun 2026
- 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation28 May 2026
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Search7 May 2026
- 2026On Training Large Language Models for Long-Horizon Tasks: An Empirical Study of Horizon Length4 May 2026
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr 2026
- 2026RecaLLM: Addressing the Lost-in-Thought Phenomenon with Explicit In-Context Retrieval10 Apr 2026
- 2026WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning13 Feb 2026
- 2025PRInTS: Reward Modeling for Long-Horizon Information Seeking24 Nov 2025
- 2025Budget-Aware Tool Use Enables Effective Agent Scaling21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents
- 2026Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests
- 2025Fathom-DeepResearch: Unlocking Long Horizon Information Retrieval and Synthesis for SLMs
- 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
- 2025DeepWideSearch: Benchmarking Depth and Width in Agentic Information Seeking
- 2026Beyond Semantic Similarity: Performance and Costs of Agentic Retrieval for Complex Tasks
- 2026ACM: Agentic Context Management for Long Horizon Tasks