mlsanityData to 14 Oct 2026

Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search

arXiv 2510.18939 ↗First posted 21 Oct 2025cs.CLcited by 12

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, enabling powerful applications like deep research systems. In this work, we show that popular agentic search frameworks struggle to scale to long trajectories primarily due to context limitations--they accumulate long, noisy content, hit context window and tool budgets, or stop early. We therefore introduce SLIM (Simple Lightweight Information Management), a simple framework that separates retrieval into distinct search and browse tools, and periodically summarizes the trajectory, keeping context concise while enabling longer, more focused searches. Across a wide range of long-horizon tasks, SLIM achieves comparable performance at substantially lower cost and far fewer tool calls than strong open-source frameworks with both proprietary and open-weight models, including RL-trained models for deep research. Specifically, with o3 as the base model, SLIM achieves 56% on BrowseComp and 33% on HLE, outperforming all open-source frameworks by 8 and 6 absolute points, respectively, while incurring 4-6x fewer tool calls. With GLM-4.7 Flash, SLIM achieves 10 points improvement over the next best open-source framework, Search-o1, on BrowseComp using a third of the cost. To systematically understand failure modes in long-horizon agentic search, we develop an automated fine-grained trajectory analysis pipeline and error taxonomy, and find that SLIM exhibits significantly fewer hallucinations than prior systems. We hope our analysis framework and simple tool design inform future long-horizon agents.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 45 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

30 of 45 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents8 Sep
  2. 2025Universal Deep Research: Bring Your Own Model and Strategy29 Aug
  3. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
  4. 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agents21 May
  5. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan
  6. 2024Infogent: An Agent-Based Framework for Web Information Aggregation24 Oct

Other references · 24

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  5. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  6. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  7. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  8. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  9. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  10. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
  11. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  12. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
12 more
  1. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  2. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  3. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  4. 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 161
  5. 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
  6. 2024HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughlycited by 125
  7. 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
  8. 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 112
  9. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
  10. 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
  11. 2025SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agentscited by 31
  12. 2025Beyond Turn Limits: Training Deep Search Agents with Dynamic Context Windowcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 10.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
  2. 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agents
  3. 2026Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests
  4. 2025Fathom-DeepResearch: Unlocking Long Horizon Information Retrieval and Synthesis for SLMs
  5. 2026Search More, Think Less: Rethinking Long-Horizon Agentic Search for Efficiency and Generalization
  6. 2025DeepWideSearch: Benchmarking Depth and Width in Agentic Information Seeking
  7. 2026Beyond Semantic Similarity: Performance and Costs of Agentic Retrieval for Complex Tasks
  8. 2026ACM: Agentic Context Management for Long Horizon Tasks