Traverse: Learning When to Remember, Reset, and Redirect for Long-Horizon Web Search
Not on the map. Why?
Abstract (arXiv)
Long-horizon information-seeking agents often accumulate noisy or misleading context, causing early mistakes to persist and making recovery increasingly difficult. We introduce an autonomous search harness in which the agent manages its own search process through three states: Rubric, Answer, and Verify. The agent first defines criteria for a valid answer, searches under these criteria, and then independently verifies the result before deciding whether to terminate or continue searching. It is further equipped with a Seal Memory tool that enables active context management. Training this behavior with reinforcement learning, however, can induce Seal Collapse, resulting in unstable training and preventing the agent from reliably learning when and how to use its memory tools. We solve this with a simple strategy that trains only the final segment after context management. Our 35B model achieves 72.83 on BrowseComp, outperforming comparable open-source systems, and consistently improves over the base model across BrowseComp-ZH, xbench, DeepSearchQA, WideSearch, financial investigation, and product search. Ablations show that autonomous compression outperforms automatic compaction and validate our RL design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
28 of 37 references.
References · 28
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2025Group Sequence Policy Optimizationcited by 788
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
16 more
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 236
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 152
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
- 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 118
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 72
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 62
- 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agentscited by 44
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verificationcited by 19
- 2025ShoppingComp: Are LLMs Really Ready for Your Shopping Cart?cited by 8
- 2026DREAM: Deep Research Evaluation with Agentic Metricscited by 7
- 2026DR-Arena: an Automated Evaluation Framework for Deep Research Agentscited by 6
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 4
Built on by
Not cited yet.