Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces
Not on the map. Why?
Abstract (arXiv)
Deepresearch (DR) agents interact with real-world web environments through multi-turn search and visit, causing their contexts to grow rapidly over time. We observe that, even after DR Agentic Reinforcement Learning (DR-RL), 61.6% of the model's remaining prediction errors can still be attributed to insufficient long-context understanding, including longcontext hallucination and failures in cross-document evidence integration. It motivates us to further break the bottleneck of DR-RL by strengthening the model's long-context ability. However, effective LongContext training requires more than simply increasing context length. To bridge the data gap, we propose `DR Rollouts to LongContext-QA (DR-to-Long)'. The method repurposes DR-RL trajectories, which naturally contain search histories, visited webpages, evidence snippets, and final-answer supervision. It then replaces the compact snippets and webpage summaries in each trajectory with the full contents of their corresponding URLs, producing substantially longer multi-document contexts while preserving the original evidence relationships. Building on DR-to-Long, we introduce DLD (DR -> LongQA -> DR)-RL. DLD-RL first performs a short DR-RL stage to collect rollout trajectories, which are then converted into LongQA instances at zero annotation cost. The model is subsequently optimized with LongQA-RL to strengthen LongContext ability, followed by full DR-RL to continue improving its DR capability. Experiments show that DLD-RL outperforms standard DR-RL by 7.3% on three Deepresearch benchmarks and improves performance by 13.5% on three long-context benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
37 of 45 references.
References · 37
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
25 more
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
- 2024Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAcited by 122
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 92
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 55
- 2025LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansioncited by 50
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2026CL-bench: A Benchmark for Context Learningcited by 47
- 2026OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Datacited by 39
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 32
- 2026SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?cited by 23
- 2024ReAttention: Training-Free Infinite Context with Finite Attention Scopecited by 13
- 2026OffSeeker: Online Reinforcement Learning Is Not All You Need for Deep Research Agentscited by 12
- 2026AgentCPM-Explore: Realizing Long-Horizon Deep Exploration for Edge-Scale Agentscited by 12
- 2026LongSeeker: Elastic Context Orchestration for Long-Horizon Search Agentscited by 10
- 2026CL-bench Life: Can Language Models Learn from Real-Life Context?cited by 9
- 2026DR-Venus: Towards Frontier Edge-Scale Deep Research Agents with Only 10K Open Datacited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agents
- 2025Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search
- 2025Fathom-DeepResearch: Unlocking Long Horizon Information Retrieval and Synthesis for SLMs
- 2026LexiHorizon: Stabilizing Reinforcement Learning for Long-Horizon Deep Search
- 2026Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents
- 2026Traverse: Learning When to Remember, Reset, and Redirect for Long-Horizon Web Search