Deep Research Pretraining via Predictive Navigation
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Deep research agents are often trained on expensive, environment-grounded tool-use trajectories that require repeated retrieval, document inspection, and report evaluation. We introduce Deep Research Pretraining (DRP), an offline framework that derives predictive navigation supervision from naturally occurring evidence structures. Given a citation-bearing or hyperlinked passage, DRP constructs a proxy research objective, recovers linked evidence and graph-related alternatives, and converts them into search-open-write trajectories. This teaches models what to search for, which documents to inspect, and how to synthesize evidence, without a live retrieval environment or executed policy rollout. We instantiate DRP on scholarly citation graphs (DRP-Paper) and Wikipedia hyperlinks (DRP-Web), continually pretrain separate Qwen3-14B-Base models on 1B tokens, and fine-tune them on controlled fractions of 13K agent trajectories. Across five independently sampled subsets at each low-data budget, both variants consistently outperform matched no-DRP models on DeepResearch Bench. With one quarter of the SFT data, DRP-Web even surpasses a fixed no-DRP full-data checkpoint, with gains transferring to ResearchQA, WebWalkerQA, and SimpleQA. Starting from matched low-data SFT checkpoints, the DRP-Web advantage also persists through subsequent agentic RL. Source-matched and evidence-mismatch controls indicate that these improvements arise from evidence-conditioned navigation rather than domain exposure or agent-format imitation. DRP thus provides a promising complementary approach to trajectory-based agent training.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 33 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
24 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks22 May
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun
Other references · 22
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
10 more
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
- 2024Measuring short-form factuality in large language modelscited by 373
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
- 2024Are We Done with MMLU?cited by 194
- 2025Agentic Reinforced Policy Optimizationcited by 172
- 2025ResearchQA: Evaluating Scholarly Question Answering at Scale Across 75 Fields with Survey-Mined Questions and Rubricscited by 49
- 2026How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Datacited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis
- 2026Baikal: Structured Search for Deep Research over Data Lakes
- 2026Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces
- 2026Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents
- 2026DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents
- 2026From Intent to Evidence: A Categorical Approach for Structural Evaluation of Deep Research Agents
- 2026S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents