Open Data Synthesis For Deep Research
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
Large language models (LLMs) are increasingly expected to go beyond simple factual queries toward Deep Research-tasks that require decomposing questions into sub-problems, coordinating multi-step reasoning, and synthesizing evidence from diverse sources. We formalize Deep Research tasks with verifiable answers as Hierarchical Constraint Satisfaction Problems (HCSPs), which are fundamentally different from single-constraint, multi-hop, or flat CSP formulations. However, existing benchmarks (e.g., Natural Questions, HotpotQA) fail to capture this complexity, while recent synthetic datasets often introduce shortcut reasoning, knowledge leakage, or lack sufficient structural depth. To address this gap, we introduce InfoSeek, a scalable framework for synthesizing complex Deep Research tasks. InfoSeek uses a dual-agent system to recursively build a Research Tree from large-scale webpages, blurring intermediate nodes into valid sub-problems, and converting these trees into natural language questions that require traversing the full hierarchy. It also enables rapid scaling, yielding over 50K training examples, a curated test set, and reasoning trajectories generated via reject sampling. Experiments show that models trained on InfoSeek consistently outperform strong baselines. On a challenging benchmark BrowseComp-Plus, 3B LLMs optimized with InfoSeek surpass much larger 32B models and lightweight commercial APIs (e.g., Gemini2.5-Flash), while achieving performance comparable to stronger APIs (e.g., Gemini2.5-Pro). By preserving meta-information such as intermediate steps and retrieval labels, InfoSeek further supports advanced optimization strategies, including compound reward design and trajectory-level exploration. We provide our codes and datasets in hrefhttps://github.com/VectorSpaceLab/InfoSeekthis repository.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 37 of its 53 references that are in the map. First posted on arXiv 30 Aug 2025.
Builds on
37 of 53 references.
References · 37
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2024Qwen2 Technical Reportcited by 2,120
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
25 more
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 147
- 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
- 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
- 2025Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Trainingcited by 42
- 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 25
- 2025DeepDiver: Adaptive Search Intensity Scaling via Open-Web Reinforcement Learningcited by 23
- 2024Agentic Information Retrievalcited by 21
- 2025Scent of Knowledge: Optimizing Search-Enhanced Reasoning with Information Foragingcited by 20
- 2025Towards AI Search Paradigmcited by 19
- 2025HawkBench: Investigating Resilience of RAG Methods on Stratified Information-Seeking Taskscited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 12.
16 papers.
Sort:
By area:
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 22
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoningcited by 13
- 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimizationcited by 11
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 10
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 10
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agentscited by 7
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 7
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agentscited by 5
- 2026Learning to Retrieve from Agent Trajectoriescited by 3
- 2026ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budgetcited by 2
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
4 more
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Managementcited by 1
- 2026K-EXAONE 2.0 Technical Reportcited by 0
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agentscited by 0
- 2026Avoiding What Your Teacher Already Knows: Entity Familiarity for Deep-Search Distillationcited by 0
- 2026Avoiding What Your Teacher Already Knows: Entity Familiarity for Deep-Search Distillation12 Oct 2026
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agents5 Oct 2026
- 2026K-EXAONE 2.0 Technical Report5 Aug 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents10 Jun 2026
- 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents8 May 2026
- 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management15 Apr 2026
- 2026ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budget1 Apr 2026
- 2026Learning to Retrieve from Agent Trajectories30 Mar 2026
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agents8 Feb 2026
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning23 Jan 2026
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoning12 Jan 2026
4 more
- 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimization30 Oct 2025
- 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications19 Oct 2025
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models16 Oct 2025
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agents29 Sep 2025
- 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimizationcited by 11
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agentscited by 7
- 2026Learning to Retrieve from Agent Trajectoriescited by 3
- 2026ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budgetcited by 2
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agentscited by 0
- 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agents5 Oct 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budget1 Apr 2026
- 2026Learning to Retrieve from Agent Trajectories30 Mar 2026
- 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimization30 Oct 2025
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agents29 Sep 2025
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoningcited by 13
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 10
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agentscited by 5
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
- 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agents8 Feb 2026
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning23 Jan 2026
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoning12 Jan 2026
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models16 Oct 2025
- 2026K-EXAONE 2.0 Technical Reportcited by 0
- 2026K-EXAONE 2.0 Technical Report5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Benchmark for Deep Information Synthesis
- 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agent
- 2025Deep Research: A Systematic Survey
- 2025Deep Research: A Survey of Autonomous Research Agents
- 2025DeepResearchEco: A Recursive Agentic Workflow for Complex Scientific Question Answering in Ecology
- 2026From Intent to Evidence: A Categorical Approach for Structural Evaluation of Deep Research Agents
- 2025Synthesizing Agentic Data for Web Agents with Progressive Difficulty Enhancement Mechanisms
- 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks