mlsanityData to 14 Oct 2026

Open Data Synthesis For Deep Research

arXiv 2509.00375 ↗First posted 30 Aug 2025cs.CL cs.AIcited by 16

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

Large language models (LLMs) are increasingly expected to go beyond simple factual queries toward Deep Research-tasks that require decomposing questions into sub-problems, coordinating multi-step reasoning, and synthesizing evidence from diverse sources. We formalize Deep Research tasks with verifiable answers as Hierarchical Constraint Satisfaction Problems (HCSPs), which are fundamentally different from single-constraint, multi-hop, or flat CSP formulations. However, existing benchmarks (e.g., Natural Questions, HotpotQA) fail to capture this complexity, while recent synthetic datasets often introduce shortcut reasoning, knowledge leakage, or lack sufficient structural depth. To address this gap, we introduce InfoSeek, a scalable framework for synthesizing complex Deep Research tasks. InfoSeek uses a dual-agent system to recursively build a Research Tree from large-scale webpages, blurring intermediate nodes into valid sub-problems, and converting these trees into natural language questions that require traversing the full hierarchy. It also enables rapid scaling, yielding over 50K training examples, a curated test set, and reasoning trajectories generated via reject sampling. Experiments show that models trained on InfoSeek consistently outperform strong baselines. On a challenging benchmark BrowseComp-Plus, 3B LLMs optimized with InfoSeek surpass much larger 32B models and lightweight commercial APIs (e.g., Gemini2.5-Flash), while achieving performance comparable to stronger APIs (e.g., Gemini2.5-Pro). By preserving meta-information such as intermediate steps and retrieval labels, InfoSeek further supports advanced optimization strategies, including compound reward design and trajectory-level exploration. We provide our codes and datasets in hrefhttps://github.com/VectorSpaceLab/InfoSeekthis repository.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 37 of its 53 references that are in the map. First posted on arXiv 30 Aug 2025.

Builds on

37 of 53 references.

References · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  10. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  11. 2024Qwen2 Technical Reportcited by 2,120
  12. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
25 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  2. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  3. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  4. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  5. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  6. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
  7. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  8. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
  9. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  10. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
  11. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  12. 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 208
  13. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
  14. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  15. 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 147
  16. 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
  17. 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
  18. 2025SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesiscited by 55
  19. 2025Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Trainingcited by 42
  20. 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 25
  21. 2025DeepDiver: Adaptive Search Intensity Scaling via Open-Web Reinforcement Learningcited by 23
  22. 2024Agentic Information Retrievalcited by 21
  23. 2025Scent of Knowledge: Optimizing Search-Enhanced Reasoning with Information Foragingcited by 20
  24. 2025Towards AI Search Paradigmcited by 19
  25. 2025HawkBench: Investigating Resilience of RAG Methods on Stratified Information-Seeking Taskscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 12.

16 papers.

Sort:

By area:

  1. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 22
  2. 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoningcited by 13
  3. 2025InfoFlow: Reinforcing Search Agent Via Reward Density Optimizationcited by 11
  4. 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 10
  5. 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 10
  6. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  7. 2025InfoAgent: Advancing Autonomous Information-Seeking Agentscited by 7
  8. 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 7
  9. 2026SRR-Judge: Step-Level Rating and Refinement for Enhancing Search-Integrated Reasoning in Search Agentscited by 5
  10. 2026Learning to Retrieve from Agent Trajectoriescited by 3
  11. 2026ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budgetcited by 2
  12. 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
4 more
  1. 2026POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Managementcited by 1
  2. 2026K-EXAONE 2.0 Technical Reportcited by 0
  3. 2026Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agentscited by 0
  4. 2026Avoiding What Your Teacher Already Knows: Entity Familiarity for Deep-Search Distillationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026A Benchmark for Deep Information Synthesis
  2. 2026DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agent
  3. 2025Deep Research: A Systematic Survey
  4. 2025Deep Research: A Survey of Autonomous Research Agents
  5. 2025DeepResearchEco: A Recursive Agentic Workflow for Complex Scientific Question Answering in Ecology
  6. 2026From Intent to Evidence: A Categorical Approach for Structural Evaluation of Deep Research Agents
  7. 2025Synthesizing Agentic Data for Web Agents with Progressive Difficulty Enhancement Mechanisms
  8. 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks