mlsanityData to 7 Oct 2026

Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science

arXiv 2603.28361 ↗First posted 30 Mar 2026cs.AI cs.MAcited by 1

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

With the advancement of large language models (LLMs) in their knowledge base and reasoning capabilities, their interactive modalities have evolved from pure text to multimodality and further to agentic tool use. Consequently, their applications have broadened from question answering to AI assistants and now to general-purpose agents. Deep research (DR) represents a prototypical vertical application for general-purpose agents, which represents an ideal approach for intelligent information processing and assisting humans in discovering and solving problems, with the goal of reaching or even surpassing the level of top human scientists. This paper provides a deep research of deep research. We articulate a clear and precise definition of deep research and unify perspectives from industry's deep research and academia's AI for Science (AI4S) within a developmental framework. We position LLMs and Stable Diffusion as the twin pillars of generative AI, and lay out a roadmap evolving from the Transformer to agents. We examine the progress of AI4S across various disciplines. We identify the predominant paradigms of human-AI interaction and prevailing system architectures, and discuss the major challenges and fundamental research issues that remain. AI supports scientific innovation, and science also can contribute to AI growth (Science for AI, S4AI). We hope this paper can help bridge the gap between the AI and AI4S communities.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 350 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

35 of 350 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026FS-Researcher: Test-Time Scaling for Long-Horizon Research Tasks with File-System-Based Agents2 Feb
  2. 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models16 Oct
  3. 2025A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications14 Jun

Other references · 32

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  3. 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
  4. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  5. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  6. 2026Learning to Discover at Test Timecited by 94
  7. 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 77
  8. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  9. 2025A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challengescited by 58
  10. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 57
  11. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 49
  12. 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discoverycited by 41
20 more
  1. 2025Evaluating Large Language Models in Scientific Discoverycited by 38
  2. 2025Early science acceleration experiments with GPT-5cited by 35
  3. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
  4. 2026Beyond Language Modeling: An Exploration of Multimodal Pretrainingcited by 32
  5. 2026Towards Autonomous Mathematics Researchcited by 31
  6. 2025SIMA 2: A Generalist Embodied Agent for Virtual Worldscited by 26
  7. 2025A Definition of AGIcited by 25
  8. 2025Training AI Co-Scientists Using Rubric Rewardscited by 23
  9. 2025A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applicationscited by 21
  10. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
  11. 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agentscited by 16
  12. 2024Multi-modal Generative AI: Multi-modal LLMs, Diffusions, and the Unificationcited by 8
  13. 2025Reinforced Generation of Combinatorial Structures: Hardness of Approximationcited by 8
  14. 2026AI Can Learn Scientific Tastecited by 8
  15. 2026Why AI systems don't learn and what to do about it: Lessons on autonomous learning from cognitive sciencecited by 8
  16. 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verificationcited by 7
  17. 2026How to Train Your Deep Research Agent? Prompt, Reward, and Policy Optimization in Search-R1cited by 6
  18. 2026Aletheia tackles FirstProof autonomouslycited by 6
  19. 2025ArXivBench: When You Should Avoid Using ChatGPT for Academic Writingcited by 3
  20. 2026Vibe Researching as Wolf Coming: Can AI Agents with Skills Replace or Augment Social Scientists?cited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Deep Research: A Survey of Autonomous Research Agents
  2. 2025Deep Research Agents: A Systematic Examination And Roadmap
  3. 2025Deep Research: A Systematic Survey
  4. 2025Interaction as Intelligence: Deep Research With Human-AI Partnership
  5. 2025AI4Research: A Survey of Artificial Intelligence for Scientific Research
  6. 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents
  7. 2025Agent4S: The Transformation of Research Paradigms from the Perspective of Large Language Models
  8. 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents