Learning Scientific Exploration from Human Research Decision Trajectories
Not on the map. Why?
Abstract (arXiv)
A key challenge in building AI systems for scientific research is enabling textitscientific exploration: the systematic process of investigating unknown phenomena or ideas to gain new knowledge through sequences of research decisions and actions. Yet this process is largely missing from existing scientific corpora; for example, research papers primarily record final outcomes rather than the trajectories that produced them. In this work, we introduce ResearchTrails, a dataset of human research trajectories constructed from Git repositories, where commit histories serve as proxies for research exploration. We develop an automated and scalable pipeline that extracts structured research trajectories from repository commits, capturing successive changes to methods, experiments, and ablations. We characterize the resulting dataset and show that these trajectories contain meaningful signals about intermediate research decisions beyond what final papers reveal. We further demonstrate utilities of ResearchTrails in multiple use cases, including retrieving human research experience as external skills at test time and training models on research trajectories to improve generalization to new research decisions. Our results suggest a path toward AI systems that learn not only from the products of science, but from the evolving process of discovery itself.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 5 Oct 2026.
Builds on
33 of 61 references.
References · 33
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 137
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 124
21 more
- 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 122
- 2023The Semantic Scholar Open Data Platformcited by 118
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
- 2025AI-Researcher: Autonomous Scientific Innovationcited by 100
- 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMscited by 72
- 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
- 2025AI Idea Bench 2025: AI Research Idea Generation Benchmarkcited by 40
- 2024ResearchTown: Simulator of Human Research Communitycited by 37
- 2025HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generationcited by 37
- 2025Training AI Co-Scientists Using Rubric Rewardscited by 29
- 2026Towards Execution-Grounded Automated AI Researchcited by 28
- 2025Sparks of Science: Hypothesis Generation Using Structured Paper Datacited by 25
- 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Researchcited by 22
- 2025ScholaWrite: A Dataset of End-to-End Scholarly Writing Processcited by 9
- 2026Learning to Predict Future-Aligned Research Proposals with Language Modelscited by 8
- 2026GIANTS: Generative Insight Anticipation from Scientific Literaturecited by 8
- 2026Sci-Reasoning: A Dataset Decoding AI Innovation Patternscited by 4
- 2026Vibe Researching as Wolf Coming: Can AI Agents with Skills Replace or Augment Social Scientists?cited by 4
- 2026ML-AutoResearch: Training Machine Learning Research Agents with Automatically Generated Environmentscited by 2
- 2026Scientific Agent Skills: A Library of Procedural Knowledge for Research Agentscited by 2
- 2026Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skillscited by 2
Built on by
Not cited yet.