Discovery Foundation Models: Toward Open-Ended Discovery Intelligence
Not on the map. Why?
Abstract (arXiv)
Foundation models have progressed from learning and reasoning over existing knowledge, to increasingly learning through action, tool use, and outcome feedback. We argue that the next frontier is a further transition: from solving and acting within problems specified by humans to participating in the process by which new problems, representations, explanations, and knowledge are created. We refer to this capability as Discovery Intelligence. We formulate Discovery Foundation Models (DFMs) as general-purpose model systems for open-ended discovery. A DFM operates over a revisable research state and supports seven coupled capabilities spanning problem discovery, formulation, representation construction, hypothesis formation, intervention, evidence-grounded revision, and continual discovery improvement. We instantiate this framework with Zetema, which couples explicit research-state dynamics, verification and experimental gating, external grounding, and cross-task Discovery Skill evolution. We further ground the framework with GALILEO, a real therapeutic-discovery system in which Dry-Lab reasoning, robotic and hands-on Wet-Lab experimentation, external biological evidence, and iterative hypothesis and design revision form a closed physical discovery loop. We then formulate a unified approach to capability formation and process-centered evaluation, enabling discovery behavior to be trained, improved, and measured beyond final-answer performance. Together, these components establish discovery as a learnable, executable, and evaluable capability of foundation-model systems. We view this shift as a broader progression in intelligence scaling: from learning over existing knowledge, to learning from action outcomes, and ultimately to participating in the construction, testing, and revision of the structures through which new knowledge is discovered. Code: https://github.com/Gen-Verse/DFM-Plans
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 59 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
33 of 59 references.
References · 33
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
21 more
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
- 2026Towards End-to-End Automation of AI Researchcited by 150
- 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 97
- 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
- 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templatescited by 62
- 2025Co-Evolving LLM Coder and Unit Tester via Reinforcement Learningcited by 51
- 2024Risks of AI Scientists: Prioritizing Safeguarding Over Autonomycited by 49
- 2025Evaluating Large Language Models in Scientific Discoverycited by 38
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
- 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 19
- 2025BoxingGym: Benchmarking Progress in Automated Experimental Design and Model Discoverycited by 15
- 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Researchcited by 15
- 2026AI scientists produce results without reasoning scientificallycited by 13
- 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnessescited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.