Hypothesis Generation for Materials Discovery and Design Using Goal-Driven and Constraint-Guided LLM Agents
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Materials discovery and design are essential for advancing technology across various industries by enabling the development of application-specific materials. Recent research has leveraged Large Language Models (LLMs) to accelerate this process. We explore the potential of LLMs to generate viable hypotheses that, once validated, can expedite materials discovery. Collaborating with materials science experts, we curated a novel dataset from recent journal publications, featuring real-world goals, constraints, and methods for designing real-world applications. Using this dataset, we test LLM-based agents that generate hypotheses for achieving given goals under specific constraints. To assess the relevance and quality of these hypotheses, we propose a novel scalable evaluation metric that emulates the process a materials scientist would use to evaluate a hypothesis critically. Our curated dataset, proposed method, and evaluation framework aim to advance future research in accelerating materials discovery and design with LLMs.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 40 references that are in the map. First posted on arXiv 23 Jan 2025.
Builds on
17 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 268
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
- 2020An invertible crystallographic representation for general inverse design of inorganic crystals with targeted propertiescited by 53
- 2024ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedbackcited by 32
4 more
- 2023HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Sciencecited by 22
- 2024MatExpert: Decomposing Materials Discovery by Mimicking Human Expertscited by 18
- 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Explorationcited by 14
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
Built on by
Citing papers per year: 2025: 17; 2026: 13.
30 papers.
Sort:
By area:
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 41
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2025LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discoverycited by 11
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaborationcited by 6
18 more
- 2025GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Timecited by 5
- 2026TritonDFT: Automating DFT with a Multi-Agent Frameworkcited by 5
- 2026FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environmentscited by 4
- 2025BioVerge: A Comprehensive Benchmark and Study of Self-Evaluating Agents for Biomedical Hypothesis Generationcited by 3
- 2026Towards Agentic Intelligence for Materials Sciencecited by 3
- 2025Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judgecited by 2
- 2026Paper Circle: An Open-source Multi-agent Research Discovery and Analysis Frameworkcited by 2
- 2025Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimizationcited by 1
- 2025GeoEvolve: Automating Geospatial Model Discovery via Multi-Agent Large Language Modelscited by 1
- 2026Are LLMs Ready for Scientific Discovery? A Capability-Oriented Benchmark for AI Scientistscited by 1
- 2026COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learningcited by 1
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulationcited by 0
- 2026Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimizationcited by 0
- 2026SciFi: A Safe, Lightweight, User-Friendly, and Fully Autonomous Agentic AI Workflow for Scientific Applicationscited by 0
- 2026The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation?cited by 0
- 2026Visualizing Graph-to-Answer Mechanism Recovery in Materials-Science Hypothesis Generationcited by 0
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistrycited by 0
- 2026HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledgecited by 0
- 2026HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge10 Sep 2026
- 2026COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning31 Aug 2026
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistry28 Aug 2026
- 2026Visualizing Graph-to-Answer Mechanism Recovery in Materials-Science Hypothesis Generation4 Aug 2026
- 2026Are LLMs Ready for Scientific Discovery? A Capability-Oriented Benchmark for AI Scientists13 Jul 2026
- 2026The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation?26 May 2026
- 2026FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments28 Apr 2026
- 2026SciFi: A Safe, Lightweight, User-Friendly, and Fully Autonomous Agentic AI Workflow for Scientific Applications14 Apr 2026
- 2026Paper Circle: An Open-source Multi-agent Research Discovery and Analysis Framework7 Apr 2026
- 2026TritonDFT: Automating DFT with a Multi-Agent Framework2 Mar 2026
- 2026Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization27 Feb 2026
- 2026Towards Agentic Intelligence for Materials Science29 Jan 2026
18 more
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025BioVerge: A Comprehensive Benchmark and Study of Self-Evaluating Agents for Biomedical Hypothesis Generation12 Nov 2025
- 2025LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discovery26 Oct 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Time4 Oct 2025
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulation4 Oct 2025
- 2025GeoEvolve: Automating Geospatial Model Discovery via Multi-Agent Large Language Models25 Sep 2025
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimization3 Aug 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures24 Jun 2025
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaboration21 May 2025
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review28 Apr 2025
- 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaboration9 Apr 2025
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions12 Mar 2025
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidation11 Mar 2025
- 2025Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judge23 Feb 2025
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2026TritonDFT: Automating DFT with a Multi-Agent Frameworkcited by 5
- 2026FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environmentscited by 4
- 2025BioVerge: A Comprehensive Benchmark and Study of Self-Evaluating Agents for Biomedical Hypothesis Generationcited by 3
- 2026Towards Agentic Intelligence for Materials Sciencecited by 3
- 2026Paper Circle: An Open-source Multi-agent Research Discovery and Analysis Frameworkcited by 2
- 2025Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimizationcited by 1
- 2025GeoEvolve: Automating Geospatial Model Discovery via Multi-Agent Large Language Modelscited by 1
12 most cited of 14 All 14 (JSON)
- 2026FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments28 Apr 2026
- 2026SciFi: A Safe, Lightweight, User-Friendly, and Fully Autonomous Agentic AI Workflow for Scientific Applications14 Apr 2026
- 2026Paper Circle: An Open-source Multi-agent Research Discovery and Analysis Framework7 Apr 2026
- 2026TritonDFT: Automating DFT with a Multi-Agent Framework2 Mar 2026
- 2026Towards Agentic Intelligence for Materials Science29 Jan 2026
- 2025BioVerge: A Comprehensive Benchmark and Study of Self-Evaluating Agents for Biomedical Hypothesis Generation12 Nov 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulation4 Oct 2025
- 2025GeoEvolve: Automating Geospatial Model Discovery via Multi-Agent Large Language Models25 Sep 2025
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimization3 Aug 2025
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures24 Jun 2025
12 newest of 14 All 14 (JSON)
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review28 Apr 2025
- 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidation11 Mar 2025
- 2025LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discoverycited by 11
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaborationcited by 6
- 2025GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Timecited by 5
- 2025Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judgecited by 2
- 2026Are LLMs Ready for Scientific Discovery? A Capability-Oriented Benchmark for AI Scientistscited by 1
- 2026COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learningcited by 1
- 2026Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimizationcited by 0
- 2026The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation?cited by 0
- 2026Visualizing Graph-to-Answer Mechanism Recovery in Materials-Science Hypothesis Generationcited by 0
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistrycited by 0
- 2026HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledgecited by 0
- 2026HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge10 Sep 2026
- 2026COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning31 Aug 2026
- 2026MAIL: Memory-driven, Adaptive, Incremental, and Literature-grounded Framework for Hypothesis Generation in Chemistry28 Aug 2026
- 2026Visualizing Graph-to-Answer Mechanism Recovery in Materials-Science Hypothesis Generation4 Aug 2026
- 2026Are LLMs Ready for Scientific Discovery? A Capability-Oriented Benchmark for AI Scientists13 Jul 2026
- 2026The Compressive Knowledge Graph Hypothesis: Which Graph Facts Matter for Scientific Hypothesis Generation?26 May 2026
- 2026Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization27 Feb 2026
- 2025LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discovery26 Oct 2025
- 2025GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Time4 Oct 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025PriM: Principle-Inspired Material Discovery through Multi-Agent Collaboration9 Apr 2025
- 2025Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judge23 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2024Are LLMs Ready for Real-World Materials Discovery?
- 2025Large language models in materials science and the need for open-source approaches
- 2024LLMatDesign: Autonomous Materials Discovery with Large Language Models
- 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools
- 2025LLM Agents for Knowledge Discovery in Atomic Layer Processing
- 2025Role of Large Language Models and Retrieval-Augmented Generation for Accelerating Crystalline Material Discovery: A Systematic Review
- 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discovery
- 2026Evaluating LLM-based AI agents integrated with materials synthesis tools: the case of atomic layer deposition