A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are typically narrow in scope and require task-specific engineering, FMs offer cross-domain generalization and exhibit emergent capabilities. Their versatility is especially well-suited to materials science, where research challenges span diverse data types and scales. This survey provides a comprehensive overview of foundation models, agentic systems, datasets, and computational tools supporting this growing field. We introduce a task-driven taxonomy encompassing six broad application areas: data extraction, interpretation and Q&A; atomistic simulation; property prediction; materials structure, design and discovery; process planning, discovery, and optimization; and multiscale modeling. We discuss recent advances in both unimodal and multimodal FMs, as well as emerging large language model (LLM) agents. Furthermore, we review standardized datasets, open-source tools, and autonomous experimental platforms that collectively fuel the development and integration of FMs into research workflows. We assess the early successes of foundation models and identify persistent limitations, including challenges in generalizability, interpretability, data imbalance, safety concerns, and limited multimodal fusion. Finally, we articulate future research directions centered on scalable pretraining, continual learning, data governance, and trustworthiness.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 105 of its 214 references that are in the map. First posted on arXiv 25 Jun 2025.
Builds on
105 of 214 references.
Closest ancestors · 2
Same direction, newest first
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Science29 Aug
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun
Other references · 103
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
38 more
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
- 2023Role-Play with Large Language Modelscited by 294
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
- 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 270
- 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 256
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
- 2019Evaluating Protein Transfer Learning with TAPEcited by 231
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 229
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
- 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 182
50 most cited of 103 All 103 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2026SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agentscited by 15
- 2025"DIVE" into Hydrogen Storage Materials Discovery with AI Agentscited by 3
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Designcited by 1
- 2026Property Prediction of Stacked Bilayer Materials: A Multimodal Learning Approachcited by 1
- 2025LSM-MS2: A Foundation Model Bridging Spectral Identification and Biological Interpretationcited by 0
- 2026RECIPER: A Dual-View Retrieval Pipeline for Procedure-Oriented Materials Question Answeringcited by 0
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal modelscited by 0
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal models10 Sep 2026
- 2026Property Prediction of Stacked Bilayer Materials: A Multimodal Learning Approach31 May 2026
- 2026RECIPER: A Dual-View Retrieval Pipeline for Procedure-Oriented Materials Question Answering13 Apr 2026
- 2026AutoMS: Multi-Agent Evolutionary Search for Cross-Physics Inverse Microstructure Design28 Mar 2026
- 2026SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agents13 Feb 2026
- 2025LSM-MS2: A Foundation Model Bridging Spectral Identification and Biological Interpretation30 Oct 2025
- 2025"DIVE" into Hydrogen Storage Materials Discovery with AI Agents18 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Large language models in materials science and the need for open-source approaches
- 2026Towards Agentic Intelligence for Materials Science
- 2026From Data to Theory: Autonomous Large Language Model Agents for Materials Science
- 2025Hypothesis Generation for Materials Discovery and Design Using Goal-Driven and Constraint-Guided LLM Agents
- 2026MatMind: A Structure-Activity Knowledge-Driven Generative Foundation Model for Materials Science
- 2025Automated Extraction of Material Properties using LLM-based AI Agents
- 2025Autonomous Inorganic Materials Discovery via Multi-Agent Physics-Aware Scientific Reasoning
- 2023Agent-based Learning of Materials Datasets from Scientific Literature