mlsanityData to 14 Oct 2026

A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools

arXiv 2506.20743 ↗First posted 25 Jun 2025cs.LG cs.CEcited by 7

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are typically narrow in scope and require task-specific engineering, FMs offer cross-domain generalization and exhibit emergent capabilities. Their versatility is especially well-suited to materials science, where research challenges span diverse data types and scales. This survey provides a comprehensive overview of foundation models, agentic systems, datasets, and computational tools supporting this growing field. We introduce a task-driven taxonomy encompassing six broad application areas: data extraction, interpretation and Q&A; atomistic simulation; property prediction; materials structure, design and discovery; process planning, discovery, and optimization; and multiscale modeling. We discuss recent advances in both unimodal and multimodal FMs, as well as emerging large language model (LLM) agents. Furthermore, we review standardized datasets, open-source tools, and autonomous experimental platforms that collectively fuel the development and integration of FMs into research workflows. We assess the early successes of foundation models and identify persistent limitations, including challenges in generalizability, interpretability, data imbalance, safety concerns, and limited multimodal fusion. Finally, we articulate future research directions centered on scalable pretraining, continual learning, data governance, and trustworthiness.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 105 of its 214 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

105 of 214 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Science29 Aug
  2. 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun

Other references · 103

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2024The Llama 3 Herd of Modelscited by 14,715
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  10. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  11. 2017Graph Attention Networkscited by 8,923
  12. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
38 more
  1. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2016Pointer Sentinel Mixture Modelscited by 3,096
  8. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  10. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  11. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  12. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  13. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
  14. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  15. 2019An Introduction to Variational Autoencoderscited by 1,000
  16. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  17. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  18. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
  19. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  20. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  21. 2020Directional Message Passing for Molecular Graphscited by 561
  22. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
  23. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
  24. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
  25. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  26. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  27. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  28. 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
  29. 2023Role-Play with Large Language Modelscited by 294
  30. 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
  31. 2021Crystal Diffusion Variational Autoencoder for Periodic Material Generationcited by 270
  32. 2022Learning Local Equivariant Representations for Large-Scale Atomistic Dynamicscited by 256
  33. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
  34. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  35. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 229
  36. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
  37. 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
  38. 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 182

50 most cited of 103 All 103 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large language models in materials science and the need for open-source approaches
  2. 2026Towards Agentic Intelligence for Materials Science
  3. 2026From Data to Theory: Autonomous Large Language Model Agents for Materials Science
  4. 2025Hypothesis Generation for Materials Discovery and Design Using Goal-Driven and Constraint-Guided LLM Agents
  5. 2026MatMind: A Structure-Activity Knowledge-Driven Generative Foundation Model for Materials Science
  6. 2025Automated Extraction of Material Properties using LLM-based AI Agents
  7. 2025Autonomous Inorganic Materials Discovery via Multi-Agent Physics-Aware Scientific Reasoning
  8. 2023Agent-based Learning of Materials Datasets from Scientific Literature