mlsanityData to 7 Oct 2026

Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPT

arXiv 2304.02213 ↗First posted 5 Apr 2023cs.CL cs.AIcited by 29

Not on the map. Why?

Abstract (arXiv)

The amount of data has growing significance in exploring cutting-edge materials and a number of datasets have been generated either by hand or automated approaches. However, the materials science field struggles to effectively utilize the abundance of data, especially in applied disciplines where materials are evaluated based on device performance rather than their properties. This article presents a new natural language processing (NLP) task called structured information inference (SII) to address the complexities of information extraction at the device level in materials science. We accomplished this task by tuning GPT-3 on an existing perovskite solar cell FAIR (Findable, Accessible, Interoperable, Reusable) dataset with 91.8% F1-score and extended the dataset with data published since its release. The produced data is formatted and normalized, enabling its direct utilization as input in subsequent data analysis. This feature empowers materials scientists to develop models by selecting high-quality review articles within their domain. Additionally, we designed experiments to predict the electrical performance of solar cells and design materials or devices with targeted parameters using large language models (LLMs). Our results demonstrate comparable performance to traditional machine learning methods without feature selection, highlighting the potential of LLMs to acquire scientific knowledge and design new materials akin to materials scientists.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 8 of its 36 references that are in the map. First posted on arXiv 5 Apr 2023.

Builds on

8 of 36 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
  4. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 82
  5. 2022SELFIES and the future of molecular string representationscited by 76
  6. 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
  7. 2019The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structurescited by 48
  8. 2017Relation Extraction : A Surveycited by 44

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 21; 2025: 5.

29 papers.

Sort:

By area:

  1. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
  2. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  3. 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 56
  4. 2023DARWIN Series: Domain Specific Large Language Models for Natural Sciencecited by 39
  5. 2024LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillationcited by 32
  6. 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Researchcited by 30
  7. 2024SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluationcited by 23
  8. 2025Sparks of Science: Hypothesis Generation Using Structured Paper Datacited by 22
  9. 2024Large Language Model Agent as a Mechanical Designercited by 20
  10. 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Taskscited by 17
  11. 2024Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understandingcited by 15
  12. 2024Integrating Chemistry Knowledge in Large Language Models via Prompt Engineeringcited by 10
17 more
  1. 2024Geometry Informed Tokenization of Molecules for Language Model Generationcited by 10
  2. 2024A Survey on Symbolic Knowledge Distillation of Large Language Modelscited by 9
  3. 2024MatViX: Multimodal Information Extraction from Visually Rich Articlescited by 8
  4. 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networkscited by 6
  5. 2024Toward Reliable Ad-hoc Scientific Information Extraction: A Case Study on Two Materials Datasetscited by 5
  6. 2023Defining a New NLP Playgroundcited by 4
  7. 2024Research on Key Technologies for Cross-Cloud Federated Training of Large Language Modelscited by 4
  8. 2024CataLM: Empowering Catalyst Design Through Large Language Modelscited by 3
  9. 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarkingcited by 2
  10. 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Modelscited by 2
  11. 2023HyperPIE: Hyperparameter Information Extraction from Scientific Publicationscited by 1
  12. 2024Extracting Polymer Nanocomposite Samples from Full-Length Documentscited by 1
  13. 2024MaTableGPT: GPT-based Table Data Extractor from Materials Science Literaturecited by 0
  14. 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entitiescited by 0
  15. 2024Towards Efficient Large Language Models for Scientific Text: A Reviewcited by 0
  16. 2025RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBackcited by 0
  17. 2025Mechanisms of Matter: Language Inferential Benchmark on Physicochemical Hypothesis in Materials Synthesiscited by 0