Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPT
Not on the map. Why?
Abstract (arXiv)
The amount of data has growing significance in exploring cutting-edge materials and a number of datasets have been generated either by hand or automated approaches. However, the materials science field struggles to effectively utilize the abundance of data, especially in applied disciplines where materials are evaluated based on device performance rather than their properties. This article presents a new natural language processing (NLP) task called structured information inference (SII) to address the complexities of information extraction at the device level in materials science. We accomplished this task by tuning GPT-3 on an existing perovskite solar cell FAIR (Findable, Accessible, Interoperable, Reusable) dataset with 91.8% F1-score and extended the dataset with data published since its release. The produced data is formatted and normalized, enabling its direct utilization as input in subsequent data analysis. This feature empowers materials scientists to develop models by selecting high-quality review articles within their domain. Additionally, we designed experiments to predict the electrical performance of solar cells and design materials or devices with targeted parameters using large language models (LLMs). Our results demonstrate comparable performance to traditional machine learning methods without feature selection, highlighting the potential of LLMs to acquire scientific knowledge and design new materials akin to materials scientists.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 8 of its 36 references that are in the map. First posted on arXiv 5 Apr 2023.
Builds on
8 of 36 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 82
- 2022SELFIES and the future of molecular string representationscited by 76
- 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
- 2019The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structurescited by 48
- 2017Relation Extraction : A Surveycited by 44
Built on by
Citing papers per year: 2023: 3; 2024: 21; 2025: 5.
29 papers.
Sort:
By area:
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 56
- 2023DARWIN Series: Domain Specific Large Language Models for Natural Sciencecited by 39
- 2024LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillationcited by 32
- 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Researchcited by 30
- 2024SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluationcited by 23
- 2025Sparks of Science: Hypothesis Generation Using Structured Paper Datacited by 22
- 2024Large Language Model Agent as a Mechanical Designercited by 20
- 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Taskscited by 17
- 2024Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understandingcited by 15
- 2024Integrating Chemistry Knowledge in Large Language Models via Prompt Engineeringcited by 10
17 more
- 2024Geometry Informed Tokenization of Molecules for Language Model Generationcited by 10
- 2024A Survey on Symbolic Knowledge Distillation of Large Language Modelscited by 9
- 2024MatViX: Multimodal Information Extraction from Visually Rich Articlescited by 8
- 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networkscited by 6
- 2024Toward Reliable Ad-hoc Scientific Information Extraction: A Case Study on Two Materials Datasetscited by 5
- 2023Defining a New NLP Playgroundcited by 4
- 2024Research on Key Technologies for Cross-Cloud Federated Training of Large Language Modelscited by 4
- 2024CataLM: Empowering Catalyst Design Through Large Language Modelscited by 3
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarkingcited by 2
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Modelscited by 2
- 2023HyperPIE: Hyperparameter Information Extraction from Scientific Publicationscited by 1
- 2024Extracting Polymer Nanocomposite Samples from Full-Length Documentscited by 1
- 2024MaTableGPT: GPT-based Table Data Extractor from Materials Science Literaturecited by 0
- 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entitiescited by 0
- 2024Towards Efficient Large Language Models for Scientific Text: A Reviewcited by 0
- 2025RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBackcited by 0
- 2025Mechanisms of Matter: Language Inferential Benchmark on Physicochemical Hypothesis in Materials Synthesiscited by 0
- 2025Mechanisms of Matter: Language Inferential Benchmark on Physicochemical Hypothesis in Materials Synthesis29 Sep 2025
- 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networks6 Jun 2025
- 2025Sparks of Science: Hypothesis Generation Using Structured Paper Data17 Apr 2025
- 2025RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBack28 Mar 2025
- 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research17 Mar 2025
- 2024MatViX: Multimodal Information Extraction from Visually Rich Articles27 Oct 2024
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models25 Oct 2024
- 2024Research on Key Technologies for Cross-Cloud Federated Training of Large Language Models24 Oct 2024
- 2024SciSafeEval: A Comprehensive Benchmark for Safety Alignment of Large Language Models in Scientific Tasks2 Oct 2024
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Science29 Aug 2024
- 2024Towards Efficient Large Language Models for Scientific Text: A Review20 Aug 2024
- 2024Geometry Informed Tokenization of Molecules for Language Model Generation19 Aug 2024
17 more
- 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entities5 Aug 2024
- 2024A Survey on Symbolic Knowledge Distillation of Large Language Models12 Jul 2024
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery16 Jun 2024
- 2024MaTableGPT: GPT-based Table Data Extractor from Materials Science Literature8 Jun 2024
- 2024Toward Reliable Ad-hoc Scientific Information Extraction: A Case Study on Two Materials Datasets8 Jun 2024
- 2024SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluation16 May 2024
- 2024CataLM: Empowering Catalyst Design Through Large Language Models13 May 2024
- 2024Large Language Model Agent as a Mechanical Designer26 Apr 2024
- 2024Integrating Chemistry Knowledge in Large Language Models via Prompt Engineering22 Apr 2024
- 2024Extracting Polymer Nanocomposite Samples from Full-Length Documents1 Mar 2024
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2024LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation30 Jan 2024
- 2024Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understanding13 Jan 2024
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarking10 Jan 2024
- 2023HyperPIE: Hyperparameter Information Extraction from Scientific Publications17 Dec 2023
- 2023Defining a New NLP Playground31 Oct 2023
- 2023DARWIN Series: Domain Specific Large Language Models for Natural Science25 Aug 2023
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Sciencecited by 56
- 2024Large Language Model Agent as a Mechanical Designercited by 20
- 2024HoneyComb: A Flexible LLM-Based Agent System for Materials Science29 Aug 2024
- 2024Large Language Model Agent as a Mechanical Designer26 Apr 2024
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2023DARWIN Series: Domain Specific Large Language Models for Natural Sciencecited by 39
- 2024LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillationcited by 32
- 2024SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluationcited by 23
- 2025Sparks of Science: Hypothesis Generation Using Structured Paper Datacited by 22
- 2024Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understandingcited by 15
- 2024Integrating Chemistry Knowledge in Large Language Models via Prompt Engineeringcited by 10
- 2024Geometry Informed Tokenization of Molecules for Language Model Generationcited by 10
- 2024A Survey on Symbolic Knowledge Distillation of Large Language Modelscited by 9
- 2024MatViX: Multimodal Information Extraction from Visually Rich Articlescited by 8
- 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networkscited by 6
12 most cited of 25 All 25 (JSON)
- 2025Mechanisms of Matter: Language Inferential Benchmark on Physicochemical Hypothesis in Materials Synthesis29 Sep 2025
- 2025Research on Personalized Financial Product Recommendation by Integrating Large Language Models and Graph Neural Networks6 Jun 2025
- 2025Sparks of Science: Hypothesis Generation Using Structured Paper Data17 Apr 2025
- 2025RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBack28 Mar 2025
- 2024MatViX: Multimodal Information Extraction from Visually Rich Articles27 Oct 2024
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models25 Oct 2024
- 2024Research on Key Technologies for Cross-Cloud Federated Training of Large Language Models24 Oct 2024
- 2024Towards Efficient Large Language Models for Scientific Text: A Review20 Aug 2024
- 2024Geometry Informed Tokenization of Molecules for Language Model Generation19 Aug 2024
- 2024MaterioMiner -- An ontology-based text mining dataset for extraction of process-structure-property entities5 Aug 2024
- 2024A Survey on Symbolic Knowledge Distillation of Large Language Models12 Jul 2024
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery16 Jun 2024
12 newest of 25 All 25 (JSON)