Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphs
Not on the map. Why?
Abstract (arXiv)
Due to an exponential increase in published research articles, it is impossible for individual scientists to read all publications, even within their own research field. In this work, we investigate the use of large language models (LLMs) for the purpose of extracting the main concepts and semantic information from scientific abstracts in the domain of materials science to find links that were not noticed by humans and thus to suggest inspiring near/mid-term future research directions. We show that LLMs can extract concepts more efficiently than automated keyword extraction methods to build a concept graph as an abstraction of the scientific literature. A machine learning model is trained to predict emerging combinations of concepts, i.e. new research ideas, based on historical data. We demonstrate that integrating semantic concept information leads to an increased prediction performance. The applicability of our model is demonstrated in qualitative interviews with domain experts based on individualized model suggestions. We show that the model can inspire materials scientists in their creative thinking process by predicting innovative combinations of topics that have not yet been investigated.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 27 of its 63 references that are in the map. First posted on arXiv 20 Jun 2025.
Builds on
27 of 63 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2023LIMA: Less Is More for Alignmentcited by 1,100
15 more
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
- 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
- 2020Natural Language Processing Advancements By Deep Learning: A Surveycited by 50
- 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 36
- 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 25
- 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 22
- 2025In-situ graph reasoning and knowledge expansion using Graph-PReFLexORcited by 11
- 2025SCI-IDEA: Context-Aware Scientific Ideation Using Token and Sentence Embeddingscited by 8
- 2013A Big Data Approach to Computational Creativitycited by 3
- 2025ConExion: Concept Extraction with Large Language Modelscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent toolscited by 7
- 2026Harnessing AtomisticSkills for Agentic Atomistic Researchcited by 6
- 2026Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicinecited by 0
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discoverycited by 0
- 2026HyGRAIL: Cost-Aware and Evidence-Grounded Scientific Hypothesis Discovery over Knowledge Graphscited by 0
- 2026RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biasescited by 0
- 2026Time-Aligned Evolving Concept Graphs for Scientific Relation Forecastingcited by 0
- 2026SCoR: A Hierarchical Framework for Forecasting Relations Between Scientific Conceptscited by 0
- 2026LANTERN: Illuminating Hidden Mathematical Knowledge in Language Modelscited by 0
- 2026LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models26 Sep 2026
- 2026Time-Aligned Evolving Concept Graphs for Scientific Relation Forecasting16 Sep 2026
- 2026RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biases9 Sep 2026
- 2026HyGRAIL: Cost-Aware and Evidence-Grounded Scientific Hypothesis Discovery over Knowledge Graphs2 Sep 2026
- 2026SCoR: A Hierarchical Framework for Forecasting Relations Between Scientific Concepts27 Aug 2026
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discovery31 Jul 2026
- 2026Harnessing AtomisticSkills for Agentic Atomistic Research18 May 2026
- 2026Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine18 May 2026
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent tools13 Nov 2025