mlsanityData to 14 Oct 2026

Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphs

arXiv 2506.16824 ↗First posted 20 Jun 2025cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Due to an exponential increase in published research articles, it is impossible for individual scientists to read all publications, even within their own research field. In this work, we investigate the use of large language models (LLMs) for the purpose of extracting the main concepts and semantic information from scientific abstracts in the domain of materials science to find links that were not noticed by humans and thus to suggest inspiring near/mid-term future research directions. We show that LLMs can extract concepts more efficiently than automated keyword extraction methods to build a concept graph as an abstraction of the scientific literature. A machine learning model is trained to predict emerging combinations of concepts, i.e. new research ideas, based on historical data. We demonstrate that integrating semantic concept information leads to an increased prediction performance. The applicability of our model is demonstrated in qualitative interviews with domain experts based on individualized model suggestions. We show that the model can inspire materials scientists in their creative thinking process by predicting innovative combinations of topics that have not yet been investigated.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 27 of its 63 references that are in the map. First posted on arXiv 20 Jun 2025.

Builds on

27 of 63 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  10. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  12. 2023LIMA: Less Is More for Alignmentcited by 1,100
15 more
  1. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  2. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
  3. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  4. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
  5. 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
  6. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
  7. 2022Structured information extraction from complex scientific text with fine-tuned large language modelscited by 56
  8. 2020Natural Language Processing Advancements By Deep Learning: A Surveycited by 50
  9. 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 36
  10. 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 25
  11. 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 22
  12. 2025In-situ graph reasoning and knowledge expansion using Graph-PReFLexORcited by 11
  13. 2025SCI-IDEA: Context-Aware Scientific Ideation Using Token and Sentence Embeddingscited by 8
  14. 2013A Big Data Approach to Computational Creativitycited by 3
  15. 2025ConExion: Concept Extraction with Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.