Forecasting high-impact research topics via machine learning on evolving knowledge graphs
Not on the map. Why?
Abstract (arXiv)
The exponential growth in scientific publications poses a severe challenge for human researchers. It forces attention to more narrow sub-fields, which makes it challenging to discover new impactful research ideas and collaborations outside one's own field. While there are ways to predict a scientific paper's future citation counts, they need the research to be finished and the paper written, usually assessing impact long after the idea was conceived. Here we show how to predict the impact of onsets of ideas that have never been published by researchers. For that, we developed a large evolving knowledge graph built from more than 21 million scientific papers. It combines a semantic network created from the content of the papers and an impact network created from the historic citations of papers. Using machine learning, we can predict the dynamic of the evolving network into the future with high accuracy (AUC values beyond 0.9 for most experiments), and thereby the impact of new research directions. We envision that the ability to predict the impact of new ideas will be a crucial component of future artificial muses that can inspire new impactful and interesting scientific ideas.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 23 of its 69 references that are in the map. First posted on arXiv 13 Feb 2024.
Builds on
23 of 69 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 166
- 2020Growth rates of modern science: A latent piecewise growth curve approach to model publication numbers from established and new literature databasescited by 75
- 2022On scientific understanding with artificial intelligencecited by 68
- 2021The physics of higher-order interactions in complex systemscited by 63
- 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 34
11 more
- 2013Quantifying Long-Term Scientific Impactcited by 28
- 2023Accelerating science with human-aware artificial intelligencecited by 27
- 2013Tradition and Innovation in Scientists' Research Strategiescited by 26
- 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 24
- 2021The CSO Classifier: Ontology-Driven Detection of Research Topics in Scholarly Articlescited by 16
- 2015Defining and identifying Sleeping Beauties in sciencecited by 11
- 2015Predicting the long-term citation impact of recent publicationscited by 8
- 2020Detecting signal from science:The structure of research communities and prior knowledge improves prediction of genetic regulatory experimentscited by 4
- 2020An Overview on Evaluating and Predicting Scholarly Article Impactcited by 3
- 2022Predicting Research Trends in Artificial Intelligence with Gradient Boosting Decision Trees and Time-aware Graph Neural Networkscited by 3
- 2023H2CGL: Modeling Dynamics of Citation Network for Impact Predictioncited by 3
Built on by
Citing papers per year: 2024: 5; 2025: 5; 2026: 11.
21 papers.
Sort:
By area:
- 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 25
- 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 21
- 2024Toward a Team of AI-made Scientists for Scientific Discovery from Gene Expression Datacited by 10
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 7
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent toolscited by 7
- 2026Learning to Predict Future-Aligned Research Proposals with Language Modelscited by 5
- 2024Discovering emergent connections in quantum physics research via dynamic word embeddingscited by 3
- 2026Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QAcited by 3
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysiscited by 2
- 2025FOS: A Large-Scale Temporal Graph Benchmark for Scientific Interdisciplinary Link Predictioncited by 2
- 2026SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Predictioncited by 2
- 2026Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluationcited by 2
9 more
- 2026ForeSci: Evaluating LLM Agents for Forward-Looking AI Research Judgmentcited by 2
- 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completioncited by 1
- 2024Challenge-Device-Synthesis: A multi-disciplinary approach for the development of social innovation competences for students of Artificial Intelligencecited by 0
- 2026LLM-Metrics: Measuring Research Impact Through Large Language Model Memorycited by 0
- 2026Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamicscited by 0
- 2026Forecasting Conceptual Diffusion in Science: The Case of Quantum Computingcited by 0
- 2026RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biasescited by 0
- 2026BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstructioncited by 0
- 2026Learning to Ideate for Scientific Impactcited by 0
- 2026Learning to Ideate for Scientific Impact24 Sep 2026
- 2026BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction21 Sep 2026
- 2026RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biases9 Sep 2026
- 2026Forecasting Conceptual Diffusion in Science: The Case of Quantum Computing2 Jun 2026
- 2026Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics2 Jun 2026
- 2026ForeSci: Evaluating LLM Agents for Forward-Looking AI Research Judgment30 May 2026
- 2026LLM-Metrics: Measuring Research Impact Through Large Language Model Memory21 May 2026
- 2026SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Prediction18 Apr 2026
- 2026Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation6 Apr 2026
- 2026Learning to Predict Future-Aligned Research Proposals with Language Models28 Mar 2026
- 2026Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QA30 Jan 2026
- 2025FOS: A Large-Scale Temporal Graph Benchmark for Scientific Interdisciplinary Link Prediction23 Nov 2025
9 more
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent tools13 Nov 2025
- 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completion19 Oct 2025
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis20 May 2025
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models20 May 2025
- 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Context23 Dec 2024
- 2024Discovering emergent connections in quantum physics research via dynamic word embeddings10 Nov 2024
- 2024Challenge-Device-Synthesis: A multi-disciplinary approach for the development of social innovation competences for students of Artificial Intelligence29 May 2024
- 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders27 May 2024
- 2024Toward a Team of AI-made Scientists for Scientific Discovery from Gene Expression Data15 Feb 2024
- 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 21
- 2024Toward a Team of AI-made Scientists for Scientific Discovery from Gene Expression Datacited by 10
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 7
- 2026Learning to Predict Future-Aligned Research Proposals with Language Modelscited by 5
- 2024Discovering emergent connections in quantum physics research via dynamic word embeddingscited by 3
- 2026Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QAcited by 3
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysiscited by 2
- 2025FOS: A Large-Scale Temporal Graph Benchmark for Scientific Interdisciplinary Link Predictioncited by 2
- 2026SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Predictioncited by 2
- 2026Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluationcited by 2
- 2024Challenge-Device-Synthesis: A multi-disciplinary approach for the development of social innovation competences for students of Artificial Intelligencecited by 0
- 2026LLM-Metrics: Measuring Research Impact Through Large Language Model Memorycited by 0
12 most cited of 16 All 16 (JSON)
- 2026Learning to Ideate for Scientific Impact24 Sep 2026
- 2026BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction21 Sep 2026
- 2026Forecasting Conceptual Diffusion in Science: The Case of Quantum Computing2 Jun 2026
- 2026Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics2 Jun 2026
- 2026LLM-Metrics: Measuring Research Impact Through Large Language Model Memory21 May 2026
- 2026SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Prediction18 Apr 2026
- 2026Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation6 Apr 2026
- 2026Learning to Predict Future-Aligned Research Proposals with Language Models28 Mar 2026
- 2026Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QA30 Jan 2026
- 2025FOS: A Large-Scale Temporal Graph Benchmark for Scientific Interdisciplinary Link Prediction23 Nov 2025
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis20 May 2025
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models20 May 2025
12 newest of 16 All 16 (JSON)