Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics
Not on the map. Why?
Abstract (arXiv)
We introduce an explainable machine-learning approach that forecasts the structural precursors of scientific breakthroughs -- the emergence and intensification of links between research concepts -- by modelling how OpenAlex concept networks evolve over time. Using 59 semantic and topological features, a two-stage LightGBM model jointly predicts the formation and the future weight of concept pairs, adding a regression stage that quantifies expected intensity to prior link-existence forecasts. Relative to the state of the art, the approach improves accuracy and explainability at once: comparative validation across four technology and biomedical domains yields ROC-AUC in [0.954, 0.967] at all horizons without re-tuning, exceeding the roughly 0.90 of prior models, while every forecast rests on structural, auditable features rather than opaque embeddings. Classification performance is high (AUC about 0.95) and regression remains stable (RMSLE 0.45 to 0.6 over one to five years). Feature attribution shows that structural factors -- particularly Adamic-Adar similarity and degree-based Hadamard measures -- consistently drive accuracy, suggesting that breakthrough-relevant recombinations emerge in tightly connected sub-networks. Two expert-anchored cases, quantum annealing and AI-enabled quantum architectures, show the model surfacing technological convergence consistent with expert expectations. We then outline a three-layer decision architecture -- detection, expert translation, institutional integration -- that turns these forecasts into evidence-based research strategy and policy, anchored in open data and explainable features.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 41 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
8 of 41 references.
References · 8
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
- 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 25
- 2024Forecasting high-impact research topics via machine learning on evolving knowledge graphscited by 22
- 2018The Scientific Prize Network Predicts Who Pushes the Boundaries of Sciencecited by 2
- 2024An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registrycited by 2
- 2013Self-organization of progress across the century of physicscited by 1
- 2020Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by expertscited by 1
Built on by
Not cited yet.