Uncertainty in Representation Learning on Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Knowledge graph embedding (KGE) methods represent entities and predicates in continuous vector spaces to infer missing knowledge. Despite strong benchmark performance, their predictions often lack principled reliability guarantees, limiting their use in high-stakes applications. Moreover, uncertainty arises throughout the KGE pipeline, from incomplete or probabilistic input knowledge to stochastic training and prediction. This thesis systematically investigates three sources of uncertainty in KGE: knowledge uncertainty, arising from incomplete, noisy, or probabilistic input knowledge; algorithmic uncertainty, induced by randomness in model training; and predictive uncertainty, concerning the reliability of model outputs. To address algorithmic uncertainty, the thesis demonstrates that models trained under identical settings can produce substantially different predictions and introduces a voting-based aggregation framework to mitigate this instability. To quantify predictive uncertainty, it adapts conformal prediction to KGE, constructing answer sets with distribution-free coverage guarantees and extending them to provide predicate-conditional reliability guarantees. To support reasoning under knowledge uncertainty, it develops statistically valid prediction intervals for confidence-scored triples and an embedding-based approach to approximate probabilistic reasoning over statistical ontologies with formal soundness guarantees. Together, these complementary, model-agnostic methods provide a practical and theoretically grounded approach to uncertainty in KGE, advancing beyond predictive accuracy toward reliable and uncertainty-aware knowledge graph reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 283 references that are in the map. First posted on arXiv 3 Oct 2026.
Builds on
38 of 283 references.
References · 38
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2019Conformalized Quantile Regressioncited by 629
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
26 more
- 2020Classification with Valid and Adaptive Coveragecited by 396
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 371
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 336
- 2017Three Factors Influencing Minima in SGDcited by 273
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
- 2014Qualitatively characterizing neural network optimization problemscited by 188
- 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
- 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 171
- 2023Conformal Language Modelingcited by 170
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 151
- 2024Language Models with Conformal Factuality Guaranteescited by 131
- 2020On Counterfactual Explanations under Predictive Multiplicitycited by 74
- 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 32
- 2017Analysis of the Impact of Negative Sampling on Link Prediction in Knowledge Graphscited by 23
- 2019Probability Calibration for Knowledge Graph Embedding Modelscited by 21
- 2022Description Logic EL++ Embeddings with Intersectional Closurecited by 16
- 2022A Unified Framework for Rank-based Evaluation Metrics for Link Prediction in Knowledge Graphscited by 15
- 2022ExpressivE: A Spatio-Functional Embedding For Knowledge Graph Completioncited by 13
- 2024Conformal Inductive Graph Neural Networkscited by 10
- 2017Differentiable Learning of Logical Rules for Knowledge Base Reasoningcited by 8
- 2018DeepProbLog: Neural Probabilistic Logic Programmingcited by 6
- 2024Approximating Probabilistic Inference in Statistical EL with Knowledge Graph Embeddingscited by 5
- 2024Robust Visual Representation Learning with Multi-modal Prior Knowledge for Image Classification Under Distribution Shiftcited by 3
- 2026AWM: Answerable Working Memory for Long-Document VQA Agentscited by 2
- 2026Conformalized Large Language Models under Configuration Shiftcited by 1
Built on by
Not cited yet.