BLADE: Distilled LLM Regularization for Calibrated Knowledge Graph Completion
On the map: Knowledge distillation → Knowledge distillation for LLMs
Abstract (arXiv)
Knowledge graph completion models optimize ranking, although many downstream applications require calibrated probabilities. We present BLADE, a variational model that separates latent truth from graph recording and distills offline language-model judgments into a frozen teacher regularizer. The LLM is absent during inference. Posterior samples provide predictive probabilities and epistemic uncertainty, while the compact teacher remains available only as an optional triage factor. Across five benchmarks, BLADE remains competitive under a common ranking protocol and reduces adaptive ECE by a macro-average of 60.1% relative to deep ensembles and 78.1% relative to temperature-scaled RotatE. On identical FB15k-237 candidate sets, BLADE also improves ECE, Brier score, and NLL over validation-selected histogram binning and a matched generative ComplEx2 model, with these improvements persisting on a prespecified near-miss pool. Under controlled injected missingness, the full triage score achieves a mean AUC-PR of 0.863, compared with 0.805 for its strongest non-teacher variant. Leakage stress tests show that aligned semantics matter, but they cannot exclude knowledge acquired during LLM pretraining. We therefore claim calibration only for the declared candidate distributions, not for all unobserved triples.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge distillation for LLMs, one of 12 directions in Knowledge distillation. Builds on 16 of its 27 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
16 of 27 references.
References · 16
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
- 2020CoDEx: A Comprehensive Knowledge Graph Completion Benchmarkcited by 102
4 more
- 2020Bayesian Graph Neural Networks with Adaptive Connection Samplingcited by 81
- 2015TransG : A Generative Mixture Model for Knowledge Graph Embeddingcited by 28
- 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025KG-CF: Knowledge Graph Completion with Context Filtering under the Guidance of Large Language Models
- 2025Exploring Graph Learning Tasks with Pure LLMs: A Comprehensive Benchmark and Investigation
- 2026Grounding LLM Reasoning under Incomplete Graph Evidence
- 2026MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation
- 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
- 2025ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models
- 2025Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphs
- 2025Optimizing the Interface Between Knowledge Graphs and LLMs for Complex Reasoning