Predicate Importance Estimation and Decoupled Rationale-Score Distillation for Entity Alignment
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Knowledge graphs (KGs) are increasingly used as structured context for Large Language Models (LLMs), but industrial KG-RAG systems often need to integrate public and domain-specific KGs constructed from heterogeneous databases. This integration relies on Entity Alignment (EA), where lexical matching alone is insufficient under predicate-name variation and incomplete local neighborhoods. We address EA for KG integration by constructing a pairwise EA dataset and proposing two complementary modules: Predicate Importance Estimation (PIE) and Decoupled Rationale-Score Distillation (DRSD). PIE is a compact embedding-based approach that removes the subject information from each 1-hop triple, encodes the resulting subjectless triples, and aggregates them with learnable predicate-importance weights to build predicate-aware entity embeddings. DRSD trains a distilled small language model (SLM) with pseudo-answers produced by a teacher LLM through distinct prompts. By converting binary EA labels into text-based supervision and decoupling confidence-score estimation from label-consistent rationales, DRSD enables the SLM to learn task-specific reasoning while retaining a less label-biased confidence signal. Experiments show that PIE and DRSD improve EA classification. Moreover, because DRSD decouples confidence-score estimation from the decision, a discrepancy between the two flags an uncertain prediction for human review, thereby enabling a practical discrepancy between automatic acceptance and human-in-the-loop verification.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 25 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
16 of 25 references.
References · 16
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2022Large Language Models Are Reasoning Teacherscited by 318
- 2022Teaching Small Language Models to Reasoncited by 279
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
- 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
- 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 126
- 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
- 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 119
- 2019Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphscited by 106
4 more
- 2019Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregationcited by 101
- 2019Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Networkcited by 68
- 2021A Benchmark and Comprehensive Survey on Knowledge Graph Entity Alignment via Representation Learningcited by 31
- 2024Unlocking the Power of Large Language Models for Entity Alignmentcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024LLM-Align: Utilizing Large Language Models for Entity Alignment in Knowledge Graphs
- 2024Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment
- 2024Entity Alignment with Noisy Annotations from Large Language Models
- 2024DERA: Dense Entity Retrieval for Entity Alignment in Knowledge Graphs
- 2023AutoAlign: Fully Automatic and Effective Knowledge Graph Alignment enabled by Large Language Models
- 2023From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment
- 2026HELEA: Hard-Negative Benchmark and LLM-based Reranking for Robust Entity Alignment
- 2022Adapters for Enhanced Modeling of Multilingual Knowledge and Text