mlsanityData to 7 Oct 2026

Predicate Importance Estimation and Decoupled Rationale-Score Distillation for Entity Alignment

arXiv 2606.22992 ↗First posted 22 Jun 2026cs.CLcited by 0

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Knowledge graphs (KGs) are increasingly used as structured context for Large Language Models (LLMs), but industrial KG-RAG systems often need to integrate public and domain-specific KGs constructed from heterogeneous databases. This integration relies on Entity Alignment (EA), where lexical matching alone is insufficient under predicate-name variation and incomplete local neighborhoods. We address EA for KG integration by constructing a pairwise EA dataset and proposing two complementary modules: Predicate Importance Estimation (PIE) and Decoupled Rationale-Score Distillation (DRSD). PIE is a compact embedding-based approach that removes the subject information from each 1-hop triple, encodes the resulting subjectless triples, and aggregates them with learnable predicate-importance weights to build predicate-aware entity embeddings. DRSD trains a distilled small language model (SLM) with pseudo-answers produced by a teacher LLM through distinct prompts. By converting binary EA labels into text-based supervision and decoupling confidence-score estimation from label-consistent rationales, DRSD enables the SLM to learn task-specific reasoning while retaining a less label-biased confidence signal. Experiments show that PIE and DRSD improve EA classification. Moreover, because DRSD decouples confidence-score estimation from the decision, a discrepancy between the two flags an uncertain prediction for human review, thereby enabling a practical discrepancy between automatic acceptance and human-in-the-loop verification.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 25 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

16 of 25 references.

References · 16

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  4. 2022Large Language Models Are Reasoning Teacherscited by 318
  5. 2022Teaching Small Language Models to Reasoncited by 279
  6. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 235
  7. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
  8. 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
  9. 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 126
  10. 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
  11. 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 119
  12. 2019Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphscited by 106
4 more
  1. 2019Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregationcited by 101
  2. 2019Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Networkcited by 68
  3. 2021A Benchmark and Comprehensive Survey on Knowledge Graph Entity Alignment via Representation Learningcited by 31
  4. 2024Unlocking the Power of Large Language Models for Entity Alignmentcited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024LLM-Align: Utilizing Large Language Models for Entity Alignment in Knowledge Graphs
  2. 2024Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment
  3. 2024Entity Alignment with Noisy Annotations from Large Language Models
  4. 2024DERA: Dense Entity Retrieval for Entity Alignment in Knowledge Graphs
  5. 2023AutoAlign: Fully Automatic and Effective Knowledge Graph Alignment enabled by Large Language Models
  6. 2023From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment
  7. 2026HELEA: Hard-Negative Benchmark and LLM-based Reranking for Robust Entity Alignment
  8. 2022Adapters for Enhanced Modeling of Multilingual Knowledge and Text