# Type Information-Assisted Self-Supervised Knowledge Graph Denoising

arXiv: https://arxiv.org/abs/2503.09916 · HTML: https://mlsanity.com/paper/2503.09916/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 51 references that are in the map.
- First posted on arXiv 13 Mar 2025.

## Builds on (most cited first, 18 of 18)

- [Open Graph Benchmark: Datasets for Machine Learning on Graphs](https://mlsanity.com/paper/2005.00687/) (2020)
- [Modeling Relational Data with Graph Convolutional Networks](https://mlsanity.com/paper/1703.06103/) (2017)
- [Embedding Entities and Relations for Learning and Inference in Knowledge Bases](https://mlsanity.com/paper/1412.6575/) (2014)
- [Convolutional 2D Knowledge Graph Embeddings](https://mlsanity.com/paper/1707.01476/) (2017)
- [Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://mlsanity.com/paper/2306.08302/) (2023)
- [A Survey on Knowledge Graphs: Representation, Acquisition and Applications](https://mlsanity.com/paper/2002.00388/) (2020)
- [DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning](https://mlsanity.com/paper/1707.06690/) (2017)
- [Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images](https://mlsanity.com/paper/2101.02824/) (2021)
- [A Survey on Knowledge Graph-Based Recommender Systems](https://mlsanity.com/paper/2003.00911/) (2020)
- [Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs](https://mlsanity.com/paper/1906.01195/) (2019)
- [Triple Trustworthiness Measurement for Knowledge Graph](https://mlsanity.com/paper/1809.09414/) (2018)
- [Contrastive Knowledge Graph Error Detection](https://mlsanity.com/paper/2211.10030/) (2022)
- [What is Normal, What is Strange, and What is Missing in a Knowledge Graph: Unified Characterization via Inductive Summarization](https://mlsanity.com/paper/2003.10412/) (2020)
- [A Review of Knowledge Graph Completion](https://mlsanity.com/paper/2208.11652/) (2022)
- [Interpretable Graph Convolutional Neural Networks for Inference on Noisy Knowledge Graphs](https://mlsanity.com/paper/1812.00279/) (2018)
- [On the Identifiability of Sparse ICA without Assuming Non-Gaussianity](https://mlsanity.com/paper/2408.10353/) (2024)
- [Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection](https://mlsanity.com/paper/2310.12011/) (2023)
- [Self2Self+: Single-Image Denoising with Self-Supervised Learning and Image Quality Assessment Loss](https://mlsanity.com/paper/2307.10695/) (2023)

## Abstract (arXiv)

Knowledge graphs serve as critical resources supporting intelligent systems, but they can be noisy due to imperfect automatic generation processes. Existing approaches to noise detection often rely on external facts, logical rule constraints, or structural embeddings. These methods are often challenged by imperfect entity alignment, flexible knowledge graph construction, and overfitting on structures. In this paper, we propose to exploit the consistency between entity and relation type information for noise detection, resulting a novel self-supervised knowledge graph denoising method that avoids those problems. We formalize type inconsistency noise as triples that deviate from the majority with respect to type-dependent reasoning along the topological structure. Specifically, we first extract a compact representation of a given knowledge graph via an encoder that models the type dependencies of triples. Then, the decoder reconstructs the original input knowledge graph based on the compact representation. It is worth noting that, our proposal has the potential to address the problems of knowledge graph compression and completion, although this is not our focus. For the specific task of noise detection, the discrepancy between the reconstruction results and the input knowledge graph provides an opportunity for denoising, which is facilitated by the type consistency embedded in our method. Experimental validation demonstrates the effectiveness of our approach in detecting potential noise in real-world data.
