FedMKGC: Privacy-Preserving Federated Multilingual Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods that rely on transferring raw data among KGs raise privacy concerns. To address this challenge, we propose a new federated learning framework that implicitly aggregates knowledge from multiple KGs without demanding raw data exchange and entity alignment. We treat each KG as a client that trains a local language model through textbased knowledge representation learning. A central server then aggregates the model weights from clients. As natural language provides a universal representation, the same knowledge thus has similar semantic representations across KGs. As such, the aggregated language model can leverage complementary knowledge from multilingual KGs without demanding raw user data sharing. Extensive experiments on a benchmark dataset demonstrate that our method substantially improves KGC on multilingual KGs, achieving comparable performance to state-of-the-art alignment-based models without requiring any labeled alignments or raw user data sharing. Our codes will be publicly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 17 Dec 2023.
Builds on
17 of 29 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2015Holographic Embeddings of Knowledge Graphscited by 181
- 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
- 2020FedE: Embedding Knowledge Graphs in Federated Settingcited by 46
- 2021Differentially Private Federated Knowledge Graphs Embeddingcited by 45
- 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
5 more
- 2022Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learningcited by 45
- 2023Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearningcited by 39
- 2022Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignmentcited by 24
- 2021Multilingual Knowledge Graph Completion with Joint Relation and Entity Alignmentcited by 12
- 2023Collective Knowledge Graph Completion with Mutual Knowledge Distillationcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.