Combating Confirmation Bias: A Unified Pseudo-Labeling Framework for Entity Alignment
Not on the map. Why?
Abstract (arXiv)
Entity alignment (EA) aims at identifying equivalent entity pairs across different knowledge graphs (KGs) that refer to the same real-world identity. To circumvent the shortage of seed alignments provided for training, recent EA models utilize pseudo-labeling strategies to iteratively add unaligned entity pairs predicted with high confidence to the seed alignments for model training. However, the adverse impact of confirmation bias during pseudo-labeling has been largely overlooked, thus hindering entity alignment performance. To systematically combat confirmation bias for pseudo-labeling-based entity alignment, we propose a Unified Pseudo-Labeling framework for Entity Alignment (UPL-EA) that explicitly eliminates pseudo-labeling errors to boost the accuracy of entity alignment. UPL-EA consists of two complementary components: (1) Optimal Transport (OT)-based pseudo-labeling uses discrete OT modeling as an effective means to determine entity correspondences and reduce erroneous matches across two KGs. An effective criterion is derived to infer pseudo-labeled alignments that satisfy one-to-one correspondences; (2) Parallel pseudo-label ensembling refines pseudo-labeled alignments by combining predictions over multiple models independently trained in parallel. The ensembled pseudo-labeled alignments are thereafter used to augment seed alignments to reinforce subsequent model training for alignment inference. The effectiveness of UPL-EA in eliminating pseudo-labeling errors is both theoretically supported and experimentally validated. Our extensive results and in-depth analyses demonstrate the superiority of UPL-EA over 15 competitive baselines and its utility as a general pseudo-labeling framework for entity alignment.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 5 Jul 2023.
Builds on
39 of 66 references.
References · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 537
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 507
- 2020Meta Pseudo Labelscited by 372
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2015Highway Networkscited by 257
- 2018Optimal Transport for structured data with application on graphscited by 170
27 more
- 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
- 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
- 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 126
- 2019Gromov-Wasserstein Learning for Graph Matching and Node Embeddingcited by 125
- 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 119
- 2019Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labelscited by 111
- 2019Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphscited by 106
- 2019Dual Student: Breaking the Limits of the Teacher in Semi-supervised Learningcited by 103
- 2020Graph Optimal Transport for Cross-Domain Alignmentcited by 103
- 2019Scalable Gromov-Wasserstein Learning for Graph Partitioning and Matchingcited by 102
- 2019Learning to Exploit Long-term Relational Dependencies in Knowledge Graphscited by 83
- 2019GOT: An Optimal Transport framework for Graph comparisoncited by 64
- 2020Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networkscited by 57
- 2021A Survey on Ensemble Learning under the Era of Deep Learningcited by 47
- 2019Aligning Cross-Lingual Entities with Multi-Aspect Informationcited by 46
- 2020TransEdge: Translating Relation-contextualized Embeddings for Knowledge Graphscited by 41
- 2019Jointly Learning Entity and Relation Representations for Entity Alignmentcited by 39
- 2017Simple and Effective Dimensionality Reduction for Word Embeddingscited by 38
- 2021A Survey on Optimal Transport for Machine Learning: Theory and Applicationscited by 35
- 2022SelfKG: Self-Supervised Entity Alignment in Knowledge Graphscited by 32
- 2019Collective Entity Alignment via Adaptive Featurescited by 30
- 2016Mutual Exclusivity Loss for Semi-Supervised Deep Learningcited by 22
- 2020Relation-Aware Neighborhood Matching Model for Entity Alignmentcited by 20
- 2022Informative Pseudo-Labeling for Graph Neural Networks with Few Labelscited by 19
- 2022LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagationcited by 18
- 2023Robust Attributed Graph Alignment via Joint Structure Learning and Optimal Transportcited by 15
- 2022Conflict-Aware Pseudo Labeling via Optimal Transport for Entity Alignmentcited by 5
Built on by
Citing papers per year: 2024: 2.
2 papers.