Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Paths
Not on the map. Why?
Abstract (arXiv)
The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of EA methods have primarily focused on the structural modality of KGs, lacking exploration of multi-modal information. A few multi-modal EA methods have made good attempts in this field. Still, they have two shortcomings: (1) inconsistent and inefficient modality modeling that designs complex and distinct models for each modality; (2) ineffective modality fusion due to the heterogeneous nature of modalities in EA. To tackle these challenges, we propose PathFusion, consisting of two main components: (1) MSP, a unified modeling approach that simplifies the alignment process by constructing paths connecting entities and modality nodes to represent multiple modalities; (2) IRF, an iterative fusion method that effectively combines information from different modalities using the path as an information carrier. Experimental results on real-world datasets demonstrate the superiority of PathFusion over state-of-the-art methods, with 22.4%-28.9% absolute improvement on Hits@1, and 0.194-0.245 absolute improvement on MRR.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 56 references that are in the map. First posted on arXiv 9 Oct 2023.
Builds on
36 of 56 references.
References · 36
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
- 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
- 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 127
- 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 120
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2019Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregationcited by 101
- 2020Exploring and Evaluating Attributes, Values, and Structures for Entity Alignmentcited by 63
- 2020Relational Reflection Entity Alignmentcited by 53
24 more
- 2020Visual Pivoting for (Unsupervised) Entity Alignmentcited by 47
- 2020TransEdge: Translating Relation-contextualized Embeddings for Knowledge Graphscited by 41
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 38
- 2021Boosting the Speed of Entity Alignment 10*: Dual Attention Matching Network with Normalized Hard Sample Miningcited by 37
- 2020Semi-supervised Relation Extraction via Incremental Meta Self-Trainingcited by 35
- 2020Knowledge Association with Hyperbolic Knowledge Graph Embeddingscited by 31
- 2019Collective Entity Alignment via Adaptive Featurescited by 30
- 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 30
- 2021LargeEA: Aligning Entities for Large-scale Knowledge Graphscited by 26
- 2021From Alignment to Assignment: Frustratingly Simple Unsupervised Entity Alignmentcited by 26
- 2023Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignmentcited by 24
- 2021Knowing the No-match: Entity Alignment with Dangling Casescited by 20
- 2022ClusterEA: Scalable Entity Alignment with Stochastic Training and Normalized Mini-batch Similaritiescited by 20
- 2023Unsupervised Entity Alignment for Temporal Knowledge Graphscited by 19
- 2023Vision, Deduction and Alignment: An Empirical Study on Multi-modal Knowledge Graph Alignmentcited by 19
- 2022LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagationcited by 18
- 2022Time-aware Graph Neural Networks for Entity Alignment between Temporal Knowledge Graphscited by 16
- 2021Crowdsourcing Learning as Domain Adaptation: A Case Study on Named Entity Recognitioncited by 13
- 2023Quiver: Supporting GPUs for Low-Latency, High-Throughput GNN Serving with Workload Awarenesscited by 11
- 2022A Simple Temporal Information Matching Mechanism for Entity Alignment Between Temporal Knowledge Graphscited by 7
- 2023Pay More Attention to Relation Exploration for Knowledge Base Question Answeringcited by 7
- 2022Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Fieldcited by 4
- 2022DGI: Easy and Efficient Inference for GNNscited by 2
- 2022HyTGraph: GPU-Accelerated Graph Processing with Hybrid Transfer Managementcited by 1
Built on by
Citing papers per year: 2024: 2.
2 papers.