MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid
Not on the map. Why?
Abstract (arXiv)
Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modality fusion strategies for multi-modal entity representation, which ignores the variations of modality preferences of different entities, thus compromising robustness against noise in modalities such as blurry images and relations. This paper introduces MEAformer, a multi-modal entity alignment transformer approach for meta modality hybrid, which dynamically predicts the mutual correlation coefficients among modalities for more fine-grained entity-level modality fusion and alignment. Experimental results demonstrate that our model not only achieves SOTA performance in multiple training scenarios, including supervised, unsupervised, iterative, and low-resource settings, but also has a limited number of parameters, efficient runtime, and interpretability. Our code is available at https://github.com/zjukg/MEAformer.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 36 of its 69 references that are in the map. First posted on arXiv 29 Dec 2022.
Builds on
36 of 69 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2021DeepViT: Towards Deeper Vision Transformercited by 289
- 2017Cross-lingual Entity Alignment via Joint Attribute-Preserving Embeddingcited by 127
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
24 more
- 2019Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphscited by 106
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2019Knowledge Graph Alignment Network with Gated Multi-hop Neighborhood Aggregationcited by 101
- 2019Multi-Channel Graph Neural Network for Entity Alignmentcited by 86
- 2019Multi-view Knowledge Graph Embedding for Entity Alignmentcited by 74
- 2019Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Networkcited by 68
- 2020Exploring and Evaluating Attributes, Values, and Structures for Entity Alignmentcited by 63
- 2021Molecular Contrastive Learning with Chemical Element Knowledge Graphcited by 50
- 2020Visual Pivoting for (Unsupervised) Entity Alignmentcited by 47
- 2019Aligning Cross-Lingual Entities with Multi-Aspect Informationcited by 46
- 2021OntoZSL: Ontology-enhanced Zero-shot Learningcited by 45
- 2020Neighborhood Matching Network for Entity Alignmentcited by 44
- 2020TransEdge: Translating Relation-contextualized Embeddings for Knowledge Graphscited by 41
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 38
- 2021Zero-shot Visual Question Answering using Knowledge Graphcited by 37
- 2021A Benchmark and Comprehensive Survey on Knowledge Graph Entity Alignment via Representation Learningcited by 31
- 2019Collective Entity Alignment via Adaptive Featurescited by 30
- 2021From Alignment to Assignment: Frustratingly Simple Unsupervised Entity Alignmentcited by 26
- 2020Relation-Aware Neighborhood Matching Model for Entity Alignmentcited by 20
- 2022ClusterEA: Scalable Entity Alignment with Stochastic Training and Normalized Mini-batch Similaritiescited by 20
- 2021OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embeddingcited by 19
- 2022LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injectioncited by 18
- 2022Informed Multi-context Entity Alignmentcited by 8
- 2022Entity Alignment with Reliable Path Reasoning and Relation-Aware Heterogeneous Graph Transformercited by 7
Built on by
Citing papers per year: 2023: 11; 2024: 11; 2025: 4; 2026: 4.
30 papers.
Sort:
By area:
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
- 2023Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answeringcited by 29
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 21
- 2024MKGL: Mastery of a Three-Word Languagecited by 17
- 2025PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignmentcited by 10
- 2024AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategiescited by 9
- 2023Revisit and Outstrip Entity Alignment: A Perspective of Generative Modelscited by 8
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignmentcited by 8
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignmentcited by 7
- 2024Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignmentcited by 6
18 more
- 2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
- 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
- 2023Retail-786k: a Large-Scale Dataset for Visual Entity Matchingcited by 2
- 2023Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Pathscited by 2
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignmentcited by 2
- 2024LoginMEA: Local-to-Global Interaction Network for Multi-modal Entity Alignmentcited by 2
- 2024Unifying Dual-Space Embedding for Entity Alignment via Contrastive Learningcited by 2
- 2024Multi-level Matching Network for Multimodal Entity Linkingcited by 2
- 2025K-ON: Stacking Knowledge On the Head Layer of Large Language Modelcited by 2
- 2025Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignmentcited by 2
- 2023MACO: A Modality Adversarial and Contrastive Framework for Modality-missing Multi-modal Knowledge Graph Completioncited by 1
- 2025Mitigating Modality Bias in Multi-modal Entity Alignment from a Causal Perspectivecited by 1
- 2023Type-enhanced Ensemble Triple Representation via Triple-aware Attention for Cross-lingual Entity Alignmentcited by 0
- 2024Unsupervised Robust Cross-Lingual Entity Alignment via Neighbor Triple Matching with Entity and Relation Textscited by 0
- 2026MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignmentcited by 0
- 2026PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignmentcited by 0
- 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignmentcited by 0
- 2026Silence and Noise: Resolving Suppression and Overvaluation in Multimodal Entity Alignmentcited by 0
- 2026Silence and Noise: Resolving Suppression and Overvaluation in Multimodal Entity Alignment12 Oct 2026
- 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignment20 Sep 2026
- 2026PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignment26 Feb 2026
- 2026MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment17 Jan 2026
- 2025Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment21 Oct 2025
- 2025PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignment27 May 2025
- 2025Mitigating Modality Bias in Multi-modal Entity Alignment from a Causal Perspective28 Apr 2025
- 2025K-ON: Stacking Knowledge On the Head Layer of Large Language Model10 Feb 2025
- 2024Multi-level Matching Network for Multimodal Entity Linking11 Dec 2024
- 2024Unifying Dual-Space Embedding for Entity Alignment via Contrastive Learning6 Dec 2024
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment18 Oct 2024
- 2024MKGL: Mastery of a Three-Word Language10 Oct 2024
18 more
- 2024LoginMEA: Local-to-Global Interaction Network for Multi-modal Entity Alignment29 Jul 2024
- 2024Progressively Modality Freezing for Multi-Modal Entity Alignment23 Jul 2024
- 2024Unsupervised Robust Cross-Lingual Entity Alignment via Neighbor Triple Matching with Entity and Relation Texts22 Jul 2024
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment19 Apr 2024
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wild28 Mar 2024
- 2024AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategies22 Mar 2024
- 2024Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignment2 Mar 2024
- 2023Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering11 Nov 2023
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment10 Oct 2023
- 2023Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Paths9 Oct 2023
- 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification8 Oct 2023
- 2023Retail-786k: a Large-Scale Dataset for Visual Entity Matching29 Sep 2023
- 2023MACO: A Modality Adversarial and Contrastive Framework for Modality-missing Multi-modal Knowledge Graph Completion13 Aug 2023
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challenges11 Aug 2023
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignment30 Jul 2023
- 2023Revisit and Outstrip Entity Alignment: A Perspective of Generative Models24 May 2023
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations6 May 2023
- 2023Type-enhanced Ensemble Triple Representation via Triple-aware Attention for Cross-lingual Entity Alignment2 May 2023
- 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 21
- 2024MKGL: Mastery of a Three-Word Languagecited by 17
- 2025PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignmentcited by 10
- 2024AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategiescited by 9
- 2023Revisit and Outstrip Entity Alignment: A Perspective of Generative Modelscited by 8
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignmentcited by 8
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignmentcited by 7
- 2024Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignmentcited by 6
- 2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
- 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
12 most cited of 28 All 28 (JSON)
- 2026Silence and Noise: Resolving Suppression and Overvaluation in Multimodal Entity Alignment12 Oct 2026
- 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignment20 Sep 2026
- 2026PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignment26 Feb 2026
- 2026MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment17 Jan 2026
- 2025Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment21 Oct 2025
- 2025PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignment27 May 2025
- 2025Mitigating Modality Bias in Multi-modal Entity Alignment from a Causal Perspective28 Apr 2025
- 2025K-ON: Stacking Knowledge On the Head Layer of Large Language Model10 Feb 2025
- 2024Multi-level Matching Network for Multimodal Entity Linking11 Dec 2024
- 2024Unifying Dual-Space Embedding for Entity Alignment via Contrastive Learning6 Dec 2024
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment18 Oct 2024
- 2024MKGL: Mastery of a Three-Word Language10 Oct 2024
12 newest of 28 All 28 (JSON)