mlsanityData to 7 Oct 2026

Vision, Deduction and Alignment: An Empirical Study on Multi-modal Knowledge Graph Alignment

arXiv 2302.08774 ↗First posted 17 Feb 2023cs.AI cs.MMcited by 19

Not on the map. Why?

Abstract (arXiv)

Entity alignment (EA) for knowledge graphs (KGs) plays a critical role in knowledge engineering. Existing EA methods mostly focus on utilizing the graph structures and entity attributes (including literals), but ignore images that are common in modern multi-modal KGs. In this study we first constructed Multi-OpenEA -- eight large-scale, image-equipped EA benchmarks, and then evaluated some existing embedding-based methods for utilizing images. In view of the complementary nature of visual modal information and logical deduction, we further developed a new multi-modal EA method named LODEME using logical deduction and multi-modal KG embedding, with state-of-the-art performance achieved on Multi-OpenEA and other existing multi-modal EA benchmarks.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 17 Feb 2023.

Builds on

20 of 33 references.

References · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2014Distributed Representations of Sentences and Documentscited by 677
  4. 2019How multilingual is Multilingual BERT?cited by 642
  5. 2017Word Translation Without Parallel Datacited by 480
  6. 2020A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphscited by 119
  7. 2019Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphscited by 106
  8. 2020Exploring and Evaluating Attributes, Values, and Structures for Entity Alignmentcited by 63
  9. 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
  10. 2019Aligning Cross-Lingual Entities with Multi-Aspect Informationcited by 46
  11. 2020Visual Pivoting for (Unsupervised) Entity Alignmentcited by 46
  12. 2019Jointly Learning Entity and Relation Representations for Entity Alignmentcited by 39
8 more
  1. 2022Contrastive Learning with Hard Negative Entities for Entity Set Expansioncited by 26
  2. 2020AliCoCo: Alibaba E-commerce Cognitive Concept Netcited by 23
  3. 2022Automatic Context Pattern Generation for Entity Set Expansioncited by 21
  4. 2021Knowing the No-match: Entity Alignment with Dangling Casescited by 20
  5. 2020An Industry Evaluation of Embedding-based Entity Alignmentcited by 15
  6. 2022Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledgecited by 11
  7. 2022Active Relation Discovery: Towards General and Label-aware Open Relation Extractioncited by 10
  8. 2021Learning Purified Feature Representations from Task-irrelevant Labelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 4; 2025: 5; 2026: 2.

19 papers.

Sort:

By area:

  1. 2023Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characterscited by 21
  2. 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 20
  3. 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budgetcited by 16
  4. 2023MESED: A Multi-modal Entity Set Expansion Dataset with Fine-grained Semantic Classes and Hard Negative Entitiescited by 13
  5. 2023Bidirectional End-to-End Learning of Retriever-Reader Paradigm for Entity Linkingcited by 7
  6. 2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
  7. 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignmentcited by 6
  8. 2024ASGEA: Exploiting Logic Rules from Align-Subgraphs for Entity Alignmentcited by 5
  9. 2025CSPO: Cross-Market Synergistic Stock Price Movement Forecasting with Pseudo-volatility Optimizationcited by 4
  10. 2025From Token to Line: Enhancing Code Generation with a Long-Term Perspectivecited by 4
  11. 2023From Retrieval to Generation: Efficient and Effective Entity Set Expansioncited by 3
  12. 2024Lambda: Learning Matchable Prior For Entity Alignment with Unlabeled Dangling Casescited by 3
7 more
  1. 2025MDIT: A Model-free Data Interpolation Method for Diverse Instruction Tuningcited by 3
  2. 2026TangramPuzzle: Evaluating Multimodal Large Language Models with Compositional Spatial Reasoningcited by 3
  3. 2023Universal Multi-modal Entity Alignment via Iteratively Fusing Modality Similarity Pathscited by 2
  4. 2025Teaching According to Talents! Instruction Tuning LLMs with Competence-Aware Curriculum Learningcited by 2
  5. 2023Investigating Graph Structure Information for Entity Alignment with Dangling Casescited by 1
  6. 2025Corrections Meet Explanations: A Unified Framework for Explainable Grammatical Error Correctioncited by 1
  7. 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignmentcited by 0