Data to 7 Oct 2026

Image-embodied Knowledge Representation Learning

arXiv 1609.07028 ↗First posted 22 Sep 2016cs.CV cs.CLcited by 68

Not on the map. Why?

Abstract (arXiv)

Entity images could provide significant visual information for knowledge representation learning. Most conventional methods learn knowledge representations merely from structured triples, ignoring rich visual information extracted from entity images. In this paper, we propose a novel Image-embodied Knowledge Representation Learning model (IKRL), where knowledge representations are learned with both triple facts and images. More specifically, we first construct representations for all images of an entity with a neural image encoder. These image representations are then integrated into an aggregated image-based representation via an attention-based method. We evaluate our IKRL models on knowledge graph completion and triple classification. Experimental results demonstrate that our models outperform all baselines on both tasks, which indicates the significance of visual information for knowledge representations and the capability of our models in learning knowledge representations with images.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Sep 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 13; 2023: 10; 2024: 15; 2025: 13; 2026: 10.

68 papers.

Sort:

By area:

2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
2021A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutionscited by 77
2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
2021Complex Knowledge Base Question Answering: A Surveycited by 52
2021OntoZSL: Ontology-enhanced Zero-shot Learningcited by 45
2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
2021Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graphcited by 31
2022Relational Message Passing for Fully Inductive Knowledge Graph Completioncited by 29
2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23

38 more

2024Learning on Multimodal Graphs: A Surveycited by 22
2022Multimodal Analogical Reasoning over Knowledge Graphscited by 21
2021Multi-modal Entity Alignment in Hyperbolic Spacecited by 19
2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
2022MoSE: Modality Split and Ensemble for Multimodal Knowledge Graph Completioncited by 14
2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
2022CAKE: A Scalable Commonsense-Aware Framework For Multi-View Knowledge Graph Completioncited by 13
2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
2024Cross-modal Retrieval for Knowledge-based Visual Question Answeringcited by 13
2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13
2024Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completioncited by 10
2023Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoningcited by 8
2022Disconnected Emerging Knowledge Graph Oriented Inductive Link Predictioncited by 7
2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embeddingcited by 7
2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
2025MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generationcited by 6
2023Knowledge Graphs Queryingcited by 5
2023BioBLP: A Modular Framework for Learning on Multimodal Biomedical Knowledge Graphscited by 5
2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
2023End-to-End Learning on Multimodal Knowledge Graphscited by 3
2024Zero-Shot Relational Learning for Multimodal Knowledge Graphscited by 3
2024Any four real numbers are on all fours with analogycited by 2
2024RConE: Rough Cone Embedding for Multi-Hop Logical Query Answering on Multi-Modal Knowledge Graphscited by 2
2024Knowledge Graph Embeddings: A Comprehensive Survey on Capturing Relation Propertiescited by 2
2025K-ON: Stacking Knowledge On the Head Layer of Large Language Modelcited by 2
2026VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddingscited by 2
2021An Adversarial Transfer Network for Knowledge Representation Learningcited by 1
2021Multimodal Entity Tagging with Multimodal Knowledge Basecited by 1
2022Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Informationcited by 1
2023IMKGA-SM: Interpretable Multimodal Knowledge Graph Answer Prediction via Sequence Modelingcited by 1
2023MACO: A Modality Adversarial and Contrastive Framework for Modality-missing Multi-modal Knowledge Graph Completioncited by 1
2024Contrast then Memorize: Semantic Neighbor Retrieval-Enhanced Inductive Multimodal Knowledge Graph Completioncited by 1
2025Diffusion-based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completioncited by 1
2025Transformer-Based Multimodal Knowledge Graph Completion with Link-Aware Contextscited by 1
2025COSINT-Agent: A Knowledge-Driven Multimodal Agent for Chinese Open Source Intelligencecited by 1
2025DiffusionCom: Structure-Aware Multimodal Diffusion Model for Multimodal Knowledge Graph Completioncited by 1
2025Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methodscited by 1
2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completioncited by 1

50 most cited of 68 All 68 (JSON)