MMKG: Multi-Modal Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity matching communities can benefit from this resource. We believe this data set has the potential to facilitate the development of novel multi-modal learning approaches for knowledge graphs.We validate the utility ofMMKG in the sameAs link prediction task with an extensive set of experiments. These experiments show that the task at hand benefits from learning of multiple feature types.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 14; 2023: 15; 2024: 24; 2025: 24; 2026: 23.
104 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
- 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 37
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmarkcited by 30
- 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 29
38 more
- 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
- 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 28
- 2023Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignmentcited by 23
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistencycited by 22
- 2022Multimodal Analogical Reasoning over Knowledge Graphscited by 21
- 2023Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignmentcited by 20
- 2021Multi-modal Entity Alignment in Hyperbolic Spacecited by 19
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2023Representation Learning on Hyper-Relational and Numeric Knowledge Graphs with Transformerscited by 16
- 2025MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphscited by 16
- 2023Continual Multimodal Knowledge Graph Constructioncited by 15
- 2022Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggingcited by 14
- 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
- 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
- 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
- 2024Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learningcited by 13
- 2024Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completioncited by 10
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQAcited by 10
- 2021Applications of knowledge graphs for food science and industrycited by 8
- 2022Kuaipedia: a Large-scale Multi-modal Short-video Encyclopediacited by 8
- 2022Augmenting Knowledge Graphs for Better Link Predictioncited by 7
- 2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embeddingcited by 7
- 2024Noise-powered Multi-modal Knowledge Graph Representation Frameworkcited by 7
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignmentcited by 6
- 2024Pseudo-Label Calibration Semi-supervised Multi-Modal Entity Alignmentcited by 6
- 2025MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generationcited by 6
- 2022A Unified Continuous Learning Framework for Multi-modal Knowledge Discovery and Pre-trainingcited by 5
- 2023AspectMMKG: A Multi-modal Knowledge Graph with Aspect-aware Entitiescited by 5
- 2023Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Promptingcited by 5
- 2024ASGEA: Exploiting Logic Rules from Align-Subgraphs for Entity Alignmentcited by 5
- 2024VCD: A Dataset for Visual Commonsense Discovery in Imagescited by 5
- 2024Progressively Modality Freezing for Multi-Modal Entity Alignmentcited by 5
- 2021Node Classification Meets Link Prediction on Knowledge Graphscited by 3
- 2022Expanding Knowledge Graphs with Humans in the Loopcited by 3
- 2024Zero-Shot Relational Learning for Multimodal Knowledge Graphscited by 3
50 most cited of 104 All 104 (JSON)
- 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignment20 Sep 2026
- 2026More Perspectives, Stronger Signals: Multi-Perspective Enhancement and Progressive Fusion for Multimodal Entity Representation Learning29 Aug 2026
- 2026Neural Regression with Embeddings for Numerical Attribute Prediction in Knowledge Graphs27 Aug 2026
- 2026Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs26 Aug 2026
- 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answering4 Aug 2026
- 2026MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion17 Jul 2026
- 2026Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs8 Jul 2026
- 2026Multimodal Graph RAG for Long-range Visually Rich Document Understanding27 Jun 2026
- 2026MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation24 Jun 2026
- 2026Uncovering Entity Identity Confusion in Multimodal Knowledge Editing7 May 2026
- 2026RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion28 Apr 2026
- 2026SAKE: Self-aware Knowledge Exploitation-Exploration for Grounded Multimodal Named Entity Recognition22 Apr 2026
38 more
- 2026E2E-GMNER: End-to-End Generative Grounded Multimodal Named Entity Recognition19 Apr 2026
- 2026MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation4 Apr 2026
- 2026When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs3 Apr 2026
- 2026A Proposal-Free Query-Guided Network for Grounded Multimodal Named Entity Recognition18 Mar 2026
- 2026Are a Thousand Words Better Than a Single Picture? Beyond Images -- A Framework for Multi-Modal Knowledge Graph Dataset Enrichment17 Mar 2026
- 2026VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddings2 Mar 2026
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning1 Mar 2026
- 2026Tokenization, Fusion and Decoupling: Bridging the Granularity Mismatch Between Large Language Models and Knowledge Graphs26 Feb 2026
- 2026Every Little Helps: Building Knowledge Graph Foundation Model with Fine-grained Transferable Multi-modal Tokens11 Feb 2026
- 2026MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment17 Jan 2026
- 2026KG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answering14 Jan 2026
- 2025VisKnow: Constructing Visual Knowledge Base for Object Understanding9 Dec 2025
- 2025MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generation26 Nov 2025
- 2025Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment21 Oct 2025
- 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completion19 Oct 2025
- 2025Graph Integrated Multimodal Concept Bottleneck Model1 Oct 2025
- 2025Collaboration of Fusion and Independence: Hypercomplex-driven Robust Multi-Modal Knowledge Graph Completion28 Sep 2025
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessment25 Sep 2025
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQA7 Aug 2025
- 2025GeoOutageKG: A Multimodal Geospatiotemporal Knowledge Graph for Multiresolution Power Outage Analysis30 Jul 2025
- 2025MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphs28 Jul 2025
- 2025Complementarity-driven Representation Learning for Multi-modal Knowledge Graph Completion28 Jul 2025
- 2025Enhancing Food-Domain Question Answering with a Multimodal Knowledge Graph: Hybrid QA Generation and Diversity Analysis9 Jul 2025
- 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion27 Jun 2025
- 2025VAT-KG: Knowledge-Intensive Multimodal Knowledge Graph Dataset for Retrieval-Augmented Generation11 Jun 2025
- 2025Abstractive Visual Understanding of Multi-modal Structured Knowledge: A New Perspective for MLLM Evaluation2 Jun 2025
- 2025HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs1 Jun 2025
- 2025MEDMKG: Benchmarking Medical Knowledge Exploitation with Multimodal Knowledge Graph22 May 2025
- 2025Mitigating Modality Bias in Multi-modal Entity Alignment from a Causal Perspective28 Apr 2025
- 2025Multi-modal Knowledge Graph Generation with Semantics-enriched Prompts18 Apr 2025
- 2025ReaLitE: Enrichment of Relation Embeddings in Knowledge Graphs using Numeric Literals1 Apr 2025
- 2025Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learning24 Mar 2025
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoning17 Mar 2025
- 2025K-ON: Stacking Knowledge On the Head Layer of Large Language Model10 Feb 2025
- 2025Diffusion-based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completion26 Jan 2025
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts23 Nov 2024
- 2024UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Prediction11 Nov 2024
- 2024Deep Multimodal Learning with Missing Modality: A Survey12 Sep 2024
50 newest of 104 All 104 (JSON)
- 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmarkcited by 30
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistencycited by 22
- 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQAcited by 10
- 2025Abstractive Visual Understanding of Multi-modal Structured Knowledge: A New Perspective for MLLM Evaluationcited by 3
- 2026VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddingscited by 2
- 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completioncited by 1
- 2026KG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answeringcited by 1
- 2026MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generationcited by 1
- 2024Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Modelscited by 0
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessmentcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs26 Aug 2026
- 2026Multimodal Graph RAG for Long-range Visually Rich Document Understanding27 Jun 2026
- 2026Uncovering Entity Identity Confusion in Multimodal Knowledge Editing7 May 2026
- 2026MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation4 Apr 2026
- 2026VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddings2 Mar 2026
- 2026KG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answering14 Jan 2026
- 2025ELMM: Efficient Lightweight Multimodal Large Language Models for Multimodal Knowledge Graph Completion19 Oct 2025
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessment25 Sep 2025
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQA7 Aug 2025
- 2025Abstractive Visual Understanding of Multi-modal Structured Knowledge: A New Perspective for MLLM Evaluation2 Jun 2025
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts23 Nov 2024
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun 2024
12 newest of 15 All 15 (JSON)
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
- 2022Multimodal Analogical Reasoning over Knowledge Graphscited by 21
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
- 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoningcited by 13
- 2025VAT-KG: Knowledge-Intensive Multimodal Knowledge Graph Dataset for Retrieval-Augmented Generationcited by 2
- 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completioncited by 1
- 2025Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion27 Jun 2025
- 2025VAT-KG: Knowledge-Intensive Multimodal Knowledge Graph Dataset for Retrieval-Augmented Generation11 Jun 2025
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoning17 Mar 2025
- 2024Multimodal Reasoning with Multimodal Knowledge Graph4 Jun 2024
- 2023Knowledge Editing for Large Language Models: A Survey24 Oct 2023
- 2022Multimodal Analogical Reasoning over Knowledge Graphs1 Oct 2022
- 2022MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoning3 Sep 2022
- 2025Graph Integrated Multimodal Concept Bottleneck Modelcited by 1
- 2025Graph Integrated Multimodal Concept Bottleneck Model1 Oct 2025
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
- 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
- 2022Multi-modal Contrastive Representation Learning for Entity Alignmentcited by 37
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2022MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybridcited by 29
- 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
- 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 28
- 2023Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignmentcited by 23
12 most cited of 77 All 77 (JSON)
- 2026Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignment20 Sep 2026
- 2026More Perspectives, Stronger Signals: Multi-Perspective Enhancement and Progressive Fusion for Multimodal Entity Representation Learning29 Aug 2026
- 2026Neural Regression with Embeddings for Numerical Attribute Prediction in Knowledge Graphs27 Aug 2026
- 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answering4 Aug 2026
- 2026Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs8 Jul 2026
- 2026SAKE: Self-aware Knowledge Exploitation-Exploration for Grounded Multimodal Named Entity Recognition22 Apr 2026
- 2026E2E-GMNER: End-to-End Generative Grounded Multimodal Named Entity Recognition19 Apr 2026
- 2026When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs3 Apr 2026
- 2026A Proposal-Free Query-Guided Network for Grounded Multimodal Named Entity Recognition18 Mar 2026
- 2026Are a Thousand Words Better Than a Single Picture? Beyond Images -- A Framework for Multi-Modal Knowledge Graph Dataset Enrichment17 Mar 2026
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning1 Mar 2026
- 2026Tokenization, Fusion and Decoupling: Bridging the Granularity Mismatch Between Large Language Models and Knowledge Graphs26 Feb 2026
12 newest of 77 All 77 (JSON)