When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs
Not on the map. Why?
Abstract (arXiv)
Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural triples and cannot fully exploit multimodal signals from new entities. Existing multimodal knowledge graph reasoning (MMKGR) methods, however, usually assume static graphs and suffer catastrophic forgetting as graphs evolve. To address this gap, we present a systematic study of continual multimodal knowledge graph reasoning (CMMKGR). We construct several continual multimodal knowledge graph benchmarks from existing MMKG datasets and propose MRCKG, a new CMMKGR model. Specifically, MRCKG employs a multimodal-structural collaborative curriculum to schedule progressive learning based on the structural connectivity of new triples to the historical graph and their multimodal compatibility. It also introduces a cross-modal knowledge preservation mechanism to mitigate forgetting through entity representation stability, relational semantic consistency, and modality anchoring. In addition, a multimodal contrastive replay scheme with a two-stage optimization strategy reinforces learned knowledge via multimodal importance sampling and representation alignment. Experiments on multiple datasets show that MRCKG preserves previously learned multimodal knowledge while substantially improving the learning of new knowledge.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
25 of 56 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2016Progressive Neural Networkscited by 1,332
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2019MMKG: Multi-Modal Knowledge Graphscited by 104
- 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
- 2019Sentence Embedding Alignment for Lifelong Relation Extractioncited by 70
13 more
- 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 43
- 2022Lifelong Embedding Learning and Transfer for Growing Knowledge Graphscited by 28
- 2023IMF: Interactive Multimodal Fusion Model for Link Predictioncited by 28
- 2020Disentangle-based Continual Graph Representation Learningcited by 25
- 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
- 2024Towards Continual Knowledge Graph Embedding via Incremental Distillationcited by 17
- 2024Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representationcited by 14
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRAcited by 14
- 2025Rethinking Regularization Methods for Knowledge Graph Completioncited by 6
- 2025KGMEL: Knowledge Graph-Enhanced Multimodal Entity Linkingcited by 3
- 2025Learning to Evolve: Bayesian-Guided Continual Knowledge Graph Embeddingcited by 2
- 2025Dark Side of Modalities: Reinforced Multimodal Distillation for Multimodal Knowledge Graph Reasoningcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.