Continual Learning of Knowledge Graph Embeddings
Not on the map. Why?
Abstract (arXiv)
In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown concepts, these representations typically assume that all concepts are known a priori, and incorporating new information requires all concepts to be learned afresh. Our work relaxes this limiting assumption of existing representations and tackles the incremental knowledge graph embedding problem by leveraging the principles of a range of continual learning methods. Through an experimental evaluation with several knowledge graphs and embedding representations, we provide insights about trade-offs for practitioners to match a semantics-driven robotics applications to a suitable continual knowledge graph embedding method.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 14 Jan 2021.
Builds on
20 of 33 references.
References · 20
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Progressive Neural Networkscited by 1,332
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2015Generating Sentences from a Continuous Spacecited by 607
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
- 2015A Review of Relational Machine Learning for Knowledge Graphscited by 264
- 2019Representation Learning for Dynamic Graphs: A Surveycited by 260
- 2018Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselinescited by 228
- 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
- 2018Don't forget, there is more than forgetting: new metrics for Continual Learningcited by 113
8 more
- 2018Generative replay with feedback connections as a general strategy for continual learningcited by 103
- 2017Analogical Inference for Multi-Relational Embeddingscited by 69
- 2017KBGAN: Adversarial Learning for Knowledge Graph Embeddingscited by 62
- 2018Incorporating GAN for Negative Sampling in Knowledge Representation Learningcited by 31
- 2019Efficiently Embedding Dynamic Knowledge Graphscited by 19
- 2014RoboBrain: Large-Scale Knowledge Engine for Robotscited by 13
- 2019RoboCSE: Robot Common Sense Embeddingcited by 9
- 2020A Motion Taxonomy for Manipulation Embeddingcited by 9
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 8; 2024: 11; 2025: 7; 2026: 4.
35 papers.
Sort:
By area:
- 2024InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructionscited by 54
- 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 50
- 2022Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoningcited by 30
- 2022Lifelong Embedding Learning and Transfer for Growing Knowledge Graphscited by 28
- 2024Continual Learning on Graphs: Challenges, Solutions, and Opportunitiescited by 20
- 2024Towards Robust Graph Incremental Learning on Evolving Graphscited by 18
- 2024Towards Continual Knowledge Graph Embedding via Incremental Distillationcited by 17
- 2023ConPET: Continual Parameter-Efficient Tuning for Large Language Modelscited by 16
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRAcited by 14
- 2023Aligning Robot and Human Representationscited by 11
- 2024Continual Learning for Smart City: A Surveycited by 9
23 more
- 2022BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learningcited by 8
- 2023PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensationcited by 8
- 2023On the Limitation and Experience Replay for GNNs in Continual Learningcited by 7
- 2024Towards Continuous Reuse of Graph Models via Holistic Memory Diversificationcited by 7
- 2021Survey on English Entity Linking on Wikidatacited by 6
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Modelcited by 6
- 2024Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robotscited by 6
- 2023History Repeats: Overcoming Catastrophic Forgetting For Event-Centric Temporal Knowledge Graph Completioncited by 5
- 2024NC-NCD: Novel Class Discovery for Node Classificationcited by 4
- 2024Neurosymbolic Methods for Dynamic Knowledge Graphscited by 3
- 2021Wikidated 1.0: An Evolving Knowledge Graph Dataset of Wikidata's Revision Historycited by 2
- 2023Online Continual Learning via the Knowledge Invariant and Spread-out Propertiescited by 1
- 2025Elastic Weight Consolidation for Knowledge Graph Continual Learning: An Empirical Evaluationcited by 1
- 2025Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognitioncited by 0
- 2025When LLMs meet open-world graph learning: a new perspective for unlabeled data uncertaintycited by 0
- 2025Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Samplingcited by 0
- 2025Unlearning of Knowledge Graph Embedding via Preference Optimizationcited by 0
- 2025SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embeddingcited by 0
- 2025From Videos to Indexed Knowledge Graphs -- Framework to Marry Methods for Multimodal Content Analysis and Understandingcited by 0
- 2026CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphscited by 0
- 2026PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphscited by 0
- 2026MA-DAR: Manifold-Aligned Dynamic Adaptive Routing for Continual Temporal Knowledge Graph Reasoningcited by 0
- 2026Matched Excess-Outranker Regularization for Candidate-Set Interference in Continual Knowledge Graph Embeddingcited by 0
- 2026Matched Excess-Outranker Regularization for Candidate-Set Interference in Continual Knowledge Graph Embedding25 Aug 2026
- 2026MA-DAR: Manifold-Aligned Dynamic Adaptive Routing for Continual Temporal Knowledge Graph Reasoning24 Jul 2026
- 2026PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphs11 May 2026
- 2026CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs11 May 2026
- 2025Elastic Weight Consolidation for Knowledge Graph Continual Learning: An Empirical Evaluation1 Dec 2025
- 2025From Videos to Indexed Knowledge Graphs -- Framework to Marry Methods for Multimodal Content Analysis and Understanding1 Oct 2025
- 2025SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding15 Aug 2025
- 2025Unlearning of Knowledge Graph Embedding via Preference Optimization28 Jul 2025
- 2025Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Sampling25 Jul 2025
- 2025When LLMs meet open-world graph learning: a new perspective for unlabeled data uncertainty20 May 2025
- 2025Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognition7 Apr 2025
- 2024Neurosymbolic Methods for Dynamic Knowledge Graphs6 Sep 2024
23 more
- 2024NC-NCD: Novel Class Discovery for Node Classification25 Jul 2024
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRA8 Jul 2024
- 2024Towards Continuous Reuse of Graph Models via Holistic Memory Diversification11 Jun 2024
- 2024Towards Continual Knowledge Graph Embedding via Incremental Distillation7 May 2024
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
- 2024InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions18 Mar 2024
- 2024Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots6 Mar 2024
- 2024Towards Robust Graph Incremental Learning on Evolving Graphs20 Feb 2024
- 2024Continual Learning on Graphs: Challenges, Solutions, and Opportunities18 Feb 2024
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networks24 Jan 2024
- 2023PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensation22 Dec 2023
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model6 Nov 2023
- 2023ConPET: Continual Parameter-Efficient Tuning for Large Language Models26 Sep 2023
- 2023CaT: Balanced Continual Graph Learning with Graph Condensation18 Sep 2023
- 2023History Repeats: Overcoming Catastrophic Forgetting For Event-Centric Temporal Knowledge Graph Completion30 May 2023
- 2023On the Limitation and Experience Replay for GNNs in Continual Learning7 Feb 2023
- 2023Aligning Robot and Human Representations3 Feb 2023
- 2023Online Continual Learning via the Knowledge Invariant and Spread-out Properties2 Feb 2023
- 2022Lifelong Embedding Learning and Transfer for Growing Knowledge Graphs29 Nov 2022
- 2022BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learning26 Nov 2022
- 2022Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning15 Mar 2022
- 2021Wikidated 1.0: An Evolving Knowledge Graph Dataset of Wikidata's Revision History9 Dec 2021
- 2021Survey on English Entity Linking on Wikidata3 Dec 2021
- 2024InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructionscited by 54
- 2023CaT: Balanced Continual Graph Learning with Graph Condensationcited by 50
- 2022Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoningcited by 30
- 2022Lifelong Embedding Learning and Transfer for Growing Knowledge Graphscited by 28
- 2024Continual Learning on Graphs: Challenges, Solutions, and Opportunitiescited by 20
- 2024Towards Robust Graph Incremental Learning on Evolving Graphscited by 18
- 2024Towards Continual Knowledge Graph Embedding via Incremental Distillationcited by 17
- 2023ConPET: Continual Parameter-Efficient Tuning for Large Language Modelscited by 16
- 2024Topology-aware Embedding Memory for Continual Learning on Expanding Networkscited by 14
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRAcited by 14
- 2023Aligning Robot and Human Representationscited by 11
- 2024Continual Learning for Smart City: A Surveycited by 9
12 most cited of 32 All 32 (JSON)
- 2026Matched Excess-Outranker Regularization for Candidate-Set Interference in Continual Knowledge Graph Embedding25 Aug 2026
- 2026MA-DAR: Manifold-Aligned Dynamic Adaptive Routing for Continual Temporal Knowledge Graph Reasoning24 Jul 2026
- 2026PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphs11 May 2026
- 2025Elastic Weight Consolidation for Knowledge Graph Continual Learning: An Empirical Evaluation1 Dec 2025
- 2025From Videos to Indexed Knowledge Graphs -- Framework to Marry Methods for Multimodal Content Analysis and Understanding1 Oct 2025
- 2025SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding15 Aug 2025
- 2025Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Sampling25 Jul 2025
- 2025When LLMs meet open-world graph learning: a new perspective for unlabeled data uncertainty20 May 2025
- 2025Constraint Multi-class Positive and Unlabeled Learning for Distantly Supervised Named Entity Recognition7 Apr 2025
- 2024Neurosymbolic Methods for Dynamic Knowledge Graphs6 Sep 2024
- 2024NC-NCD: Novel Class Discovery for Node Classification25 Jul 2024
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRA8 Jul 2024
12 newest of 32 All 32 (JSON)