CYCLE: Cross-Year Contrastive Learning in Entity-Linking
Not on the map. Why?
Abstract (arXiv)
Knowledge graphs constantly evolve with new entities emerging, existing definitions being revised, and entity relationships changing. These changes lead to temporal degradation in entity linking models, characterized as a decline in model performance over time. To address this issue, we propose leveraging graph relationships to aggregate information from neighboring entities across different time periods. This approach enhances the ability to distinguish similar entities over time, thereby minimizing the impact of temporal degradation. We introduce CYCLE: Cross-Year Contrastive Learning for Entity-Linking. This model employs a novel graph contrastive learning method to tackle temporal performance degradation in entity linking tasks. Our contrastive learning method treats newly added graph relationships as textitpositive samples and newly removed ones as textitnegative samples. This approach helps our model effectively prevent temporal degradation, achieving a 13.90% performance improvement over the state-of-the-art from 2023 when the time gap is one year, and a 17.79% improvement as the gap expands to three years. Further analysis shows that CYCLE is particularly robust for low-degree entities, which are less resistant to temporal degradation due to their sparse connectivity, making them particularly suitable for our method. The code and data are made available at urlhttps://github.com/pengyu-zhang/CYCLE-Cross-Year-Contrastive-Learning-in-Entity-Linking.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
21 of 36 references.
References · 21
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
- 2019Zero-Shot Entity Linking by Reading Entity Descriptionscited by 124
- 2022TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Modelscited by 119
- 2021An Empirical Study of Graph Contrastive Learningcited by 113
- 2022Temporal Knowledge Graph Completion: A Surveycited by 61
- 2020Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linkingcited by 49
- 2021Knowledge-Rich Self-Supervision for Biomedical Entity Linkingcited by 31
- 2023GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Modelscited by 30
- 2022Uncovering the Structural Fairness in Graph Contrastive Learningcited by 29
- 2019Tackling Long-Tailed Relations and Uncommon Entities in Knowledge Graph Completioncited by 19
9 more
- 2021CHOLAN: A Modular Approach for Neural Entity Linking on Wikipedia and Wikidatacited by 14
- 2023TempEL: Linking Dynamically Evolving and Newly Emerging Entitiescited by 14
- 2020Zero-shot Entity Linking with Efficient Long Range Sequence Modelingcited by 13
- 2021Time-aware Path Reasoning on Knowledge Graph for Recommendationcited by 11
- 2023SpEL: Structured Prediction for Entity Linkingcited by 11
- 2022TwiRGCN: Temporally Weighted Graph Convolution for Question Answering over Temporal Knowledge Graphscited by 10
- 2023Rethinking and Simplifying Bootstrapped Graph Latentscited by 10
- 2020End-to-End Entity Linking and Disambiguation leveraging Word and Knowledge Graph Embeddingscited by 2
- 2022Wasserstein Adversarial Learning based Temporal Knowledge Graph Embeddingcited by 2
Built on by
Not cited yet.