Lifelong Event Detection via Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Continual Event Detection (CED) poses a formidable challenge due to the catastrophic forgetting phenomenon, where learning new tasks (with new coming event types) hampers performance on previous ones. In this paper, we introduce a novel approach, Lifelong Event Detection via Optimal Transport (LEDOT), that leverages optimal transport principles to align the optimization of our classification module with the intrinsic nature of each class, as defined by their pre-trained language modeling. Our method integrates replay sets, prototype latent representations, and an innovative Optimal Transport component. Extensive experiments on MAVEN and ACE datasets demonstrate LEDOT's superior performance, consistently outperforming state-of-the-art baselines. The results underscore LEDOT as a pioneering solution in continual event detection, offering a more effective and nuanced approach to addressing catastrophic forgetting in evolving environments.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
22 of 48 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Experience Replay for Continual Learningcited by 1,074
- 2019Large Scale Incremental Learningcited by 727
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
- 2021Gradient Projection Memory for Continual Learningcited by 338
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2015Learning with a Wasserstein Losscited by 194
10 more
- 2020Using Hindsight to Anchor Past Knowledge in Continual Learningcited by 160
- 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
- 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 103
- 2023Exploring the Feasibility of ChatGPT for Event Extractioncited by 76
- 2020SpaceNet: Make Free Space For Continual Learningcited by 53
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2022Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detectioncited by 23
- 2023Rationale-Enhanced Language Models are Better Continual Relation Learnerscited by 13
- 2023Continual Event Extraction with Semantic Confusion Rectificationcited by 5
- 2024Lifelong Event Detection with Embedding Space Separation and Compactioncited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.