mlsanityData to 14 Oct 2026

LEAF: A Robust Expert-Based Framework for Few-Shot Continual Event Detection

arXiv 2509.24547 ↗First posted 29 Sep 2025cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-shot Continual Event Detection (FCED) poses the dual challenges of learning from limited data and mitigating catastrophic forgetting across sequential tasks. Existing approaches often suffer from severe forgetting due to the full fine-tuning of a shared base model, which leads to knowledge interference between tasks. Moreover, they frequently rely on data augmentation strategies that can introduce unnatural or semantically distorted inputs. To address these limitations, we propose LEAF, a novel and robust expert-based framework for FCED. LEAF integrates a specialized mixture of experts architecture into the base model, where each expert is parameterized with low-rank adaptation (LoRA) matrices. A semantic-aware expert selection mechanism dynamically routes instances to the most relevant experts, enabling expert specialization and reducing knowledge interference. To improve generalization in limited-data settings, LEAF incorporates a contrastive learning objective guided by label descriptions, which capture high-level semantic information about event types. Furthermore, to prevent overfitting on the memory buffer, our framework employs a knowledge distillation strategy that transfers knowledge from previous models to the current one. Extensive experiments on multiple FCED benchmarks demonstrate that LEAF consistently achieves state-of-the-art performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

20 of 35 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2016Learning without Forgettingcited by 2,496
  6. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  7. 2021Learning to Prompt for Continual Learningcited by 944
  8. 2019Large Scale Incremental Learningcited by 732
  9. 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 198
  10. 2024Mixture of LoRA Expertscited by 181
  11. 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
  12. 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 104
8 more
  1. 2023Lifelong Language Pretraining with Distribution-Specialized Expertscited by 66
  2. 2024Mixture of Experts Meets Prompt-Based Continual Learningcited by 43
  3. 2022Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detectioncited by 23
  4. 2022Efficient Zero-shot Event Extraction with Context-Definition Alignmentcited by 11
  5. 2024Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspectivecited by 6
  6. 2024Continual Few-shot Event Detection via Hierarchical Augmentation Networkscited by 3
  7. 2024Lifelong Event Detection via Optimal Transportcited by 2
  8. 2025Adaptive Few-Shot Learning (AFSL): Tackling Data Scarcity with Stability, Robustness, and Versatilitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning
  2. 2026Decomposing and Composing: Towards Efficient Vision-Language Continual Learning via Rank-1 Expert Pool in a Single LoRA
  3. 2024A Unified Framework for Continual Learning and Unlearning
  4. 2026CP-MoE: Consistency-Preserving Mixture-of-Experts for Continual Learning
  5. 2021Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer
  6. 2025Little by Little: Continual Learning via Incremental Mixture of Rank-1 Associative Memory Experts
  7. 2025Harnessing Textual Semantic Priors for Knowledge Transfer and Refinement in CLIP-Driven Continual Learning
  8. 2025LLaVA-CMoE: Towards Continual Mixture of Experts for Large Vision-Language Models