mlsanityData to 14 Oct 2026

Type-Balanced Contextual Learning for Incremental Named Entity Recognition

arXiv 2608.31038 ↗First posted 31 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Incremental Named Entity Recognition (INER) stands as a pivotal task in information extraction, emphasizing the successive identification of new entity types within unstructured text. Faced with the continuous influx of entity types, INER grapples with two significant challenges: the widespread issue of catastrophic forgetting and the unique shift issue of the non-entity type semantics. While pseudo-labeling-based INER methods have proven effective in addressing these challenges, a previously overlooked issue arises: the biased context problem. Our analysis shows that, in new sentences, the contextual associations of tokens representing old entity types exhibit a significantly stronger bias towards new entity types compared to their contexts in old sentences. This tendency intensifies the degradation of old knowledge while promoting the overfitting of new knowledge. To solve this biased context, we propose a Type-Balanced Contextual Learning (TBCL) method, featuring a sentence-duplet learning scheme and a contextual consistency loss. This approach offers a fresh perspective for INER through context analysis. Extensive experiments across ten INER settings on three highly recognized datasets showcase the efficacy of our TBCL method, highlighting its proficiency in resolving the biased context issue inherent in pseudo-labeling based INER approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

33 of 52 references.

References · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  6. 2016Learning without Forgettingcited by 2,496
  7. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  8. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  9. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  10. 2017Continual Learning with Deep Generative Replaycited by 1,158
  11. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  12. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
21 more
  1. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  2. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  3. 2016Neural Architectures for Named Entity Recognitioncited by 550
  4. 2018Progress & Compress: A scalable framework for continual learningcited by 520
  5. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
  6. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  7. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
  8. 2020PLOP: Learning without Forgetting for Continual Semantic Segmentationcited by 177
  9. 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
  10. 2019A continual learning survey: Defying forgetting in classification taskscited by 118
  11. 2017Incremental Learning Through Deep Adaptationcited by 108
  12. 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
  13. 2023Federated Incremental Semantic Segmentationcited by 36
  14. 2021AliCG: Fine-grained and Evolvable Conceptual Graph Construction for Semantic Search at Alibabacited by 33
  15. 2022RBC: Rectifying the Biased Context in Continual Semantic Segmentationcited by 27
  16. 2019Incremental Learning with Maximum Entropy Regularization: Rethinking Forgetting and Intransigencecited by 12
  17. 2023Continual Named Entity Recognition without Catastrophic Forgettingcited by 11
  18. 2022Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognitioncited by 10
  19. 2023Task Relation Distillation and Prototypical Pseudo Label for Incremental Named Entity Recognitioncited by 9
  20. 2022Learning "O" Helps for Learning More: Handling the Concealed Entity Problem for Class-incremental NERcited by 8
  21. 2025Exploring Stability-Plasticity Trade-offs for Continual Named Entity Recognitioncited by 1

Built on by

Not cited yet.