mlsanityData to 14 Oct 2026

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

arXiv 2105.03654 ↗First posted 8 May 2021cs.CL cs.AI cs.LGcited by 76

Not on the map. Why?

Abstract (arXiv)

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find external contexts of a sentence by retrieving and selecting a set of semantically relevant texts through a search engine, with the original sentence as the query. We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence. Furthermore, we can improve the model performance of both input views by Cooperative Learning, a training method that encourages the two input views to produce similar contextual representations or output label distributions. Experiments show that our approach can achieve new state-of-the-art performance on 8 NER data sets across 5 domains.

Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 8 May 2021.

Builds on

30 of 59 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  7. 2018Deep contextualized word representationscited by 2,290
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  9. 2016Neural Architectures for Named Entity Recognitioncited by 550
  10. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  11. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  12. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
18 more
  1. 2019Dice Loss for Data-imbalanced NLP Taskscited by 182
  2. 2013A Survey on Multi-view Learningcited by 152
  3. 2020Named Entity Recognition as Dependency Parsingcited by 151
  4. 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
  5. 2018Retrieve and Refine: Improved Sequence Generation Models For Dialoguecited by 82
  6. 2018Semi-Supervised Sequence Modeling with Cross-View Trainingcited by 75
  7. 2018A Retrieve-and-Edit Framework for Predicting Structured Outputscited by 73
  8. 2018Guiding Neural Machine Translation with Retrieved Translation Piecescited by 63
  9. 2019CrossWeigh: Training Named Entity Tagger from Imperfect Annotationscited by 60
  10. 2018Retrieval-Based Neural Code Generationcited by 41
  11. 2019Cloze-driven Pretraining of Self-attention Networkscited by 41
  12. 2020Exploring Cross-sentence Contexts for Named Entity Recognition with BERTcited by 27
  13. 2020Named Entity Recognition for Social Media Texts with Semantic Augmentationcited by 23
  14. 2019Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsingcited by 18
  15. 2020Structure-Level Knowledge Distillation For Multilingual Sequence Labelingcited by 13
  16. 2019BioFLAIR: Pretrained Pooled Contextualized Embeddings for Biomedical Sequence Labeling Taskscited by 11
  17. 2020Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictorcited by 7
  18. 2020More Embeddings, Better Sequence Labelers?cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 6; 2022: 22; 2023: 29; 2024: 13; 2025: 5; 2026: 1.

76 papers.

Sort:

By area:

  1. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
  2. 2024Retrieval-Augmented Generation for Natural Language Processing: A Surveycited by 71
  3. 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
  4. 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commercecited by 49
  5. 2023Universal Information Extraction as Unified Semantic Matchingcited by 48
  6. 2023LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Modelcited by 43
  7. 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
  8. 2025LaRA: Benchmarking Retrieval-Augmented Generation and Long-Context LLMs -- No Silver Bullet for LC or RAG Routingcited by 29
  9. 2022Named Entity and Relation Extraction with Multi-Modal Retrievalcited by 26
  10. 2021ITA: Image-Text Alignments for Multi-Modal Named Entity Recognitioncited by 24
  11. 2022Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learningcited by 24
  12. 2022Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learningcited by 21
38 more
  1. 2022Parallel Instance Query Network for Named Entity Recognitioncited by 19
  2. 2022KPI-BERT: A Joint Named Entity Recognition and Relation Extraction Model for Financial Reportscited by 19
  3. 2022DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognitioncited by 17
  4. 2023FiNER-ORD: Financial Named Entity Recognition Open Research Datasetcited by 17
  5. 2023Adapt in Contexts: Retrieval-Augmented Domain Adaptation via In-Context Learningcited by 16
  6. 2024medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRscited by 16
  7. 2022KnowGL: Knowledge Generation and Linking from Textcited by 13
  8. 2021Context-NER : Contextual Phrase Generation at Scalecited by 11
  9. 2022Domain-Specific NER via Retrieving Correlated Samplescited by 11
  10. 2023Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledgecited by 11
  11. 2024ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questionscited by 10
  12. 2022KPI-EDGAR: A Novel Dataset and Accompanying Metric for Relation Extraction from Financial Documentscited by 9
  13. 2023DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognitioncited by 9
  14. 2021SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluationcited by 8
  15. 2022PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Taskscited by 7
  16. 2023Representation biases in sentence transformerscited by 7
  17. 2023RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extractioncited by 7
  18. 2023Chain-of-Thought Prompt Distillation for Multimodal Named Entity Recognition and Multimodal Relation Extractioncited by 6
  19. 2023Informed Named Entity Recognition Decoding for Generative Language Modelscited by 6
  20. 2023Benchmarking Large Language Models with Augmented Instructions for Fine-grained Information Extractioncited by 6
  21. 2023Split-NER: Named Entity Recognition via Two Question-Answering-based Classificationscited by 6
  22. 2025Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inferencecited by 6
  23. 2022DAMO-NLP at NLPCC-2022 Task 2: Knowledge Enhanced Robust NER for Speech Entity Linkingcited by 5
  24. 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extractioncited by 5
  25. 2023Universal Information Extraction with Meta-Pretrained Self-Retrievalcited by 5
  26. 2023Learning to Rank Context for Named Entity Recognition Using a Synthetic Datasetcited by 5
  27. 2024SCANNER: Knowledge-Enhanced Approach for Robust Multi-modal Named Entity Recognition of Unseen Entitiescited by 5
  28. 2022TURNER: The Uncertainty-based Retrieval Framework for Chinese NERcited by 4
  29. 2023ScrollTimes: Tracing the Provenance of Paintings as a Window into Historycited by 3
  30. 2024VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Modelscited by 3
  31. 2024Embedded Named Entity Recognition using Probing Classifierscited by 3
  32. 2024Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contextscited by 3
  33. 2022Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognitioncited by 2
  34. 2022Recognizing Nested Entities from Flat Supervision: A New NER Subtask, Feasibility and Challengescited by 2
  35. 2022Towards automating Numerical Consistency Checks in Financial Reportscited by 2
  36. 2022From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Readercited by 2
  37. 2023USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NERcited by 2
  38. 2023The Role of Global and Local Context in Named Entity Recognitioncited by 2

50 most cited of 76 All 76 (JSON)