SpanNER: Named Entity Re-/Recognition as Span Prediction
Not on the map. Why?
Abstract (arXiv)
Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model's architectural bias has not been fully understood. In this paper, we first investigate the strengths and weaknesses when the span prediction model is used for named entity recognition compared with the sequence labeling framework and how to further improve it, which motivates us to make complementary advantages of systems based on different paradigms. We then reveal that span prediction, simultaneously, can serve as a system combiner to re-recognize named entities from different systems' outputs. We experimentally implement 154 systems on 11 datasets, covering three languages, comprehensive results show the effectiveness of span prediction models that both serve as base NER systems and system combiners. We make all code and datasets available: urlhttps://github.com/neulab/spanner, as well as an online system demo: urlhttp://spanner.sh. Our model also has been deployed into the ExplainaBoard platform, which allows users to flexibly perform a system combination of top-scoring systems in an interactive way: urlhttp://explainaboard.nlpedia.ai/leaderboard/task-ner/.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Builds on 28 of its 65 references that are in the map. First posted on arXiv 1 Jun 2021.
Builds on
28 of 65 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2018Deep contextualized word representationscited by 2,285
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
16 more
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2014A Convolutional Neural Network for Modelling Sentencescited by 163
- 2020Named Entity Recognition as Dependency Parsingcited by 150
- 2017A Minimal Span-Based Neural Constituency Parsercited by 59
- 2021ExplainaBoard: An Explainable Leaderboard for NLPcited by 50
- 2020Rethinking Generalization of Neural Models: A Named Entity Recognition Case Studycited by 35
- 2019Hierarchical Contextualized Representation for Named Entity Recognitioncited by 32
- 2020TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognitioncited by 30
- 2020Interpretable Multi-dataset Evaluation for Named Entity Recognitioncited by 27
- 2020Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognitioncited by 23
- 2019Generalizing Natural Language Analysis through Span-relation Representationscited by 22
- 2019Multi-Grained Named Entity Recognitioncited by 19
- 2019GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognitioncited by 18
- 2018Robust Lexical Features for Improved Neural Network Named-Entity Recognitioncited by 12
- 2017Neural System Combination for Machine Translationcited by 6
- 2021Larger-Context Tagging: When and Why Does It Work?cited by 4
Built on by
Citing papers per year: 2021: 4; 2022: 15; 2023: 19; 2024: 9; 2025: 6; 2026: 2.
55 papers.
Sort:
By area:
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2021Mastering the Explicit Opinion-role Interaction: Syntax-aided Neural Transition System for Unified Opinion Role Labelingcited by 25
- 2022Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learningcited by 24
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspectivecited by 17
- 2022Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypescited by 17
- 2022Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognitioncited by 15
- 2025Post-Training Large Language Models via Reinforcement Learning from Self-Feedbackcited by 14
38 more
- 2024Rethinking Negative Instances for Generative Named Entity Recognitioncited by 13
- 2024LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertaintycited by 12
- 2022What do we Really Know about State of the Art NER?cited by 10
- 2025PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER)cited by 10
- 2023Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learningcited by 8
- 2024ToNER: Type-oriented Named Entity Recognition with Generative Language Modelcited by 8
- 2022Zero-shot Triplet Extraction by Template Infillingcited by 7
- 2023E-NER: Evidential Deep Learning for Trustworthy Named Entity Recognitioncited by 7
- 2023A Neural Span-Based Continual Named Entity Recognition Modelcited by 6
- 2023Split-NER: Named Entity Recognition via Two Question-Answering-based Classificationscited by 6
- 2022Span Classification with Structured Information for Disfluency Detection in Spoken Utterancescited by 5
- 2023Less than One-shot: Named Entity Recognition via Extremely Weak Supervisioncited by 4
- 2022REKnow: Enhanced Knowledge for Joint Entity and Relation Extractioncited by 3
- 2022DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognitioncited by 3
- 2023Emotion-Cause Pair Extraction as Question Answeringcited by 3
- 2023Span-based Named Entity Recognition by Generating and Compressing Informationcited by 3
- 2023A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognitioncited by 3
- 2023LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraintscited by 3
- 2024Embedded Named Entity Recognition using Probing Classifierscited by 3
- 2024Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation?cited by 3
- 2024Mitigating Out-of-Entity Errors in Named Entity Recognition: A Sentence-Level Strategycited by 3
- 2022Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognitioncited by 2
- 2022An Empirical Study on Finding Spanscited by 2
- 2023DMNER: Biomedical Entity Recognition by Detection and Matchingcited by 2
- 2024EROS: Entity-Driven Controlled Policy Document Summarizationcited by 2
- 2024Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognitioncited by 2
- 2022OSLAT: Open Set Label Attention Transformer for Medical Entity Retrieval and Span Extractioncited by 1
- 2023Text sampling strategies for predicting missing bibliographic linkscited by 1
- 2023CLaC at SemEval-2023 Task 2: Comparing Span-Prediction and Sequence-Labeling approaches for NERcited by 1
- 2023SHINE: Syntax-augmented Hierarchical Interactive Encoder for Zero-shot Cross-lingual Information Extractioncited by 1
- 2023Comparing and combining some popular NER approaches on Biomedical taskscited by 1
- 2023Span Identification of Epistemic Stance-Taking in Academic Written Englishcited by 1
- 2023Unifying Token and Span Level Supervisions for Few-Shot Sequence Labelingcited by 1
- 2023Filtered Semi-Markov CRFcited by 1
- 2024A Span-based Model for Extracting Overlapping PICO Entities from RCT Publicationscited by 1
- 2022Nested Named Entity Recognition from Medical Texts: An Adaptive Shared Network Architecture with Attentive CRFcited by 0
- 2023NER-to-MRC: Named-Entity Recognition Completely Solving as Machine Reading Comprehensioncited by 0
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understandingcited by 0
50 most cited of 55 All 55 (JSON)
- 2026SmartRAG: Native Graph-Based RAG for Mobile Device16 Jul 2026
- 2026A Mechanism and Optimization Study on the Impact of Information Density on User-Generated Content Named Entity Recognition21 Apr 2026
- 2025Multi-Intent Spoken Language Understanding: Methods, Trends, and Challenges12 Dec 2025
- 2025Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance12 Aug 2025
- 2025Post-Training Large Language Models via Reinforcement Learning from Self-Feedback29 Jul 2025
- 2025CodeNER: Code Prompting for Named Entity Recognition27 Jul 2025
- 2025PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER)30 Jun 2025
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding13 Jan 2025
- 2024Mitigating Out-of-Entity Errors in Named Entity Recognition: A Sentence-Level Strategy11 Dec 2024
- 2024Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation?2 Jul 2024
- 2024Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognition3 Jun 2024
- 2024ToNER: Type-oriented Named Entity Recognition with Generative Language Model14 Apr 2024
38 more
- 2024Embedded Named Entity Recognition using Probing Classifiers18 Mar 2024
- 2024EROS: Entity-Driven Controlled Policy Document Summarization29 Feb 2024
- 2024Rethinking Negative Instances for Generative Named Entity Recognition26 Feb 2024
- 2024LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty16 Feb 2024
- 2024A Span-based Model for Extracting Overlapping PICO Entities from RCT Publications8 Jan 2024
- 2023Filtered Semi-Markov CRF29 Nov 2023
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer14 Nov 2023
- 2023Less than One-shot: Named Entity Recognition via Extremely Weak Supervision6 Nov 2023
- 2023Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications30 Oct 2023
- 2023LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints27 Sep 2023
- 2023Unifying Token and Span Level Supervisions for Few-Shot Sequence Labeling16 Jul 2023
- 2023DMNER: Biomedical Entity Recognition by Detection and Matching27 Jun 2023
- 2023Span Identification of Epistemic Stance-Taking in Academic Written English3 Jun 2023
- 2023Comparing and combining some popular NER approaches on Biomedical tasks30 May 2023
- 2023E-NER: Evidential Deep Learning for Trustworthy Named Entity Recognition29 May 2023
- 2023Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning23 May 2023
- 2023A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition21 May 2023
- 2023SHINE: Syntax-augmented Hierarchical Interactive Encoder for Zero-shot Cross-lingual Information Extraction21 May 2023
- 2023NER-to-MRC: Named-Entity Recognition Completely Solving as Machine Reading Comprehension6 May 2023
- 2023CLaC at SemEval-2023 Task 2: Comparing Span-Prediction and Sequence-Labeling approaches for NER5 May 2023
- 2023A Neural Span-Based Continual Named Entity Recognition Model23 Feb 2023
- 2023Span-based Named Entity Recognition by Generating and Compressing Information10 Feb 2023
- 2023Emotion-Cause Pair Extraction as Question Answering5 Jan 2023
- 2023Text sampling strategies for predicting missing bibliographic links4 Jan 2023
- 2022Zero-shot Triplet Extraction by Template Infilling21 Dec 2022
- 2022DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition15 Nov 2022
- 2022Nested Named Entity Recognition from Medical Texts: An Adaptive Shared Network Architecture with Attentive CRF9 Nov 2022
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Bases24 Oct 2022
- 2022An Empirical Study on Finding Spans13 Oct 2022
- 2022Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning30 Aug 2022
- 2022Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes17 Aug 2022
- 2022Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognition5 Aug 2022
- 2022OSLAT: Open Set Label Attention Transformer for Medical Entity Retrieval and Span Extraction12 Jul 2022
- 2022Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognition7 Jul 2022
- 2022REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction10 Jun 2022
- 2022What do we Really Know about State of the Art NER?29 Apr 2022
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognition12 Apr 2022
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective9 Apr 2022
50 newest of 55 All 55 (JSON)
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
- 2022TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Basescited by 59
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2021Mastering the Explicit Opinion-role Interaction: Syntax-aided Neural Transition System for Unified Opinion Role Labelingcited by 25
- 2022Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learningcited by 24
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspectivecited by 17
- 2022Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypescited by 17
- 2022Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognitioncited by 15
- 2024LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertaintycited by 12
12 most cited of 53 All 53 (JSON)
- 2026SmartRAG: Native Graph-Based RAG for Mobile Device16 Jul 2026
- 2026A Mechanism and Optimization Study on the Impact of Information Density on User-Generated Content Named Entity Recognition21 Apr 2026
- 2025Multi-Intent Spoken Language Understanding: Methods, Trends, and Challenges12 Dec 2025
- 2025Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance12 Aug 2025
- 2025CodeNER: Code Prompting for Named Entity Recognition27 Jul 2025
- 2025PBa-LLM: Privacy- and Bias-aware NLP using Named-Entity Recognition (NER)30 Jun 2025
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding13 Jan 2025
- 2024Mitigating Out-of-Entity Errors in Named Entity Recognition: A Sentence-Level Strategy11 Dec 2024
- 2024Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation?2 Jul 2024
- 2024Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognition3 Jun 2024
- 2024ToNER: Type-oriented Named Entity Recognition with Generative Language Model14 Apr 2024
- 2024Embedded Named Entity Recognition using Probing Classifiers18 Mar 2024
12 newest of 53 All 53 (JSON)