Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications
Not on the map. Why?
Abstract (arXiv)
In this work, we address the NER problem by splitting it into two logical sub-tasks: (1) Span Detection which simply extracts entity mention spans irrespective of entity type; (2) Span Classification which classifies the spans into their entity types. Further, we formulate both sub-tasks as question-answering (QA) problems and produce two leaner models which can be optimized separately for each sub-task. Experiments with four cross-domain datasets demonstrate that this two-step approach is both effective and time efficient. Our system, SplitNER outperforms baselines on OntoNotes5.0, WNUT17 and a cybersecurity dataset and gives on-par performance on BioNLP13CG. In all cases, it achieves a significant reduction in training time compared to its QA baseline counterpart. The effectiveness of our system stems from fine-tuning the BERT model twice, separately for span detection and classification. The source code can be found at https://github.com/c3sr/split-ner.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 30 Oct 2023.
Builds on
27 of 40 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
15 more
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2019Dice Loss for Data-imbalanced NLP Taskscited by 180
- 2020Named Entity Recognition as Dependency Parsingcited by 150
- 2021A Unified Generative Framework for Various NER Subtaskscited by 141
- 2020CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characterscited by 87
- 2021Improving Named Entity Recognition by External Context Retrieving and Cooperative Learningcited by 76
- 2021SpanNER: Named Entity Re-/Recognition as Span Predictioncited by 55
- 2020Natural Language Processing Advancements By Deep Learning: A Surveycited by 50
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2020Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognitioncited by 23
- 2019Generalizing Natural Language Analysis through Span-relation Representationscited by 22
- 2021Better Feature Integration for Named Entity Recognitioncited by 22
- 2022Boundary Smoothing for Named Entity Recognitioncited by 21
- 2020FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representationscited by 4
- 2016Entity Identification as Multitaskingcited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 0; 2026: 1.
6 papers.
- 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answeringcited by 9
- 2024Named Entity Recognition Under Domain Shift via Metric Learning for Life Sciencescited by 2
- 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognitioncited by 1
- 2024ELLEN: Extremely Lightly Supervised Learning For Efficient Named Entity Recognitioncited by 0
- 2024Software Mention Recognition with a Three-Stage Framework Based on BERTology Models at SOMD 2024cited by 0
- 2026Decoding Text Spans for Efficient and Accurate Named-Entity Recognitioncited by 0
- 2026Decoding Text Spans for Efficient and Accurate Named-Entity Recognition22 Apr 2026
- 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognition24 Jul 2024
- 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answering15 May 2024
- 2024Software Mention Recognition with a Three-Stage Framework Based on BERTology Models at SOMD 202423 Apr 2024
- 2024ELLEN: Extremely Lightly Supervised Learning For Efficient Named Entity Recognition26 Mar 2024
- 2024Named Entity Recognition Under Domain Shift via Metric Learning for Life Sciences19 Jan 2024