mlsanityData to 7 Oct 2026

QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition

arXiv 2203.01543 ↗First posted 3 Mar 2022cs.CL cs.AI cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Recently, prompt-based learning for pre-trained language models has succeeded in few-shot Named Entity Recognition (NER) by exploiting prompts as task guidance to increase label efficiency. However, previous prompt-based methods for few-shot NER have limitations such as a higher computational complexity, poor zero-shot ability, requiring manual prompt engineering, or lack of prompt robustness. In this work, we address these shortcomings by proposing a new prompt-based learning NER method with Question Answering (QA), called QaNER. Our approach includes 1) a refined strategy for converting NER problems into the QA formulation; 2) NER prompt generation for QA models; 3) prompt-based tuning with QA models on a few annotated NER examples; 4) zero-shot NER by prompting the QA model. Comparing the proposed approach with previous methods, QaNER is faster at inference, insensitive to the prompt quality, and robust to hyper-parameters, as well as demonstrating significantly better low-resource performance and zero-shot capability.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 19 of its 25 references that are in the map. First posted on arXiv 3 Mar 2022.

Builds on

19 of 25 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  6. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  7. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  8. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  9. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  10. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  11. 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
  12. 2021True Few-Shot Learning with Language Modelscited by 343
7 more
  1. 2020Revisiting Few-sample BERT Fine-tuningcited by 237
  2. 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
  3. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  4. 2018Ultra-Fine Entity Typingcited by 87
  5. 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
  6. 2018Accelerating Neural Transformer via an Average Attention Networkcited by 22
  7. 2020Example-Based Named Entity Recognitioncited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 9; 2024: 2; 2025: 0; 2026: 1.

15 papers.

Sort:

By area: