QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Recently, prompt-based learning for pre-trained language models has succeeded in few-shot Named Entity Recognition (NER) by exploiting prompts as task guidance to increase label efficiency. However, previous prompt-based methods for few-shot NER have limitations such as a higher computational complexity, poor zero-shot ability, requiring manual prompt engineering, or lack of prompt robustness. In this work, we address these shortcomings by proposing a new prompt-based learning NER method with Question Answering (QA), called QaNER. Our approach includes 1) a refined strategy for converting NER problems into the QA formulation; 2) NER prompt generation for QA models; 3) prompt-based tuning with QA models on a few annotated NER examples; 4) zero-shot NER by prompting the QA model. Comparing the proposed approach with previous methods, QaNER is faster at inference, insensitive to the prompt quality, and robust to hyper-parameters, as well as demonstrating significantly better low-resource performance and zero-shot capability.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 19 of its 25 references that are in the map. First posted on arXiv 3 Mar 2022.
Builds on
19 of 25 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
- 2021True Few-Shot Learning with Language Modelscited by 343
7 more
- 2020Revisiting Few-sample BERT Fine-tuningcited by 237
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2018Ultra-Fine Entity Typingcited by 87
- 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
- 2018Accelerating Neural Transformer via an Average Attention Networkcited by 22
- 2020Example-Based Named Entity Recognitioncited by 19
Built on by
Citing papers per year: 2022: 3; 2023: 9; 2024: 2; 2025: 0; 2026: 1.
15 papers.
Sort:
By area:
- 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2023PromptNER: Prompt Locating and Typing for Named Entity Recognitioncited by 17
- 2023How far is Language Model from 100% Few-shot Named Entity Recognition in Medical Domaincited by 14
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promisescited by 13
- 2023CoPL: Contextual Prompt Learning for Vision-Language Understandingcited by 9
- 2023Learning In-context Learning for Named Entity Recognitioncited by 7
- 2022Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0cited by 6
- 2024GAMedX: Generative AI-based Medical Entity Data Extractor Using Large Language Modelscited by 5
- 2023ContrastNER: Contrastive-based Prompt Tuning for Few-shot NERcited by 3
- 2022Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labelingcited by 2
- 2023From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contextscited by 2
3 more
- 2023Question-Answering System Extracts Information on Injection Drug Use from Clinical Notescited by 2
- 2024Utilizing Large Language Models for Named Entity Recognition in Traditional Chinese Medicine against COVID-19 Literature: Comparative Studycited by 1
- 2026Automatic Generation of Highlights for Academic Paper Via Prompt-based Learningcited by 0
- 2026Automatic Generation of Highlights for Academic Paper Via Prompt-based Learning24 Jun 2026
- 2024Utilizing Large Language Models for Named Entity Recognition in Traditional Chinese Medicine against COVID-19 Literature: Comparative Study24 Aug 2024
- 2024GAMedX: Generative AI-based Medical Entity Data Extractor Using Large Language Models31 May 2024
- 2023CoPL: Contextual Prompt Learning for Vision-Language Understanding3 Jul 2023
- 2023How far is Language Model from 100% Few-shot Named Entity Recognition in Medical Domain1 Jul 2023
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promises7 Jun 2023
- 2023ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER29 May 2023
- 2023PromptNER: Prompt Locating and Typing for Named Entity Recognition26 May 2023
- 2023Learning In-context Learning for Named Entity Recognition18 May 2023
- 2023Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes15 May 2023
- 2023From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts5 May 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applications28 Apr 2023
- 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2023PromptNER: Prompt Locating and Typing for Named Entity Recognitioncited by 17
- 2023How far is Language Model from 100% Few-shot Named Entity Recognition in Medical Domaincited by 14
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promisescited by 13
- 2023Learning In-context Learning for Named Entity Recognitioncited by 7
- 2022Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0cited by 6
- 2024GAMedX: Generative AI-based Medical Entity Data Extractor Using Large Language Modelscited by 5
- 2023ContrastNER: Contrastive-based Prompt Tuning for Few-shot NERcited by 3
- 2022Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labelingcited by 2
- 2023From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contextscited by 2
- 2023Question-Answering System Extracts Information on Injection Drug Use from Clinical Notescited by 2
12 most cited of 14 All 14 (JSON)
- 2026Automatic Generation of Highlights for Academic Paper Via Prompt-based Learning24 Jun 2026
- 2024Utilizing Large Language Models for Named Entity Recognition in Traditional Chinese Medicine against COVID-19 Literature: Comparative Study24 Aug 2024
- 2024GAMedX: Generative AI-based Medical Entity Data Extractor Using Large Language Models31 May 2024
- 2023How far is Language Model from 100% Few-shot Named Entity Recognition in Medical Domain1 Jul 2023
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promises7 Jun 2023
- 2023ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER29 May 2023
- 2023PromptNER: Prompt Locating and Typing for Named Entity Recognition26 May 2023
- 2023Learning In-context Learning for Named Entity Recognition18 May 2023
- 2023Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes15 May 2023
- 2023From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts5 May 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applications28 Apr 2023
- 2022Query Your Model with Definitions in FrameNet: An Effective Method for Frame Semantic Role Labeling5 Dec 2022
12 newest of 14 All 14 (JSON)