Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification
Not on the map. Why?
Abstract (arXiv)
A recent approach for few-shot text classification is to convert textual inputs to cloze questions that contain some form of task description, process them with a pretrained language model and map the predicted words to labels. Manually defining this mapping between words and labels requires both domain expertise and an understanding of the language model's abilities. To mitigate this issue, we devise an approach that automatically finds such a mapping given small amounts of training data. For a number of tasks, the mapping found by our approach performs almost as well as hand-crafted label-to-word mappings.
Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 34; 2023: 32; 2024: 9; 2025: 4; 2026: 1.
98 papers.
Sort:
By area:
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2022Large Language Models Are Reasoning Teacherscited by 318
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021How Many Data Points is a Prompt Worth?cited by 197
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Challenges in Detoxifying Language Modelscited by 169
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
38 more
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
- 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
- 2021Prompt-Learning for Fine-Grained Entity Typingcited by 62
- 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
- 2022BBTv2: Towards a Gradient-Free Future with Large Language Modelscited by 53
- 2022TEMPERA: Test-Time Prompting via Reinforcement Learningcited by 50
- 2022PERFECT: Prompt-free and Efficient Few-shot Learning with Language Modelscited by 40
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
- 2021True Few-Shot Learning with Prompts -- A Real-World Perspectivecited by 38
- 2022Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learningcited by 36
- 2022Dynamic Prefix-Tuning for Generative Template-based Event Extractioncited by 35
- 2022Frustratingly Easy Label Projection for Cross-lingual Transfercited by 33
- 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
- 2021LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Promptingcited by 27
- 2021Avoiding Inference Heuristics in Few-shot Prompt-based Finetuningcited by 23
- 2021Solving Aspect Category Sentiment Analysis as a Text Generation Taskcited by 21
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
- 2022MetaPrompting: Learning to Learn Better Promptscited by 19
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budgetcited by 16
- 2022PromptAttack: Prompt-based Attack for Language Models via Gradient Searchcited by 15
- 2023Effective Structured Prompting by Meta-Learning and Representative Verbalizercited by 14
- 2022Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuningcited by 13
- 2022Generative Prompt Tuning for Relation Classificationcited by 13
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Taskscited by 12
- 2022Prompt-Learning for Short Text Classificationcited by 11
- 2023Hierarchical Verbalizer for Few-Shot Hierarchical Text Classificationcited by 11
- 2023Scalable Prompt Generation for Semi-supervised Learning with Language Modelscited by 10
- 2021Semi-Supervised Exaggeration Detection of Health Science Press Releasescited by 8
- 2022Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classificationcited by 8
- 2022Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Promptscited by 7
- 2023Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understandingcited by 7
- 2023Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Modelscited by 7
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoorscited by 7
- 2022Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizercited by 6
- 2022Decoder Tuning: Efficient Language Understanding as Decodingcited by 6
- 2023PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Trainingcited by 6
50 most cited of 98 All 98 (JSON)
- 2026SCHK-HTC: Sibling Contrastive Learning with Hierarchical Knowledge-Aware Prompt Tuning for Hierarchical Text Classification17 Apr 2026
- 2025Retrieval-augmented Prompt Learning for Pre-trained Foundation Models23 Dec 2025
- 2025Do Generalisation Results Generalise?8 Dec 2025
- 2025Modeling Data Diversity for Joint Instance and Verbalizer Selection in Cold-Start Scenarios1 Jul 2025
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models2 Feb 2025
- 2024Manual Verbalizer Enrichment for Few-Shot Text Classification8 Oct 2024
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks23 Aug 2024
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget31 Jul 2024
- 2024Prompting Encoder Models for Zero-Shot Classification: A Cross-Domain Study in Italian30 Jul 2024
- 2024Graph Structure Prompt Learning: A Novel Methodology to Improve Performance of Graph Neural Networks16 Jul 2024
- 2024Prompt-tuning for Clickbait Detection via Text Summarization17 Apr 2024
- 2024Clinical information extraction for Low-resource languages with Few-shot learning using Pre-trained language models and Prompting20 Mar 2024
38 more
- 2024One size doesn't fit all: Predicting the Number of Examples for In-Context Learning11 Mar 2024
- 2024Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data22 Jan 2024
- 2023Enhancing Low-Resource Relation Representations through Multi-View Decoupling26 Dec 2023
- 2023Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning13 Dec 2023
- 2023Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classification8 Dec 2023
- 2023Simple and Effective Input Reformulations for Translation12 Nov 2023
- 2023ProMap: Effective Bilingual Lexicon Induction via Language Model Prompting28 Oct 2023
- 2023A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models24 Oct 2023
- 2023Label-Aware Automatic Verbalizer for Few-Shot Text Classification19 Oct 2023
- 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding18 Oct 2023
- 2023Prompt Backdoors in Visual Prompt Learning11 Oct 2023
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics9 Oct 2023
- 2023PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models21 Sep 2023
- 2023How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study15 Sep 2023
- 2023Characterizing Latent Perspectives of Media Houses Towards Public Figures12 Sep 2023
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors26 Aug 2023
- 2023Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models18 Aug 2023
- 2023Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction4 Aug 2023
- 2023Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding15 Jul 2023
- 2023Evolutionary Verbalizer Search for Prompt-based Few Shot Text Classification18 Jun 2023
- 2023Politeness Stereotypes and Attack Vectors: Gender Stereotypes in Japanese and Korean Language Models16 Jun 2023
- 2023MetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification15 Jun 2023
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers3 Jun 2023
- 2023Effective Structured Prompting by Meta-Learning and Representative Verbalizer1 Jun 2023
- 2023Exploring Lottery Prompts for Pre-trained Language Models31 May 2023
- 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation26 May 2023
- 2023Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification26 May 2023
- 2023PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training23 May 2023
- 2023Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives14 May 2023
- 2023Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge5 May 2023
- 2023The Benefits of Label-Description Training for Zero-Shot Text Classification3 May 2023
- 2023Rethinking Visual Prompt Learning as Masked Visual Token Modeling9 Mar 2023
- 2023Scalable Prompt Generation for Semi-supervised Learning with Language Models18 Feb 2023
- 2023Distinguishability Calibration to In-Context Learning13 Feb 2023
- 2022Large Language Models Are Reasoning Teachers20 Dec 2022
- 2022Decoder Tuning: Efficient Language Understanding as Decoding16 Dec 2022
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning15 Dec 2022
- 2022Technical Report -- Competition Solution for Prompt Tuning using Pretrained Language Model13 Dec 2022
50 newest of 98 All 98 (JSON)
- 2022Large Language Models Are Reasoning Teacherscited by 318
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Againcited by 83
- 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understandingcited by 4
- 2023Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding18 Oct 2023
- 2022Large Language Models Are Reasoning Teachers20 Dec 2022
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning15 Dec 2022
- 2022Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again16 Mar 2022
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoorscited by 7
- 2023Prompt Backdoors in Visual Prompt Learningcited by 4
- 2023Prompt Backdoors in Visual Prompt Learning11 Oct 2023
- 2023LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors26 Aug 2023
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021How Many Data Points is a Prompt Worth?cited by 197
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Challenges in Detoxifying Language Modelscited by 169
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
12 most cited of 89 All 89 (JSON)
- 2026SCHK-HTC: Sibling Contrastive Learning with Hierarchical Knowledge-Aware Prompt Tuning for Hierarchical Text Classification17 Apr 2026
- 2025Do Generalisation Results Generalise?8 Dec 2025
- 2025Modeling Data Diversity for Joint Instance and Verbalizer Selection in Cold-Start Scenarios1 Jul 2025
- 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models2 Feb 2025
- 2024Manual Verbalizer Enrichment for Few-Shot Text Classification8 Oct 2024
- 2024SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks23 Aug 2024
- 2024ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget31 Jul 2024
- 2024Prompting Encoder Models for Zero-Shot Classification: A Cross-Domain Study in Italian30 Jul 2024
- 2024Graph Structure Prompt Learning: A Novel Methodology to Improve Performance of Graph Neural Networks16 Jul 2024
- 2024Prompt-tuning for Clickbait Detection via Text Summarization17 Apr 2024
- 2024Clinical information extraction for Low-resource languages with Few-shot learning using Pre-trained language models and Prompting20 Mar 2024
- 2024One size doesn't fit all: Predicting the Number of Examples for In-Context Learning11 Mar 2024
12 newest of 89 All 89 (JSON)