MetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification
Not on the map. Why?
Abstract (arXiv)
Prompting methods have shown impressive performance in a variety of text mining tasks and applications, especially few-shot ones. Despite the promising prospects, the performance of prompting model largely depends on the design of prompt template and verbalizer. In this work, we propose MetricPrompt, which eases verbalizer design difficulty by reformulating few-shot text classification task into text pair relevance estimation task. MetricPrompt adopts prompting model as the relevance metric, further bridging the gap between Pre-trained Language Model's (PLM) pre-training objective and text classification task, making possible PLM's smooth adaption. Taking a training sample and a query one simultaneously, MetricPrompt captures cross-sample relevance information for accurate relevance estimation. We conduct experiments on three widely used text classification datasets across four few-shot settings. Results show that MetricPrompt outperforms manual verbalizer and other automatic verbalizer design methods across all few-shot settings, achieving new state-of-the-art (SOTA) performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 15 Jun 2023.
Builds on
26 of 44 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2021GPT Understands, Toocited by 715
14 more
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2021WARP: Word-level Adversarial ReProgrammingcited by 220
- 2019oLMpics -- On what Language Model Pre-training Capturescited by 161
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2020Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classificationcited by 98
- 2021Improving and Simplifying Pattern Exploiting Trainingcited by 97
- 2019Zero-shot Text Classification With Generative Language Modelscited by 55
- 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
- 2016Improving Multi-Document Summarization via Text Classificationcited by 14
- 2022Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corporacited by 13
- 2022Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Taggingcited by 5
Built on by
Not cited yet.