Adaptive Prompt Learning-based Few-Shot Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
In the field of natural language processing, sentiment analysis via deep learning has a excellent performance by using large labeled datasets. Meanwhile, labeled data are insufficient in many sentiment analysis, and obtaining these data is time-consuming and laborious. Prompt learning devotes to resolving the data deficiency by reformulating downstream tasks with the help of prompt. In this way, the appropriate prompt is very important for the performance of the model. This paper proposes an adaptive prompting(AP) construction strategy using seq2seq-attention structure to acquire the semantic information of the input sequence. Then dynamically construct adaptive prompt which can not only improve the quality of the prompt, but also can effectively generalize to other fields by pre-trained prompt which is constructed by existing public labeled data. The experimental results on FewCLUE datasets demonstrate that the proposed method AP can effectively construct appropriate adaptive prompt regardless of the quality of hand-crafted prompt and outperform the state-of-the-art baselines.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 15 May 2022.
Builds on
18 of 45 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019How Can We Know What Language Models Know?cited by 953
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2021GPT Understands, Toocited by 715
- 2014Distributed Representations of Sentences and Documentscited by 677
6 more
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
- 2021Entailment as Few-Shot Learnercited by 122
- 2020ParsBERT: Transformer-based Model for Persian Language Understandingcited by 92
- 2021FewCLUE: A Chinese Few-shot Learning Evaluation Benchmarkcited by 41
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1.
3 papers.