Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks
Not on the map. Why?
Abstract (arXiv)
Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set samples, primarily due to probable large intra-class differences and small inter-class differences within the task. Recent approaches attempt to incorporate external knowledge or pre-trained language models to augment data, but this requires additional resources and thus does not suit many few-shot scenarios. In this paper, we propose a novel solution to address this issue by adequately leveraging the information within the task itself. Specifically, we utilize label information to construct a task-adaptive metric space, thereby adaptively reducing the intra-class differences and magnifying the inter-class differences. We further employ the optimal transport technique to estimate class prototypes with query set samples together, mitigating the problem of inaccurate and ambiguous support set samples caused by large intra-class differences. We conduct extensive experiments on eight benchmark datasets, and our approach shows obvious advantages over state-of-the-art models across all the tasks on all the datasets. For reproducibility, all the datasets and codes are available at https://github.com/YvoGao/LAQDA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
26 of 37 references.
References · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2015Optimal Transport for Domain Adaptationcited by 463
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
14 more
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2018How to train your MAMLcited by 309
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2019Benchmarking Natural Language Understanding Services for building Conversational Agentscited by 166
- 2019Induction Networks for Few-Shot Text Classificationcited by 64
- 2019Few-shot Text Classification with Distributional Signaturescited by 58
- 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
- 2021Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classificationcited by 18
- 2023ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classificationcited by 17
- 2023Boosting Few-Shot Text Classification via Distribution Estimationcited by 4
- 2022Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classificationcited by 3
- 2023TART: Improved Few-shot Text Classification Using Task-Adaptive Reference Transformationcited by 3
Built on by
Not cited yet.