Contrastive Bootstrapping for Label Refinement
Not on the map. Why?
Abstract (arXiv)
Traditional text classification typically categorizes texts into pre-defined coarse-grained classes, from which the produced models cannot handle the real-world scenario where finer categories emerge periodically for accurate services. In this work, we investigate the setting where fine-grained classification is done only using the annotation of coarse-grained categories and the coarse-to-fine mapping. We propose a lightweight contrastive clustering-based bootstrapping method to iteratively refine the labels of passages. During clustering, it pulls away negative passage-prototype pairs under the guidance of the mapping from both global and local perspectives. Experiments on NYT and 20News show that our method outperforms the state-of-the-art methods by a large margin.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 7 Jun 2023.
Builds on
19 of 28 references.
References · 19
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Supervised Contrastive Learningcited by 2,803
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2017Word Translation Without Parallel Datacited by 480
- 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
- 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
- 2020Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approachcited by 83
- 2021Contrastive Out-of-Distribution Detection for Pretrained Transformerscited by 70
- 2018Weakly-Supervised Neural Text Classificationcited by 66
7 more
- 2020On Learning Universal Representations Across Languagescited by 58
- 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
- 2020X-Class: Text Classification with Extremely Weak Supervisioncited by 45
- 2021Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classificationcited by 43
- 2020Text Classification Using Label Names Only: A Language Model Self-Training Approachcited by 32
- 2022Unified Semantic Typing with Meaningful Label Inferencecited by 18
- 2021Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Datacited by 13
Built on by
Not cited yet.