mlsanityData to 7 Oct 2026

Contrastive Bootstrapping for Label Refinement

arXiv 2306.04544 ↗First posted 7 Jun 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Traditional text classification typically categorizes texts into pre-defined coarse-grained classes, from which the produced models cannot handle the real-world scenario where finer categories emerge periodically for accurate services. In this work, we investigate the setting where fine-grained classification is done only using the annotation of coarse-grained categories and the coarse-to-fine mapping. We propose a lightweight contrastive clustering-based bootstrapping method to iteratively refine the labels of passages. During clustering, it pulls away negative passage-prototype pairs under the guidance of the mapping from both global and local perspectives. Experiments on NYT and 20News show that our method outperforms the state-of-the-art methods by a large margin.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 7 Jun 2023.

Builds on

19 of 28 references.

References · 19

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2020Supervised Contrastive Learningcited by 2,803
  5. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  6. 2017Decoupled Weight Decay Regularizationcited by 1,722
  7. 2017Word Translation Without Parallel Datacited by 480
  8. 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
  9. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  10. 2020Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approachcited by 83
  11. 2021Contrastive Out-of-Distribution Detection for Pretrained Transformerscited by 70
  12. 2018Weakly-Supervised Neural Text Classificationcited by 66
7 more
  1. 2020On Learning Universal Representations Across Languagescited by 58
  2. 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
  3. 2020X-Class: Text Classification with Extremely Weak Supervisioncited by 45
  4. 2021Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classificationcited by 43
  5. 2020Text Classification Using Label Names Only: A Language Model Self-Training Approachcited by 32
  6. 2022Unified Semantic Typing with Meaningful Label Inferencecited by 18
  7. 2021Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Datacited by 13

Built on by

Not cited yet.