mlsanityData to 7 Oct 2026

Multi-Label Image Classification with Contrastive Learning

arXiv 2107.11626 ↗First posted 24 Jul 2021cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to leverage this learning framework to enhance distinctiveness for better performance in multi-label image classification. In this paper, we show that a direct application of contrastive learning can hardly improve in multi-label cases. Accordingly, we propose a novel framework for multi-label classification with contrastive learning in a fully supervised setting, which learns multiple representations of an image under the context of different labels. This facilities a simple yet intuitive adaption of contrastive learning into our model to boost its performance in multi-label image classification. Extensive experiments on two benchmark datasets show that the proposed framework achieves state-of-the-art performance in the comparison with the advanced methods in multi-label classification.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 24 Jul 2021.

Builds on

35 of 49 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  9. 2020Supervised Contrastive Learningcited by 2,803
  10. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  11. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  12. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
23 more
  1. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  3. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  4. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  5. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  6. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  7. 2020Asymmetric Loss For Multi-Label Classificationcited by 379
  8. 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
  9. 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
  10. 2016CNN-RNN: A Unified Framework for Multi-label Image Classificationcited by 189
  11. 2020Adversarial Self-Supervised Contrastive Learningcited by 138
  12. 2019Learning Semantic-Specific Graph Representation for Multi-Label Image Recognitioncited by 116
  13. 2017Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classificationcited by 85
  14. 2017Multi-label Image Recognition by Recurrently Discovering Attentional Regionscited by 83
  15. 2020Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognitioncited by 80
  16. 2019Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classificationcited by 78
  17. 2017Recurrent Attentional Reinforcement Learning for Multi-label Image Recognitioncited by 44
  18. 2018Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detectioncited by 37
  19. 2018Chest X-rays Classification: A Multi-Label and Fine-Grained Problemcited by 31
  20. 2017Order-Free RNN with Visual Attention for Multi-Label Classificationcited by 26
  21. 2016Improving Multi-label Learning with Missing Labels by Structured Semantic Correlationscited by 14
  22. 2016Semantic Regularisation for Recurrent Image Annotationcited by 14
  23. 2015Pinterest Board Recommendation for Twitter Userscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 4; 2024: 2; 2025: 4; 2026: 1.

18 papers.

Sort:

  1. 2021Multi-label Classification with Partial Annotations using Class-aware Selective Losscited by 25
  2. 2023PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classificationcited by 21
  3. 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examplescited by 9
  4. 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
  5. 2023End-to-End Supervised Multilabel Contrastive Learningcited by 8
  6. 2023Semantic-Aware Dual Contrastive Learning for Multi-label Image Classificationcited by 8
  7. 2022Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognitioncited by 6
  8. 2024Multi-Label Contrastive Learning : A Comprehensive Studycited by 3
  9. 2022Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labelscited by 2
  10. 2025Multi-level Supervised Contrastive Learningcited by 1
  11. 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistencycited by 0
  12. 2022Multi-view Contrastive Learning with Additive Margin for Adaptive Nasopharyngeal Carcinoma Radiotherapy Predictioncited by 0
6 more
  1. 2023A Contrastive Learning Scheme with Transformer Innate Patchescited by 0
  2. 2024Computer User Interface Understanding. A New Dataset and a Learning Frameworkcited by 0
  3. 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Datacited by 0
  4. 2025Enhancing Text-Based Hierarchical Multilabel Classification for Mobile Applications via Contrastive Learningcited by 0
  5. 2025Semantic-Aware Representation Learning via Conditional Transport for Multi-Label Image Classificationcited by 0
  6. 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlookcited by 0