Multi-Label Image Classification with Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to leverage this learning framework to enhance distinctiveness for better performance in multi-label image classification. In this paper, we show that a direct application of contrastive learning can hardly improve in multi-label cases. Accordingly, we propose a novel framework for multi-label classification with contrastive learning in a fully supervised setting, which learns multiple representations of an image under the context of different labels. This facilities a simple yet intuitive adaption of contrastive learning into our model to boost its performance in multi-label image classification. Extensive experiments on two benchmark datasets show that the proposed framework achieves state-of-the-art performance in the comparison with the advanced methods in multi-label classification.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 24 Jul 2021.
Builds on
35 of 49 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Supervised Contrastive Learningcited by 2,803
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
23 more
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020Asymmetric Loss For Multi-Label Classificationcited by 379
- 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 320
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2016CNN-RNN: A Unified Framework for Multi-label Image Classificationcited by 189
- 2020Adversarial Self-Supervised Contrastive Learningcited by 138
- 2019Learning Semantic-Specific Graph Representation for Multi-Label Image Recognitioncited by 116
- 2017Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classificationcited by 85
- 2017Multi-label Image Recognition by Recurrently Discovering Attentional Regionscited by 83
- 2020Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognitioncited by 80
- 2019Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classificationcited by 78
- 2017Recurrent Attentional Reinforcement Learning for Multi-label Image Recognitioncited by 44
- 2018Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detectioncited by 37
- 2018Chest X-rays Classification: A Multi-Label and Fine-Grained Problemcited by 31
- 2017Order-Free RNN with Visual Attention for Multi-Label Classificationcited by 26
- 2016Improving Multi-label Learning with Missing Labels by Structured Semantic Correlationscited by 14
- 2016Semantic Regularisation for Recurrent Image Annotationcited by 14
- 2015Pinterest Board Recommendation for Twitter Userscited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 4; 2024: 2; 2025: 4; 2026: 1.
18 papers.
Sort:
- 2021Multi-label Classification with Partial Annotations using Class-aware Selective Losscited by 25
- 2023PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classificationcited by 21
- 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examplescited by 9
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
- 2023End-to-End Supervised Multilabel Contrastive Learningcited by 8
- 2023Semantic-Aware Dual Contrastive Learning for Multi-label Image Classificationcited by 8
- 2022Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognitioncited by 6
- 2024Multi-Label Contrastive Learning : A Comprehensive Studycited by 3
- 2022Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labelscited by 2
- 2025Multi-level Supervised Contrastive Learningcited by 1
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistencycited by 0
- 2022Multi-view Contrastive Learning with Additive Margin for Adaptive Nasopharyngeal Carcinoma Radiotherapy Predictioncited by 0
6 more
- 2023A Contrastive Learning Scheme with Transformer Innate Patchescited by 0
- 2024Computer User Interface Understanding. A New Dataset and a Learning Frameworkcited by 0
- 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Datacited by 0
- 2025Enhancing Text-Based Hierarchical Multilabel Classification for Mobile Applications via Contrastive Learningcited by 0
- 2025Semantic-Aware Representation Learning via Conditional Transport for Multi-Label Image Classificationcited by 0
- 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlookcited by 0
- 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook1 Jul 2026
- 2025Semantic-Aware Representation Learning via Conditional Transport for Multi-Label Image Classification20 Jul 2025
- 2025Enhancing Text-Based Hierarchical Multilabel Classification for Mobile Applications via Contrastive Learning6 Jul 2025
- 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Data6 Jun 2025
- 2025Multi-level Supervised Contrastive Learning4 Feb 2025
- 2024Multi-Label Contrastive Learning : A Comprehensive Study27 Nov 2024
- 2024Computer User Interface Understanding. A New Dataset and a Learning Framework15 Mar 2024
- 2023Semantic-Aware Dual Contrastive Learning for Multi-label Image Classification19 Jul 2023
- 2023PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classification18 Jul 2023
- 2023End-to-End Supervised Multilabel Contrastive Learning8 Jul 2023
- 2023A Contrastive Learning Scheme with Transformer Innate Patches26 Mar 2023
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classification1 Dec 2022
6 more
- 2022Multi-view Contrastive Learning with Additive Margin for Adaptive Nasopharyngeal Carcinoma Radiotherapy Prediction27 Oct 2022
- 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examples3 Oct 2022
- 2022Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labels3 Sep 2022
- 2022Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognition15 Aug 2022
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistency11 Jul 2022
- 2021Multi-label Classification with Partial Annotations using Class-aware Selective Loss21 Oct 2021
- 2021Multi-label Classification with Partial Annotations using Class-aware Selective Losscited by 25
- 2023PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classificationcited by 21
- 2022MultiGuard: Provably Robust Multi-label Classification against Adversarial Examplescited by 9
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
- 2023End-to-End Supervised Multilabel Contrastive Learningcited by 8
- 2023Semantic-Aware Dual Contrastive Learning for Multi-label Image Classificationcited by 8
- 2022Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognitioncited by 6
- 2024Multi-Label Contrastive Learning : A Comprehensive Studycited by 3
- 2022Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labelscited by 2
- 2025Multi-level Supervised Contrastive Learningcited by 1
- 2022Towards Effective Multi-Label Recognition Attacks via Knowledge Graph Consistencycited by 0
- 2022Multi-view Contrastive Learning with Additive Margin for Adaptive Nasopharyngeal Carcinoma Radiotherapy Predictioncited by 0
12 most cited of 18 All 18 (JSON)
- 2026Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook1 Jul 2026
- 2025Semantic-Aware Representation Learning via Conditional Transport for Multi-Label Image Classification20 Jul 2025
- 2025Enhancing Text-Based Hierarchical Multilabel Classification for Mobile Applications via Contrastive Learning6 Jul 2025
- 2025Any-Class Presence Likelihood for Robust Multi-Label Classification with Abundant Negative Data6 Jun 2025
- 2025Multi-level Supervised Contrastive Learning4 Feb 2025
- 2024Multi-Label Contrastive Learning : A Comprehensive Study27 Nov 2024
- 2024Computer User Interface Understanding. A New Dataset and a Learning Framework15 Mar 2024
- 2023Semantic-Aware Dual Contrastive Learning for Multi-label Image Classification19 Jul 2023
- 2023PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classification18 Jul 2023
- 2023End-to-End Supervised Multilabel Contrastive Learning8 Jul 2023
- 2023A Contrastive Learning Scheme with Transformer Innate Patches26 Mar 2023
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classification1 Dec 2022
12 newest of 18 All 18 (JSON)