Adaptive Soft Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual samples are treated as independent categories. However, presuming all the samples are different contradicts the natural grouping of similar samples in common visual datasets, e.g., multiple views of the same dog. To bridge the gap, this paper proposes an adaptive method that introduces soft inter-sample relations, namely Adaptive Soft Contrastive Learning (ASCL). More specifically, ASCL transforms the original instance discrimination task into a multi-instance soft discrimination task, and adaptively introduces inter-sample relations. As an effective and concise plug-in module for existing self-supervised learning frameworks, ASCL achieves the best performance on several benchmarks in terms of both performance and efficiency. Code is available at https://github.com/MrChenFeng/ASCL_ICPR2022.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 23 of its 28 references that are in the map. First posted on arXiv 22 Jul 2022.
Builds on
23 of 28 references.
References · 23
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
- 2016Colorful Image Colorizationcited by 1,114
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
- 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
11 more
- 2019Self-labelling via simultaneous clustering and representation learningcited by 528
- 2020Debiased Contrastive Learningcited by 356
- 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 326
- 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 300
- 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
- 2020Boosting Contrastive Self-Supervised Learning with False Negative Cancellationcited by 119
- 2021Contrastive Learning with Stronger Augmentationscited by 100
- 2021ReSSL: Relational Self-Supervised Learning with Weak Augmentationcited by 84
- 2021Mean Shift for Self-Supervised Learningcited by 65
- 2021Incremental False Negative Detection for Contrastive Learningcited by 48
- 2020CO2: Consistent Contrast for Unsupervised Visual Representation Learningcited by 38
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 2; 2026: 1.
13 papers.
Sort:
By area:
- 2023Soft Contrastive Learning for Time Seriescited by 51
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Datasetcited by 21
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Imagecited by 14
- 2024LAFS: Landmark-based Facial Self-supervised Learning for Face Recognitioncited by 13
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolutioncited by 5
- 2023Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Featurescited by 4
- 2024Open-Vocabulary Mobile Manipulation Based on Double Relaxed Contrastive Learning with Dense Labelingcited by 3
- 2024SoftCVI: Contrastive variational inference with self-generated soft labelscited by 1
- 2024Explicit Mutual Information Maximization for Self-Supervised Learningcited by 1
- 2026Deconstructing the Failure of Ideal Noise Correction: A Three-Pillar Diagnosiscited by 1
- 2023MSVQ: Self-Supervised Learning with Multiple Sample Views and Queuescited by 0
- 2026Deconstructing the Failure of Ideal Noise Correction: A Three-Pillar Diagnosis13 Mar 2026
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolution1 Jun 2025
- 2025Predicting butterfly species presence from satellite imagery using soft contrastive regularisation14 May 2025
- 2024Open-Vocabulary Mobile Manipulation Based on Double Relaxed Contrastive Learning with Dense Labeling21 Dec 2024
- 2024Explicit Mutual Information Maximization for Self-Supervised Learning7 Sep 2024
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIP19 Aug 2024
- 2024SoftCVI: Contrastive variational inference with self-generated soft labels22 Jul 2024
- 2024LAFS: Landmark-based Facial Self-supervised Learning for Face Recognition13 Mar 2024
- 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Image10 Jan 2024
- 2023Soft Contrastive Learning for Time Series27 Dec 2023
- 2023Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Features25 Aug 2023
- 2023MSVQ: Self-Supervised Learning with Multiple Sample Views and Queues9 May 2023
1 more
- 2023Soft Contrastive Learning for Time Seriescited by 51
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Datasetcited by 21
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Imagecited by 14
- 2024LAFS: Landmark-based Facial Self-supervised Learning for Face Recognitioncited by 13
- 2023Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Featurescited by 4
- 2024Open-Vocabulary Mobile Manipulation Based on Double Relaxed Contrastive Learning with Dense Labelingcited by 3
- 2024SoftCVI: Contrastive variational inference with self-generated soft labelscited by 1
- 2024Explicit Mutual Information Maximization for Self-Supervised Learningcited by 1
- 2026Deconstructing the Failure of Ideal Noise Correction: A Three-Pillar Diagnosiscited by 1
- 2023MSVQ: Self-Supervised Learning with Multiple Sample Views and Queuescited by 0
- 2025Predicting butterfly species presence from satellite imagery using soft contrastive regularisationcited by 0
- 2026Deconstructing the Failure of Ideal Noise Correction: A Three-Pillar Diagnosis13 Mar 2026
- 2025Predicting butterfly species presence from satellite imagery using soft contrastive regularisation14 May 2025
- 2024Open-Vocabulary Mobile Manipulation Based on Double Relaxed Contrastive Learning with Dense Labeling21 Dec 2024
- 2024Explicit Mutual Information Maximization for Self-Supervised Learning7 Sep 2024
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIP19 Aug 2024
- 2024SoftCVI: Contrastive variational inference with self-generated soft labels22 Jul 2024
- 2024LAFS: Landmark-based Facial Self-supervised Learning for Face Recognition13 Mar 2024
- 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Image10 Jan 2024
- 2023Soft Contrastive Learning for Time Series27 Dec 2023
- 2023Self-Supervised Representation Learning with Cross-Context Learning between Global and Hypercolumn Features25 Aug 2023
- 2023MSVQ: Self-Supervised Learning with Multiple Sample Views and Queues9 May 2023
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Dataset22 Mar 2023