Center Contrastive Loss for Metric Learning
Not on the map. Why?
Abstract (arXiv)
Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In this paper, we propose a novel metric learning function called Center Contrastive Loss, which maintains a class-wise center bank and compares the category centers with the query data points using a contrastive loss. The center bank is updated in real-time to boost model convergence without the need for well-designed sample mining. The category centers are well-optimized classification proxies to re-balance the supervisory signal of each class. Furthermore, the proposed loss combines the advantages of both contrastive and classification methods by reducing intra-class variations and enhancing inter-class differences to improve the discriminative power of embeddings. Our experimental results, as shown in Figure 1, demonstrate that a standard network (ResNet50) trained with our loss achieves state-of-the-art performance and faster convergence.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 64 references that are in the map. First posted on arXiv 1 Aug 2023.
Builds on
46 of 64 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 663
34 more
- 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
- 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2020A Metric Learning Reality Checkcited by 317
- 2016Large-Margin Softmax Loss for Convolutional Neural Networkscited by 296
- 2018Learning Discriminative Features with Multiple Granularities for Person Re-Identificationcited by 290
- 2017Sampling Matters in Deep Embedding Learningcited by 285
- 2018Additive Margin Softmax for Face Verificationcited by 275
- 2017No Fuss Distance Metric Learning using Proxiescited by 225
- 2020Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-IDcited by 212
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
- 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
- 2019Cross-Batch Memory for Embedding Learningcited by 130
- 2018Deep Metric Learning with Hierarchical Triplet Losscited by 112
- 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
- 2020A unifying mutual information view of metric learning: cross-entropy vs. pairwise lossescited by 100
- 2020Revisiting Training Strategies and Generalization Performance in Deep Metric Learningcited by 99
- 2020Smooth-AP: Smoothing the Path Towards Large-Scale Image Retrievalcited by 98
- 2017Smart Mining for Deep Metric Learningcited by 96
- 2021Cluster Contrast for Unsupervised Person Re-Identificationcited by 89
- 2020Hard negative examples are hard, but usefulcited by 82
- 2019Ranked List Loss for Deep Metric Learningcited by 77
- 2019Optimizing Rank-based Metrics with Blackbox Differentiationcited by 58
- 2016Learning Deep Embeddings with Histogram Losscited by 52
- 2021Recall@k Surrogate Loss with Large Batches and Similarity Mixupcited by 49
- 2016Hard-Aware Deeply Cascaded Embeddingcited by 44
- 2020Fewer is More: A Deep Graph Metric Learning Perspective Using Fewer Proxiescited by 36
- 2019Metric Learning With HORDE: High-Order Regularizer for Deep Embeddingscited by 29
- 2019SoDeep: a Sorting Deep net to learn ranking loss surrogatescited by 28
- 2021Noise-resistant Deep Metric Learning with Ranking-based Instance Selectioncited by 23
- 2021It Takes Two to Tango: Mixup for Deep Metric Learningcited by 23
- 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
Built on by
Citing papers per year: 2024: 3; 2025: 0; 2026: 1.
4 papers.
- 2024Cross-Modal Mapping: Mitigating the Modality Gap for Few-Shot Image Classificationcited by 1
- 2024Realigned Softmax Warping for Deep Metric Learningcited by 0
- 2024GLRT-Based Metric Learning for Remote Sensing Object Retrievalcited by 0
- 2026Variance & Greediness: A comparative study of metric-learning lossescited by 0
- 2026Variance & Greediness: A comparative study of metric-learning losses29 Jan 2026
- 2024Cross-Modal Mapping: Mitigating the Modality Gap for Few-Shot Image Classification28 Dec 2024
- 2024GLRT-Based Metric Learning for Remote Sensing Object Retrieval8 Oct 2024
- 2024Realigned Softmax Warping for Deep Metric Learning28 Aug 2024