Noise-resistant Deep Metric Learning with Ranking-based Instance Selection
Not on the map. Why?
Abstract (arXiv)
The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness to noisy labels in classification tasks, the problem of noisy labels in deep metric learning (DML) remains open. In this paper, we propose a noise-resistant training technique for DML, which we name Probabilistic Ranking-based Instance Selection with Memory (PRISM). PRISM identifies noisy data in a minibatch using average similarity against image features extracted by several previous versions of the neural network. These features are stored in and retrieved from a memory bank. To alleviate the high computational cost brought by the memory bank, we introduce an acceleration method that replaces individual data points with the class centers. In extensive comparisons with 12 existing approaches under both synthetic and real-world label noise, PRISM demonstrates superior performance of up to 6.06% in Precision@1.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 42 of its 59 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
42 of 59 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 663
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 652
- 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 506
- 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
- 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
30 more
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2020A Metric Learning Reality Checkcited by 317
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 305
- 2020Combating noisy labels by agreement: A joint training method with co-regularizationcited by 289
- 2017Sampling Matters in Deep Embedding Learningcited by 285
- 2017No Fuss Distance Metric Learning using Proxiescited by 225
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2018Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarkingcited by 189
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
- 2018Learning to Learn from Noisy Labeled Datacited by 160
- 2019Cross-Batch Memory for Embedding Learningcited by 130
- 2016End-to-end Learning of Deep Visual Representations for Image Retrievalcited by 122
- 2015Learning with Symmetric Label Noise: The Importance of Being Unhingedcited by 120
- 2018Iterative Learning with Open-set Noisy Labelscited by 108
- 2019Meta Label Correction for Noisy Label Learningcited by 108
- 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
- 2020A unifying mutual information view of metric learning: cross-entropy vs. pairwise lossescited by 100
- 2020Smooth-AP: Smoothing the Path Towards Large-Scale Image Retrievalcited by 98
- 2017Smart Mining for Deep Metric Learningcited by 96
- 2019Ranked List Loss for Deep Metric Learningcited by 77
- 2020PyTorch Metric Learningcited by 57
- 2020Fewer is More: A Deep Graph Metric Learning Perspective Using Fewer Proxiescited by 36
- 2017Distance-based Confidence Score for Neural Network Classifierscited by 30
- 2019Distance-Based Learning from Errors for Confidence Calibrationcited by 23
- 2020Meta Soft Label Generation for Noisy Labelscited by 21
- 2019The Group Loss for Deep Metric Learningcited by 20
- 2019Large-scale Landmark Retrieval/Recognition under a Noisy and Diverse Datasetcited by 17
- 2018Deep Metric Learning by Online Soft Mining and Class-Aware Attentioncited by 12
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 6; 2024: 4; 2025: 3; 2026: 1.
23 papers.
Sort:
By area:
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimationcited by 49
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2025Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Datacited by 12
- 2021Learning with Label Noise for Image Retrieval by Selecting Interactionscited by 8
- 2022RankDNN: Learning to Rank for Few-shot Learningcited by 7
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculturecited by 6
- 2023Center Contrastive Loss for Metric Learningcited by 4
- 2022Deep Metric Learning with Chance Constraintscited by 3
- 2023A Survey of Historical Learning: Learning Models with Learning Historycited by 3
- 2022Deep Image Retrieval is not Robust to Label Noisecited by 2
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learningcited by 2
11 more
- 2024Towards certifiable AI in aviation: landscape, challenges, and opportunitiescited by 2
- 2025Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain Generalizationcited by 2
- 2023Robust Calibrate Proxy Loss for Deep Metric Learningcited by 1
- 2023Generalized Sum Pooling for Metric Learningcited by 1
- 2023Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commercecited by 1
- 2024Angel or Devil: Discriminating Hard Samples and Anomaly Contaminations for Unsupervised Time Series Anomaly Detectioncited by 1
- 2025Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selectioncited by 1
- 2021Noise-Resistant Deep Metric Learning with Probabilistic Instance Filteringcited by 0
- 2021LIGAR: Lightweight General-purpose Action Recognitioncited by 0
- 2024Debiased Orthogonal Boundary-Driven Efficient Noise Mitigationcited by 0
- 2026SynMulti: Synthetic-to-Real Learning for Multimodal Video Understandingcited by 0
- 2026SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding14 Apr 2026
- 2025Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain Generalization3 Apr 2025
- 2025Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Data3 Mar 2025
- 2025Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selection19 Jan 2025
- 2024Angel or Devil: Discriminating Hard Samples and Anomaly Contaminations for Unsupervised Time Series Anomaly Detection26 Oct 2024
- 2024Debiased Orthogonal Boundary-Driven Efficient Noise Mitigation2 Oct 2024
- 2024Towards certifiable AI in aviation: landscape, challenges, and opportunities13 Sep 2024
- 2024Towards Graph Contrastive Learning: A Survey and Beyond20 May 2024
- 2023Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commerce29 Nov 2023
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learning1 Nov 2023
- 2023Generalized Sum Pooling for Metric Learning18 Aug 2023
- 2023Center Contrastive Loss for Metric Learning1 Aug 2023
11 more
- 2023Robust Calibrate Proxy Loss for Deep Metric Learning6 Apr 2023
- 2023A Survey of Historical Learning: Learning Models with Learning History23 Mar 2023
- 2022RankDNN: Learning to Rank for Few-shot Learning28 Nov 2022
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculture20 Oct 2022
- 2022Deep Metric Learning with Chance Constraints19 Sep 2022
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimation6 Jun 2022
- 2022Deep Image Retrieval is not Robust to Label Noise23 May 2022
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learning28 Mar 2022
- 2021Learning with Label Noise for Image Retrieval by Selecting Interactions20 Dec 2021
- 2021LIGAR: Lightweight General-purpose Action Recognition30 Aug 2021
- 2021Noise-Resistant Deep Metric Learning with Probabilistic Instance Filtering3 Aug 2021
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimationcited by 49
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2021Learning with Label Noise for Image Retrieval by Selecting Interactionscited by 8
- 2022RankDNN: Learning to Rank for Few-shot Learningcited by 7
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculturecited by 6
- 2023Center Contrastive Loss for Metric Learningcited by 4
- 2022Deep Metric Learning with Chance Constraintscited by 3
- 2023A Survey of Historical Learning: Learning Models with Learning Historycited by 3
- 2022Deep Image Retrieval is not Robust to Label Noisecited by 2
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learningcited by 2
- 2024Towards certifiable AI in aviation: landscape, challenges, and opportunitiescited by 2
12 most cited of 21 All 21 (JSON)
- 2025Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain Generalization3 Apr 2025
- 2025Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selection19 Jan 2025
- 2024Angel or Devil: Discriminating Hard Samples and Anomaly Contaminations for Unsupervised Time Series Anomaly Detection26 Oct 2024
- 2024Debiased Orthogonal Boundary-Driven Efficient Noise Mitigation2 Oct 2024
- 2024Towards certifiable AI in aviation: landscape, challenges, and opportunities13 Sep 2024
- 2024Towards Graph Contrastive Learning: A Survey and Beyond20 May 2024
- 2023Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commerce29 Nov 2023
- 2023ProcSim: Proxy-based Confidence for Robust Similarity Learning1 Nov 2023
- 2023Generalized Sum Pooling for Metric Learning18 Aug 2023
- 2023Center Contrastive Loss for Metric Learning1 Aug 2023
- 2023Robust Calibrate Proxy Loss for Deep Metric Learning6 Apr 2023
- 2023A Survey of Historical Learning: Learning Models with Learning History23 Mar 2023
12 newest of 21 All 21 (JSON)