Deep k-NN for Noisy Labels
Not on the map. Why?
Abstract (arXiv)
Modern machine learning models are often trained on examples with noisy labels that hurt performance and are hard to identify. In this paper, we provide an empirical study showing that a simple k-nearest neighbor-based filtering approach on the logit layer of a preliminary model can remove mislabeled training data and produce more accurate models than many recently proposed methods. We also provide new statistical guarantees into its efficacy.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 11; 2023: 9; 2024: 8; 2025: 2; 2026: 8.
55 papers.
Sort:
By area:
- 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 151
- 2021Deep Learning Through the Lens of Example Difficultycited by 139
- 2021FINE Samples for Learning with Noisy Labelscited by 82
- 2021Clusterability as an Alternative to Anchor Points When Learning with Noisy Labelscited by 65
- 2021Detecting Corrupted Labels Without Training a Model to Predictcited by 57
- 2022Learning with Neighbor Consistency for Noisy Labelscited by 55
- 2022Identifiability of Label Noise Transition Matrixcited by 34
- 2022Neighborhood Collective Estimation for Noisy Label Identification and Correctioncited by 22
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Modelcited by 21
- 2021Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrectioncited by 20
- 2023CSOT: Curriculum and Structure-Aware Optimal Transport for Learning with Noisy Labelscited by 17
- 2023AQuA: A Benchmarking Tool for Label Quality Assessmentcited by 16
38 more
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2021Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Imagescited by 13
- 2021SSR: An Efficient and Robust Framework for Learning with Unknown Label Noisecited by 13
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 13
- 2023DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modelingcited by 10
- 2022BoMD: Bag of Multi-label Descriptors for Noisy Chest X-ray Classificationcited by 9
- 2023VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language Modelscited by 9
- 2021Locally Adaptive Label Smoothing for Predictive Churncited by 7
- 2022Bootstrapping the Relationship Between Images and Their Clean and Noisy Labelscited by 7
- 2024LEMoN: Label Error Detection using Multimodal Neighborscited by 6
- 2024Integrating kNN with Foundation Models for Adaptable and Privacy-Aware Image Classificationcited by 5
- 2024An Embedding is Worth a Thousand Noisy Labelscited by 5
- 2021ASK: Adversarial Soft k-Nearest Neighbor Attack and Defensecited by 4
- 2023Learning with Noisy Labels through Learnable Weighting and Centroid Similaritycited by 4
- 2024Dirichlet-based Per-Sample Weighting by Transition Matrix for Noisy Label Learningcited by 4
- 2021Multi-Branch Deep Radial Basis Function Networks for Facial Emotion Recognitioncited by 3
- 2023CAPro: Webly Supervised Learning with Cross-Modality Aligned Prototypescited by 3
- 2021Label Smoothed Embedding Hypothesis for Out-of-Distribution Detectioncited by 1
- 2021Active Coveringcited by 1
- 2022Context-based Virtual Adversarial Training for Text Classification with Noisy Labelscited by 1
- 2022New Metric Formulas that Include Measurement Errors in Machine Learning for Natural Sciencescited by 1
- 2022Denoising after Entropy-based Debiasing A Robust Training Method for Dataset Bias with Noisy Labelscited by 1
- 2023CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognitioncited by 1
- 2023Systematic Testing of the Data-Poisoning Robustness of KNNcited by 1
- 2023LaplaceConfidence: a Graph-based Approach for Learning with Noisy Labelscited by 1
- 2024Robust Noisy Label Learning via Two-Stream Sample Distillationcited by 1
- 2024Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoderscited by 1
- 2024Mislabeled examples detection viewed as probing machine learning models: concepts, survey and extensive benchmarkcited by 1
- 2026Model-Agnostic Meta Learning for Class Imbalance Adaptationcited by 1
- 2026An Adaptive Data cleaning Framework for Noisy Label Detectioncited by 1
- 2021INN: A Method Identifying Clean-annotated Samples via Consistency Effect in Deep Neural Networkscited by 0
- 2021kNet: A Deep kNN Network To Handle Label Noisecited by 0
- 2021Deep Adversarially-Enhanced k-Nearest Neighborscited by 0
- 2021Disjoint Contrastive Regression Learning for Multi-Sourced Annotationscited by 0
- 2022Towards Harnessing Feature Embedding for Robust Learning with Noisy Labelscited by 0
- 2025A Prototype-Guided Coarse Annotations Refining Approach for Whole Slide Imagescited by 0
- 2025Detecting and Rectifying Noisy Labels: A Similarity-based Approachcited by 0
- 2026An assessment of data-centric methods for label noise identification in remote sensing data setscited by 0
50 most cited of 55 All 55 (JSON)
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrations8 Aug 2026
- 2026Robust Trajectory Distillation: Hybrid Reweighting Meets Teacher-Inspired Targets29 Jun 2026
- 2026Denoising Implicit Feedback for Cold-start Recommendation17 Jun 2026
- 2026An Adaptive Data cleaning Framework for Noisy Label Detection5 Jun 2026
- 2026Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets28 May 2026
- 2026Leveraging Data Symmetries to Select an Optimal Subset of Training Data under Label Noise3 May 2026
- 2026Model-Agnostic Meta Learning for Class Imbalance Adaptation20 Apr 2026
- 2026An assessment of data-centric methods for label noise identification in remote sensing data sets17 Mar 2026
- 2025Detecting and Rectifying Noisy Labels: A Similarity-based Approach28 Sep 2025
- 2025A Prototype-Guided Coarse Annotations Refining Approach for Whole Slide Images25 Mar 2025
- 2024Mislabeled examples detection viewed as probing machine learning models: concepts, survey and extensive benchmark21 Oct 2024
- 2024An Embedding is Worth a Thousand Noisy Labels26 Aug 2024
38 more
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIP19 Aug 2024
- 2024LEMoN: Label Error Detection using Multimodal Neighbors10 Jul 2024
- 2024Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders6 May 2024
- 2024Robust Noisy Label Learning via Two-Stream Sample Distillation16 Apr 2024
- 2024Dirichlet-based Per-Sample Weighting by Transition Matrix for Noisy Label Learning5 Mar 2024
- 2024Integrating kNN with Foundation Models for Adaptable and Privacy-Aware Image Classification19 Feb 2024
- 2023CSOT: Curriculum and Structure-Aware Optimal Transport for Learning with Noisy Labels11 Dec 2023
- 2023CAPro: Webly Supervised Learning with Cross-Modality Aligned Prototypes15 Oct 2023
- 2023VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language Models28 Sep 2023
- 2023LaplaceConfidence: a Graph-based Approach for Learning with Noisy Labels31 Jul 2023
- 2023Systematic Testing of the Data-Poisoning Robustness of KNN17 Jul 2023
- 2023AQuA: A Benchmarking Tool for Label Quality Assessment15 Jun 2023
- 2023DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling30 May 2023
- 2023CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition24 May 2023
- 2023Learning with Noisy Labels through Learnable Weighting and Centroid Similarity16 Mar 2023
- 2022Denoising after Entropy-based Debiasing A Robust Training Method for Dataset Bias with Noisy Labels1 Dec 2022
- 2022Bootstrapping the Relationship Between Images and Their Clean and Noisy Labels17 Oct 2022
- 2022New Metric Formulas that Include Measurement Errors in Machine Learning for Natural Sciences30 Sep 2022
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledge22 Aug 2022
- 2022Neighborhood Collective Estimation for Noisy Label Identification and Correction5 Aug 2022
- 2022Towards Harnessing Feature Embedding for Robust Learning with Noisy Labels27 Jun 2022
- 2022Context-based Virtual Adversarial Training for Text Classification with Noisy Labels29 May 2022
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Model2 May 2022
- 2022BoMD: Bag of Multi-label Descriptors for Noisy Chest X-ray Classification3 Mar 2022
- 2022Learning with Neighbor Consistency for Noisy Labels4 Feb 2022
- 2022Identifiability of Label Noise Transition Matrix4 Feb 2022
- 2021Disjoint Contrastive Regression Learning for Multi-Sourced Annotations31 Dec 2021
- 2021Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrection29 Nov 2021
- 2021SSR: An Efficient and Robust Framework for Learning with Unknown Label Noise22 Nov 2021
- 2021Detecting Corrupted Labels Without Training a Model to Predict12 Oct 2021
- 2021Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Images22 Sep 2021
- 2021Multi-Branch Deep Radial Basis Function Networks for Facial Emotion Recognition7 Sep 2021
- 2021Deep Adversarially-Enhanced k-Nearest Neighbors15 Aug 2021
- 2021kNet: A Deep kNN Network To Handle Label Noise20 Jul 2021
- 2021INN: A Method Identifying Clean-annotated Samples via Consistency Effect in Deep Neural Networks29 Jun 2021
- 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption29 Jun 2021
- 2021ASK: Adversarial Soft k-Nearest Neighbor Attack and Defense27 Jun 2021
- 2021Deep Learning Through the Lens of Example Difficulty17 Jun 2021
50 newest of 55 All 55 (JSON)
- 2023Systematic Testing of the Data-Poisoning Robustness of KNN17 Jul 2023
- 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 151
- 2021Deep Learning Through the Lens of Example Difficultycited by 139
- 2021FINE Samples for Learning with Noisy Labelscited by 82
- 2021Clusterability as an Alternative to Anchor Points When Learning with Noisy Labelscited by 65
- 2021Detecting Corrupted Labels Without Training a Model to Predictcited by 57
- 2022Learning with Neighbor Consistency for Noisy Labelscited by 55
- 2022Identifiability of Label Noise Transition Matrixcited by 34
- 2022Neighborhood Collective Estimation for Noisy Label Identification and Correctioncited by 22
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Modelcited by 21
- 2021Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrectioncited by 20
- 2023CSOT: Curriculum and Structure-Aware Optimal Transport for Learning with Noisy Labelscited by 17
- 2023AQuA: A Benchmarking Tool for Label Quality Assessmentcited by 16
12 most cited of 51 All 51 (JSON)
- 2026Robust Trajectory Distillation: Hybrid Reweighting Meets Teacher-Inspired Targets29 Jun 2026
- 2026Denoising Implicit Feedback for Cold-start Recommendation17 Jun 2026
- 2026An Adaptive Data cleaning Framework for Noisy Label Detection5 Jun 2026
- 2026Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets28 May 2026
- 2026Leveraging Data Symmetries to Select an Optimal Subset of Training Data under Label Noise3 May 2026
- 2026Model-Agnostic Meta Learning for Class Imbalance Adaptation20 Apr 2026
- 2026An assessment of data-centric methods for label noise identification in remote sensing data sets17 Mar 2026
- 2025Detecting and Rectifying Noisy Labels: A Similarity-based Approach28 Sep 2025
- 2025A Prototype-Guided Coarse Annotations Refining Approach for Whole Slide Images25 Mar 2025
- 2024Mislabeled examples detection viewed as probing machine learning models: concepts, survey and extensive benchmark21 Oct 2024
- 2024An Embedding is Worth a Thousand Noisy Labels26 Aug 2024
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIP19 Aug 2024
12 newest of 51 All 51 (JSON)