Confidence Scores Make Instance-dependent Label-noise Learning Possible
Not on the map. Why?
Abstract (arXiv)
In learning with noisy labels, for every instance, its label can randomly walk to other classes following a transition distribution which is named a noise model. Well-studied noise models are all instance-independent, namely, the transition depends only on the original label but not the instance itself, and thus they are less practical in the wild. Fortunately, methods based on instance-dependent noise have been studied, but most of them have to rely on strong assumptions on the noise models. To alleviate this issue, we introduce confidence-scored instance-dependent noise (CSIDN), where each instance-label pair is equipped with a confidence score. We find with the help of confidence scores, the transition distribution of each instance can be approximately estimated. Similarly to the powerful forward correction for instance-independent noise, we propose a novel instance-level forward correction for CSIDN. We demonstrate the utility and effectiveness of our method through multiple experiments under synthetic label noise and real-world unknown noise.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 12; 2024: 13; 2025: 7; 2026: 6.
63 papers.
Sort:
By area:
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
- 2021Provably End-to-end Label-Noise Learning without Anchor Pointscited by 97
- 2021To Smooth or Not? When Label Smoothing Meets Noisy Labelscited by 70
- 2021Clusterability as an Alternative to Anchor Points When Learning with Noisy Labelscited by 65
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Instance-dependent Label-noise Learning under a Structural Causal Modelcited by 50
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimationcited by 49
- 2023When Source-Free Domain Adaptation Meets Learning with Noisy Labelscited by 46
- 2022Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shiftcited by 38
- 2022Identifiability of Label Noise Transition Matrixcited by 34
- 2021Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural Networkcited by 30
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Modelcited by 21
38 more
- 2021Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrectioncited by 20
- 2023Label-Retrieval-Augmented Diffusion Models for Learning from Noisy Labelscited by 20
- 2021Two Wrongs Don't Make a Right: Combating Confirmation Bias in Learning with Label Noisecited by 18
- 2022Instance-Dependent Noisy Label Learning via Graphical Modellingcited by 17
- 2024Label-Noise Robust Diffusion Modelscited by 16
- 2021An Instance-Dependent Simulation Framework for Learning with Label Noisecited by 14
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusioncited by 13
- 2021Tackling Instance-Dependent Label Noise via a Universal Probabilistic Modelcited by 12
- 2024Cost-Sensitive Learning to Defer to Multiple Experts with Workload Constraintscited by 12
- 2023DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modelingcited by 10
- 2022Instance-dependent Label Distribution Estimation for Learning with Label Noisecited by 9
- 2023VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language Modelscited by 9
- 2024Foster Adaptivity and Balance in Learning with Noisy Labelscited by 9
- 2021Deep Classifiers with Label Noise Modeling and Distance Awarenesscited by 8
- 2021Learning with Proper Partial Labelscited by 8
- 2023Multi-annotator Deep Learning: A Probabilistic Framework for Classificationcited by 8
- 2024Trusted Multi-view Learning under Noisy Supervisioncited by 8
- 2022Disparate Censorship & Undertesting: A Source of Label Bias in Clinical Machine Learningcited by 7
- 2022Label Noise-Robust Learning using a Confidence-Based Sieving Strategycited by 6
- 2024Mitigating Label Noise on Graph via Topological Sample Selectioncited by 6
- 2024Learning with Confidence: Training Better Classifiers from Soft Labelscited by 6
- 2022ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy Statecited by 5
- 2023Unified Risk Analysis for Weakly Supervised Learningcited by 5
- 2023Leveraging an Alignment Set in Tackling Instance-Dependent Label Noisecited by 4
- 2024Dirichlet-based Per-Sample Weighting by Transition Matrix for Noisy Label Learningcited by 4
- 2025Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinementcited by 4
- 2021Elucidating Robust Learning with Uncertainty-Aware Corruption Pattern Estimationcited by 3
- 2023Unsupervised Domain-agnostic Fake News Detection using Multi-modal Weak Signalscited by 3
- 2023FiFAR: A Fraud Detection Dataset for Learning to Defercited by 3
- 2024Learning Causal Transition Matrix for Instance-dependent Label Noisecited by 3
- 2025Enhanced Sample Selection with Confidence Tracking: Identifying Correctly Labeled yet Hard-to-Learn Samples in Noisy Datacited by 3
- 2022Tackling Instance-Dependent Label Noise with Dynamic Distribution Calibrationcited by 2
- 2023Binary Classification with Instance and Label Dependent Label Noisecited by 2
- 2023Generating the Ground Truth: Synthetic Data for Soft Label and Label Noise Researchcited by 2
- 2024AlleNoise: large-scale text classification benchmark dataset with real-world label noisecited by 2
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Predictioncited by 2
- 2024NoisyAG-News: A Benchmark for Addressing Instance-Dependent Noise in Text Classificationcited by 1
- 2024Learning with Instance-Dependent Noisy Labels by Anchor Hallucination and Hard Sample Label Correctioncited by 1
50 most cited of 63 All 63 (JSON)
- 2026Beyond Performance Metrics: Uncertainty Mapping of Label Ambiguity in Fazekas Score Prediction15 Sep 2026
- 2026AUC Maximization from Biased Positive-unlabeled Data with Confidence10 Sep 2026
- 2026AURA: Adaptive Uncertainty-aware Refinement for LLM-as-a-Judge Auditing18 Jun 2026
- 2026Benchmarking Instance-Dependent Label Noise with Controlled Corruptions12 Jun 2026
- 2026Learning Robust Recommenders from Noisy Implicit Feedback via GMM-Weighted Bayesian Transition Matrix20 May 2026
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Prediction30 Apr 2026
- 2025Learning to Clean: Reinforcement Learning for Noisy Label Correction25 Nov 2025
- 2025Fair Bayesian Data Selection via Generalized Discrepancy Measures10 Nov 2025
- 2025Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinement26 May 2025
- 2025Enhanced Sample Selection with Confidence Tracking: Identifying Correctly Labeled yet Hard-to-Learn Samples in Noisy Data24 Apr 2025
- 2025A Bayesian Approach to Segmentation with Noisy Labels via Spatially Correlated Distributions21 Apr 2025
- 2025Training Robust Graph Neural Networks by Modeling Noise Dependencies27 Feb 2025
38 more
- 2025Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shifts20 Feb 2025
- 2024Learning Causal Transition Matrix for Instance-dependent Label Noise18 Dec 2024
- 2024Learning with Confidence: Training Better Classifiers from Soft Labels24 Sep 2024
- 2024Learning with Instance-Dependent Noisy Labels by Anchor Hallucination and Hard Sample Label Correction10 Jul 2024
- 2024NoisyAG-News: A Benchmark for Addressing Instance-Dependent Noise in Text Classification9 Jul 2024
- 2024Foster Adaptivity and Balance in Learning with Noisy Labels3 Jul 2024
- 2024AlleNoise: large-scale text classification benchmark dataset with real-world label noise24 Jun 2024
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusion30 May 2024
- 2024EchoAlign: Bridging Generative and Discriminative Learning under Noisy Labels21 May 2024
- 2024Trusted Multi-view Learning under Noisy Supervision18 Apr 2024
- 2024Cost-Sensitive Learning to Defer to Multiple Experts with Workload Constraints11 Mar 2024
- 2024Dirichlet-based Per-Sample Weighting by Transition Matrix for Noisy Label Learning5 Mar 2024
- 2024Mitigating Label Noise on Graph via Topological Sample Selection4 Mar 2024
- 2024Label-Noise Robust Diffusion Models27 Feb 2024
- 2023FiFAR: A Fraud Detection Dataset for Learning to Defer20 Dec 2023
- 2023VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language Models28 Sep 2023
- 2023Unified Risk Analysis for Weakly Supervised Learning15 Sep 2023
- 2023Generating the Ground Truth: Synthetic Data for Soft Label and Label Noise Research8 Sep 2023
- 2023Leveraging an Alignment Set in Tackling Instance-Dependent Label Noise10 Jul 2023
- 2023Binary Classification with Instance and Label Dependent Label Noise6 Jun 2023
- 2023Label-Retrieval-Augmented Diffusion Models for Learning from Noisy Labels31 May 2023
- 2023DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling30 May 2023
- 2023Unsupervised Domain-agnostic Fake News Detection using Multi-modal Weak Signals18 May 2023
- 2023Rethinking the Value of Labels for Instance-Dependent Label Noise Learning10 May 2023
- 2023Multi-annotator Deep Learning: A Probabilistic Framework for Classification5 Apr 2023
- 2023When Source-Free Domain Adaptation Meets Learning with Noisy Labels31 Jan 2023
- 2022Instance-dependent Label Distribution Estimation for Learning with Label Noise16 Dec 2022
- 2022Label Noise-Robust Learning using a Confidence-Based Sieving Strategy11 Oct 2022
- 2022Tackling Instance-Dependent Label Noise with Dynamic Distribution Calibration11 Oct 2022
- 2022Instance-Dependent Noisy Label Learning via Graphical Modelling2 Sep 2022
- 2022Disparate Censorship & Undertesting: A Source of Label Bias in Clinical Machine Learning1 Aug 2022
- 2022ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy State30 Jun 2022
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimation6 Jun 2022
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Model2 May 2022
- 2022Backdoor Defense via Decoupling the Training Process5 Feb 2022
- 2022Identifiability of Label Noise Transition Matrix4 Feb 2022
- 2022Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shift27 Jan 2022
- 2021Learning with Proper Partial Labels23 Dec 2021
50 newest of 63 All 63 (JSON)
- 2024Label-Noise Robust Diffusion Modelscited by 16
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusioncited by 13
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusion30 May 2024
- 2024Label-Noise Robust Diffusion Models27 Feb 2024
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
- 2021Provably End-to-end Label-Noise Learning without Anchor Pointscited by 97
- 2021To Smooth or Not? When Label Smoothing Meets Noisy Labelscited by 70
- 2021Clusterability as an Alternative to Anchor Points When Learning with Noisy Labelscited by 65
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Instance-dependent Label-noise Learning under a Structural Causal Modelcited by 50
- 2022Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix Estimationcited by 49
- 2023When Source-Free Domain Adaptation Meets Learning with Noisy Labelscited by 46
- 2022Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution Shiftcited by 38
- 2022Identifiability of Label Noise Transition Matrixcited by 34
- 2021Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural Networkcited by 30
- 2022From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative Modelcited by 21
12 most cited of 59 All 59 (JSON)
- 2026Beyond Performance Metrics: Uncertainty Mapping of Label Ambiguity in Fazekas Score Prediction15 Sep 2026
- 2026AUC Maximization from Biased Positive-unlabeled Data with Confidence10 Sep 2026
- 2026AURA: Adaptive Uncertainty-aware Refinement for LLM-as-a-Judge Auditing18 Jun 2026
- 2026Benchmarking Instance-Dependent Label Noise with Controlled Corruptions12 Jun 2026
- 2026Learning Robust Recommenders from Noisy Implicit Feedback via GMM-Weighted Bayesian Transition Matrix20 May 2026
- 2026Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Prediction30 Apr 2026
- 2025Learning to Clean: Reinforcement Learning for Noisy Label Correction25 Nov 2025
- 2025Fair Bayesian Data Selection via Generalized Discrepancy Measures10 Nov 2025
- 2025Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinement26 May 2025
- 2025Enhanced Sample Selection with Confidence Tracking: Identifying Correctly Labeled yet Hard-to-Learn Samples in Noisy Data24 Apr 2025
- 2025A Bayesian Approach to Segmentation with Noisy Labels via Spatially Correlated Distributions21 Apr 2025
- 2025Training Robust Graph Neural Networks by Modeling Noise Dependencies27 Feb 2025
12 newest of 59 All 59 (JSON)