Learning to Detect Noisy Labels Using Model-Based Features
Not on the map. Why?
Abstract (arXiv)
Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible enough to achieve optimal solutions. Meta learning based methods address this issue by learning a data selection function, but can be hard to optimize. In light of these pros and cons, we propose Selection-Enhanced Noisy label Training (SENT) that does not rely on meta learning while having the flexibility of being data-driven. SENT transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features. Empirically, on a wide range of tasks including text classification and speech recognition, SENT improves performance over strong baselines under the settings of self-training and label corruption.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 28 Dec 2022.
Builds on
30 of 45 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2019Confidence Regularized Self-Trainingcited by 419
- 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 373
18 more
- 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 372
- 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
- 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
- 2020Improved Noisy Student Training for Automatic Speech Recognitioncited by 141
- 2016Harnessing Deep Neural Networks with Logic Rulescited by 135
- 2019Deep Self-Learning From Noisy Labelscited by 122
- 2019Meta Label Correction for Noisy Label Learningcited by 108
- 2016Stance Detection with Bidirectional Conditional Encodingcited by 93
- 2019Learning to Self-Train for Semi-Supervised Few-Shot Classificationcited by 83
- 2020Beyond Class-Conditional Assumption: A Primary Attempt to Combat Instance-Dependent Label Noisecited by 82
- 2020Learning from Rules Generalizing Labeled Exemplarscited by 59
- 2018Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scalecited by 52
- 2021Self-Training with Weak Supervisioncited by 49
- 2020Adaptive Self-training for Few-shot Neural Sequence Labelingcited by 18
- 2021On sensitivity of meta-learning to support datacited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2025QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Searchcited by 20
- 2024SparseCL: Sparse Contrastive Learning for Contradiction Retrievalcited by 2
- 2025DINA: A Dual Defense Framework Against Internal Noise and External Attacks in Natural Language Processingcited by 0
- 2025Weed Out, Then Harvest: Dual Low-Rank Adaptation is an Effective Noisy Label Detector for Noise-Robust Learningcited by 0
- 2026Noise-Aware Framework for Correcting Corrupted Labelscited by 0
- 2026A Data-Centric Framework for Detecting and Correcting Corrupted Labelscited by 0
- 2026A Data-Centric Framework for Detecting and Correcting Corrupted Labels10 Jun 2026
- 2026Noise-Aware Framework for Correcting Corrupted Labels10 Jun 2026
- 2025Weed Out, Then Harvest: Dual Low-Rank Adaptation is an Effective Noisy Label Detector for Noise-Robust Learning11 Oct 2025
- 2025DINA: A Dual Defense Framework Against Internal Noise and External Attacks in Natural Language Processing4 Aug 2025
- 2025QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Search4 Feb 2025
- 2024SparseCL: Sparse Contrastive Learning for Contradiction Retrieval15 Jun 2024