Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization
Not on the map. Why?
Abstract (arXiv)
Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational costs, heavy hyperparameter tuning process, and coarse-grained optimization. To address these challenges, we propose a novel two-stage noisy learning framework that enables instance-level optimization through a dynamically weighted loss function, avoiding hyperparameter tuning. To obtain stable and accurate information about noise modeling, we introduce a simple yet effective metric, termed wrong event, which dynamically models the cleanliness and difficulty of individual samples while maintaining computational costs. Our framework first collects wrong event information and builds a strong base model. Then we perform noise-robust training on the base model, using a probabilistic model to handle the wrong event information of samples. Experiments on five synthetic and real-world LNL benchmarks demonstrate our method surpasses state-of-the-art methods in performance, achieves a nearly 75% reduction in computational time and improves model scalability.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 1 May 2025.
Builds on
39 of 61 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2022A ConvNet for the 2020scited by 3,579
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2017A Closer Look at Memorization in Deep Networkscited by 942
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
27 more
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
- 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
- 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
- 2018CurriculumNet: Weakly Supervised Learning from Large-Scale Web Imagescited by 126
- 2018Gradient Harmonized Single-stage Detectorcited by 114
- 2022Selective-Supervised Contrastive Learning with Noisy Labelscited by 112
- 2019Meta Label Correction for Noisy Label Learningcited by 108
- 2021Augmentation Strategies for Learning with Noisy Labelscited by 86
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2021Contrast to Divide: Self-Supervised Pre-Training for Learning with Noisy Labelscited by 69
- 2021Co-learning: Learning from Noisy Labels with Self-supervisioncited by 51
- 2022ProMix: Combating Label Noise via Maximizing Clean Sample Utilitycited by 48
- 2021LongReMix: Robust Learning with High Confidence Samples in a Noisy Label Environmentcited by 40
- 2024Harnessing Diversity for Important Data Selection in Pretraining Large Language Modelscited by 34
- 2022Self-Filtering: A Noise-Aware Sample Selection for Label Noise with Confidence Penalizationcited by 33
- 2025Early Stopping Against Label Noise Without Validation Datacited by 21
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environmentscited by 19
- 2022Instance-Dependent Noisy Label Learning via Graphical Modellingcited by 17
- 2023Late Stopping: Avoiding Confidently Learning from Mislabeled Examplescited by 17
- 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
- 2024Vision-Language Models are Strong Noisy Label Detectorscited by 16
- 2023Fine tuning Pre trained Models for Robustness Under Noisy Labelscited by 8
- 2018SOSELETO: A Unified Approach to Transfer Learning and Training with Noisy Labelscited by 5
- 2022Tripartite: Tackle Noisy Labels by a More Precise Partitioncited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2026SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactionscited by 2
- 2025Benchmarking noisy label detection methodscited by 1
- 2026UFO: A Unified Flow-Oriented Framework for Robust Continual Graph Learningcited by 0
- 2026Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learningcited by 0
- 2026DiagramRAG: A Lightweight Framework to Retrieve Scientific Diagram for Figure Generationcited by 0
- 2026Video-Arena: A Scalable Agentic Video Benchmark for Spatiotemporal Capabilitycited by 0
- 2026Video-Arena: A Scalable Agentic Video Benchmark for Spatiotemporal Capability9 Oct 2026
- 2026SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions30 Aug 2026
- 2026DiagramRAG: A Lightweight Framework to Retrieve Scientific Diagram for Figure Generation27 May 2026
- 2026Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learning17 May 2026
- 2026UFO: A Unified Flow-Oriented Framework for Robust Continual Graph Learning11 May 2026
- 2025Benchmarking noisy label detection methods17 Oct 2025