mlsanityData to 14 Oct 2026

Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization

arXiv 2505.00812 ↗First posted 1 May 2025cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational costs, heavy hyperparameter tuning process, and coarse-grained optimization. To address these challenges, we propose a novel two-stage noisy learning framework that enables instance-level optimization through a dynamically weighted loss function, avoiding hyperparameter tuning. To obtain stable and accurate information about noise modeling, we introduce a simple yet effective metric, termed wrong event, which dynamically models the cleanliness and difficulty of individual samples while maintaining computational costs. Our framework first collects wrong event information and builds a strong base model. Then we perform noise-robust training on the base model, using a probabilistic model to handle the wrong event information of samples. Experiments on five synthetic and real-world LNL benchmarks demonstrate our method surpasses state-of-the-art methods in performance, achieves a nearly 75% reduction in computational time and improves model scalability.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 1 May 2025.

Builds on

39 of 61 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  7. 2022A ConvNet for the 2020scited by 3,579
  8. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  9. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  10. 2017A Closer Look at Memorization in Deep Networkscited by 942
  11. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  12. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
27 more
  1. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  2. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
  3. 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
  4. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
  5. 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
  6. 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
  7. 2018CurriculumNet: Weakly Supervised Learning from Large-Scale Web Imagescited by 126
  8. 2018Gradient Harmonized Single-stage Detectorcited by 114
  9. 2022Selective-Supervised Contrastive Learning with Noisy Labelscited by 112
  10. 2019Meta Label Correction for Noisy Label Learningcited by 108
  11. 2021Augmentation Strategies for Learning with Noisy Labelscited by 86
  12. 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
  13. 2021Contrast to Divide: Self-Supervised Pre-Training for Learning with Noisy Labelscited by 69
  14. 2021Co-learning: Learning from Noisy Labels with Self-supervisioncited by 51
  15. 2022ProMix: Combating Label Noise via Maximizing Clean Sample Utilitycited by 48
  16. 2021LongReMix: Robust Learning with High Confidence Samples in a Noisy Label Environmentcited by 40
  17. 2024Harnessing Diversity for Important Data Selection in Pretraining Large Language Modelscited by 34
  18. 2022Self-Filtering: A Noise-Aware Sample Selection for Label Noise with Confidence Penalizationcited by 33
  19. 2025Early Stopping Against Label Noise Without Validation Datacited by 21
  20. 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environmentscited by 19
  21. 2022Instance-Dependent Noisy Label Learning via Graphical Modellingcited by 17
  22. 2023Late Stopping: Avoiding Confidently Learning from Mislabeled Examplescited by 17
  23. 2024CLIPCleaner: Cleaning Noisy Labels with CLIPcited by 16
  24. 2024Vision-Language Models are Strong Noisy Label Detectorscited by 16
  25. 2023Fine tuning Pre trained Models for Robustness Under Noisy Labelscited by 8
  26. 2018SOSELETO: A Unified Approach to Transfer Learning and Training with Noisy Labelscited by 5
  27. 2022Tripartite: Tackle Noisy Labels by a More Precise Partitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.