mlsanityData to 14 Oct 2026

Learning from Long-Tailed Noisy Data with Sample Selection and Balanced Loss

arXiv 2211.10906 ↗First posted 20 Nov 2022cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while a few methods are developed to tackle long-tailed noisy data. To solve this, we propose a robust method for learning from long-tailed noisy data with sample selection and balanced loss. Specifically, we separate the noisy training data into clean labeled set and unlabeled set with sample selection, and train the deep neural network in a semi-supervised manner with a balanced loss based on model bias. Extensive experiments on benchmarks demonstrate that our method outperforms existing state-of-the-art methods.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 51 of its 72 references that are in the map. First posted on arXiv 20 Nov 2022.

Builds on

51 of 72 references.

References · 51

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  7. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  8. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  9. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  10. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  11. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  12. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
38 more
  1. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
  2. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  3. 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
  4. 2017A Closer Look at Memorization in Deep Networkscited by 942
  5. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
  6. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
  7. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  8. 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
  9. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
  10. 2020Long-tail learning via logit adjustmentcited by 618
  11. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
  12. 2017Robust Loss Functions under Label Noise for Deep Neural Networkscited by 443
  13. 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
  14. 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
  15. 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
  16. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
  17. 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
  18. 2018Joint Optimization Framework for Learning with Noisy Labelscited by 293
  19. 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
  20. 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
  21. 2018Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noisecited by 216
  22. 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
  23. 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
  24. 2019Understanding and Utilizing Deep Neural Networks Trained with Noisy Labelscited by 209
  25. 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
  26. 2020M2m: Imbalanced Classification via Major-to-minor Translationcited by 134
  27. 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
  28. 2020Deep Representation Learning on Long-tailed Data: A Learnable Embedding Augmentation Perspectivecited by 120
  29. 2020Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learningcited by 105
  30. 2021Learning Fast Sample Re-weighting Without Reward Datacited by 69
  31. 2021ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learningcited by 65
  32. 2020Heteroskedastic and Imbalanced Deep Learning with Adaptive Regularizationcited by 49
  33. 2021Towards Understanding Deep Learning from Noisy Labels with Small-Loss Criterioncited by 36
  34. 2019L_DMI: An Information-theoretic Noise-robust Loss Functioncited by 26
  35. 2022Identifying Hard Noise in Long-Tailed Sample Distributioncited by 19
  36. 2021Learning From Long-Tailed Data With Noisy Labelscited by 17
  37. 2022Label-Noise Learning with Intrinsically Long-Tailed Datacited by 17
  38. 2021Delving into Sample Loss Curve to Embrace Noisy and Imbalanced Datacited by 16

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.