mlsanityData to 14 Oct 2026

Radial-Angular Geometry for Reliable Update Diagnosis in Noisy-Label Learning

arXiv 2605.17429 ↗First posted 17 May 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Noisy-label methods often estimate sample reliability from forward-space signals such as loss, confidence, or entropy. These signals indicate whether a sample is difficult to predict, but they do not directly test whether its observed label induces a reliable parameter update. This gap matters because hard clean samples and mislabeled samples can have similar loss while inducing different updates. We recast reliability estimation as diagnosis of the observed-label update. The sample-wise empirical Fisher trace gives a backward-space measure of update energy: for the classifier layer, it factorizes into a prediction-residual term and a feature-sensitivity term, so it captures information beyond scalar loss. Trace, however, is still a radial magnitude signal and cannot decide whether a large update is useful or harmful. We therefore propose Relative Geometric Conflict (RGC), which compares the observed-label gradient with a reference gradient induced by an EMA teacher. The conflict term helps distinguish large but aligned hard-clean updates from large conflicting updates caused by corrupted labels. Across synthetic and real-world noisy-label benchmarks, RGC improves hard-clean preservation and accuracy under our evaluation protocol.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

24 of 33 references.

References · 24

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020Supervised Contrastive Learningcited by 2,829
  4. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  5. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  6. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
  7. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  8. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
  9. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
  10. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  11. 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
  12. 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
12 more
  1. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
  2. 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
  3. 2019An Investigation into Neural Net Optimization via Hessian Eigenvalue Densitycited by 292
  4. 2019Limitations of the Empirical Fisher Approximation for Natural Gradient Descentcited by 217
  5. 2021Learning with Feature-Dependent Label Noise: A Progressive Approachcited by 102
  6. 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
  7. 2020Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalizationcited by 62
  8. 2022ProMix: Combating Label Noise via Maximizing Clean Sample Utilitycited by 48
  9. 2021LongReMix: Robust Learning with High Confidence Samples in a Noisy Label Environmentcited by 40
  10. 2022L2B: Learning to Bootstrap Robust Models for Combating Label Noisecited by 10
  11. 2025Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimizationcited by 6
  12. 2025Enhancing Sample Selection Against Label Noise by Cutting Mislabeled Easy Examplescited by 4

Built on by

Not cited yet.