Selective Posterior Margin Regularization for Forward-Corrected Classification
Not on the map. Why?
Abstract (arXiv)
Learning with class-conditional label noise often relies on a transition model from latent clean classes to observed annotations. Forward correction embeds this transition in the likelihood, yet finite-sample networks may still memorize corrupted labels. The corrected likelihood also induces a reverse posterior over the clean classes that could explain each annotation. When its leading class differs from the annotation, the model and transition matrix provide evidence against that annotation, but the leading alternatives can remain nearly tied. We introduce Selective Posterior Margin Regularization (SPMR), which preserves the Forward objective and converts this disagreement into a graded update on the clean classifier. SPMR selects the leading reverse-posterior class, scales a detached pairwise margin by the separation between the two leading posterior classes, and assigns correspondingly little influence to diffuse conflicts. The gap factorizes into transition- adjusted pairwise separation and the posterior mass carried by the leading pair. The active margin follows the locally minimum-norm logit direction that enlarges the selected pairwise margin. Across five known-transition benchmarks, SPMR improves full-length Forward by 2.5-7.0 percentage points and remains 0.7-2.5 percentage points above Forward with Mixup and early stopping. Matched interventions support distinct gains from the posterior-space coefficient, transition-adjusted target, and pairwise action. The same design transfers to estimated transitions, human annotations, architectural changes, and stronger Forward recipes. The formulation uses latent-class evidence already available inside Forward correction without promoting every posterior conflict to a corrected label.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
33 of 43 references.
References · 33
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2016Wide Residual Networkscited by 3,070
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
- 2017Robust Loss Functions under Label Noise for Deep Neural Networkscited by 443
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
21 more
- 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
- 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
- 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 328
- 2014Training Deep Neural Networks on Noisy Labels with Bootstrappingcited by 322
- 2020Combating noisy labels by agreement: A joint training method with co-regularizationcited by 289
- 2020Identifying Mislabeled Data using the Area Under the Margin Rankingcited by 261
- 2020Normalized Loss Functions for Deep Learning with Noisy Labelscited by 257
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
- 2018Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noisecited by 216
- 2019Are Anchor Points Really Indispensable in Label-Noise Learning?cited by 208
- 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
- 2020Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learningcited by 142
- 2021Augmentation Strategies for Learning with Noisy Labelscited by 86
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2021Generalized Jensen-Shannon Divergence Loss for Learning with Noisy Labelscited by 74
- 2022Investigating Why Contrastive Learning Benefits Robustness Against Label Noisecited by 46
- 2022CrossSplit: Mitigating Label Noise Memorization through Data Splittingcited by 12
- 2024Learning from Noisy Labels via Conditional Distributionally Robust Optimizationcited by 6
- 2024Optimized Gradient Clipping for Noisy Label Learningcited by 4
- 2023Label Noise: Correcting the Forward-Correctioncited by 1
- 2026Deconstructing the Failure of Ideal Noise Correction: A Three-Pillar Diagnosiscited by 1
Built on by
Not cited yet.