On Symmetric Losses for Learning from Corrupted Labels
Not on the map. Why?
Abstract (arXiv)
This paper aims to provide a better understanding of a symmetric loss. First, we emphasize that using a symmetric loss is advantageous in the balanced error rate (BER) minimization and area under the receiver operating characteristic curve (AUC) maximization from corrupted labels. Second, we prove general theoretical properties of symmetric losses, including a classification-calibration condition, excess risk bound, conditional risk minimizer, and AUC-consistency condition. Third, since all nonnegative symmetric losses are non-convex, we propose a convex barrier hinge loss that benefits significantly from the symmetric condition, although it is not symmetric everywhere. Finally, we conduct experiments to validate the relevance of the symmetric condition.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 15; 2022: 12; 2023: 11; 2024: 3; 2025: 5; 2026: 6.
53 papers.
Sort:
By area:
- 2021Learning with Feature-Dependent Label Noise: A Progressive Approachcited by 102
- 2022AUC Maximization in the Era of Big Data and AI: A Surveycited by 100
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Asymmetric Loss Functions for Learning with Noisy Labelscited by 46
- 2021Learning with Noisy Labels via Sparse Regularizationcited by 38
- 2020Robust Imitation Learning from Noisy Demonstrationscited by 26
- 2021Understanding Instance-Level Label Noise: Disparate Impacts and Treatmentscited by 22
- 2021Adaptive Sample Selection for Robust Learning under Label Noisecited by 20
- 2022Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teachercited by 12
- 2023Weakly Supervised AUC Optimization: A Unified Partial AUC Approachcited by 11
- 2022Benchmarking Deep AUROC Optimization: Loss Functions and Algorithmic Choicescited by 10
- 2022Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusioncited by 10
38 more
- 2022FeDXL: Provable Federated Learning for Deep X-Risk Optimizationcited by 10
- 2021Robustness and Reliability When Training With Noisy Labelscited by 9
- 2021Learning with Label Noise for Image Retrieval by Selecting Interactionscited by 8
- 2021Learning with Proper Partial Labelscited by 8
- 2023NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processingcited by 8
- 2023Regularly Truncated M-estimators for Learning with Noisy Labelscited by 8
- 2022Class-Imbalanced Complementary-Label Learning via Weighted Losscited by 7
- 2023Confidence-based Reliable Learning under Dual Noisescited by 6
- 2025Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognitioncited by 6
- 2023Unified Risk Analysis for Weakly Supervised Learningcited by 5
- 2022Prototype-Anchored Learning for Learning with Imperfect Annotationscited by 4
- 2023SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognitioncited by 4
- 2023Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervisioncited by 4
- 2025On Symmetric Losses for Robust Policy Optimization with Noisy Preferencescited by 4
- 2021Approximating Instance-Dependent Noise via Instance-Confidence Embeddingcited by 3
- 2021Do We Really Need Gold Samples for Sample Weighting Under Label Noise?cited by 3
- 2023Provable Multi-instance Deep AUC Maximization with Stochastic Poolingcited by 3
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extractioncited by 3
- 2024Active Negative Loss: A Robust Framework for Learning with Noisy Labelscited by 3
- 2021An Exploration into why Output Regularization Mitigates Label Noisecited by 2
- 2021The perils of being unhinged: On the accuracy of classifiers minimizing a noise-robust convex losscited by 2
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Lossescited by 2
- 2022What killed the Convex Booster ?cited by 1
- 2022Maximising the Utility of Validation Sets for Imbalanced Noisy-label Meta-learningcited by 1
- 2024Exploring Loss Design Techniques For Decision Tree Robustness To Label Noisecited by 1
- 2025Accessible, Realistic, and Fair Evaluation of Positive-Unlabeled Learning Algorithmscited by 1
- 2021A Symmetric Loss Perspective of Reliable Machine Learningcited by 0
- 2021Contrastive Representations for Label Noise Require Fine-Tuningcited by 0
- 2022Deep Learning with Label Noise: A Hierarchical Approachcited by 0
- 2022Performances of Symmetric Loss for Private Data from Exponential Mechanismcited by 0
- 2022Learning with Silver Standard Data for Zero-shot Relation Extractioncited by 0
- 2023Learning from Stochastic Labelscited by 0
- 2023AUC Optimization from Multiple Unlabeled Datasetscited by 0
- 2023Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classificationcited by 0
- 2025Learning from Uncertain Similarity and Unlabeled Datacited by 0
- 2026Communication-Efficient Federated AUC Maximization with Cyclic Client Participationcited by 0
- 2026Generalized Distribution-Free Semi-Supervised Learning with Risk Rewritecited by 0
- 2026Robust Losses from Univariate Base Functions for Noisy-Label Learningcited by 0
50 most cited of 53 All 53 (JSON)
- 2026Importance Weighting for Unlabeled-unlabeled Learning under Distribution Shift10 Sep 2026
- 2026AUC Maximization from Biased Positive-unlabeled Data with Confidence10 Sep 2026
- 2026Bayes-Optimal BER and AUC: Estimation and Evaluation of Estimators2 Sep 2026
- 2026Robust Losses from Univariate Base Functions for Noisy-Label Learning18 Jul 2026
- 2026Generalized Distribution-Free Semi-Supervised Learning with Risk Rewrite11 Jul 2026
- 2026Communication-Efficient Federated AUC Maximization with Cyclic Client Participation4 Jan 2026
- 2025Accessible, Realistic, and Fair Evaluation of Positive-Unlabeled Learning Algorithms29 Sep 2025
- 2025Learning from Uncertain Similarity and Unlabeled Data15 Sep 2025
- 2025Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognition27 Jun 2025
- 2025On Symmetric Losses for Robust Policy Optimization with Noisy Preferences30 May 2025
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Losses14 May 2025
- 2024Active Negative Loss: A Robust Framework for Learning with Noisy Labels3 Dec 2024
38 more
- 2024Exploring Loss Design Techniques For Decision Tree Robustness To Label Noise27 May 2024
- 2024On the use of Silver Standard Data for Zero-shot Classification Tasks in Information Extraction28 Feb 2024
- 2023Unified Risk Analysis for Weakly Supervised Learning15 Sep 2023
- 2023Regularly Truncated M-estimators for Learning with Noisy Labels2 Sep 2023
- 2023Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification2 Jul 2023
- 2023Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervision12 Jun 2023
- 2023AUC Optimization from Multiple Unlabeled Datasets25 May 2023
- 2023Weakly Supervised AUC Optimization: A Unified Partial AUC Approach23 May 2023
- 2023NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing18 May 2023
- 2023Provable Multi-instance Deep AUC Maximization with Stochastic Pooling14 May 2023
- 2023SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition6 May 2023
- 2023Confidence-based Reliable Learning under Dual Noises10 Feb 2023
- 2023Learning from Stochastic Labels1 Feb 2023
- 2022Learning with Silver Standard Data for Zero-shot Relation Extraction25 Nov 2022
- 2022FeDXL: Provable Federated Learning for Deep X-Risk Optimization26 Oct 2022
- 2022Performances of Symmetric Loss for Private Data from Exponential Mechanism9 Oct 2022
- 2022Class-Imbalanced Complementary-Label Learning via Weighted Loss28 Sep 2022
- 2022Maximising the Utility of Validation Sets for Imbalanced Noisy-label Meta-learning17 Aug 2022
- 2022Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusion22 Jul 2022
- 2022Prototype-Anchored Learning for Learning with Imperfect Annotations23 Jun 2022
- 2022Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teacher28 May 2022
- 2022Deep Learning with Label Noise: A Hierarchical Approach28 May 2022
- 2022What killed the Convex Booster ?19 May 2022
- 2022AUC Maximization in the Era of Big Data and AI: A Survey28 Mar 2022
- 2022Benchmarking Deep AUROC Optimization: Loss Functions and Algorithmic Choices27 Mar 2022
- 2021Learning with Proper Partial Labels23 Dec 2021
- 2021Learning with Label Noise for Image Retrieval by Selecting Interactions20 Dec 2021
- 2021The perils of being unhinged: On the accuracy of classifiers minimizing a noise-robust convex loss8 Dec 2021
- 2021Robustness and Reliability When Training With Noisy Labels7 Oct 2021
- 2021Contrastive Representations for Label Noise Require Fine-Tuning20 Aug 2021
- 2021Learning with Noisy Labels via Sparse Regularization31 Jul 2021
- 2021Adaptive Sample Selection for Robust Learning under Label Noise29 Jun 2021
- 2021Asymmetric Loss Functions for Learning with Noisy Labels6 Jun 2021
- 2021An Exploration into why Output Regularization Mitigates Label Noise26 Apr 2021
- 2021Do We Really Need Gold Samples for Sample Weighting Under Label Noise?19 Apr 2021
- 2021Approximating Instance-Dependent Noise via Instance-Confidence Embedding25 Mar 2021
- 2021Learning with Feature-Dependent Label Noise: A Progressive Approach13 Mar 2021
- 2021Understanding Instance-Level Label Noise: Disparate Impacts and Treatments10 Feb 2021
50 newest of 53 All 53 (JSON)
- 2020Robust Imitation Learning from Noisy Demonstrationscited by 26
- 2020Robust Imitation Learning from Noisy Demonstrations20 Oct 2020
- 2021Learning with Feature-Dependent Label Noise: A Progressive Approachcited by 102
- 2022AUC Maximization in the Era of Big Data and AI: A Surveycited by 100
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Asymmetric Loss Functions for Learning with Noisy Labelscited by 46
- 2021Learning with Noisy Labels via Sparse Regularizationcited by 38
- 2021Understanding Instance-Level Label Noise: Disparate Impacts and Treatmentscited by 22
- 2021Adaptive Sample Selection for Robust Learning under Label Noisecited by 20
- 2022Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teachercited by 12
- 2023Weakly Supervised AUC Optimization: A Unified Partial AUC Approachcited by 11
- 2022Benchmarking Deep AUROC Optimization: Loss Functions and Algorithmic Choicescited by 10
- 2022Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusioncited by 10
- 2022FeDXL: Provable Federated Learning for Deep X-Risk Optimizationcited by 10
12 most cited of 51 All 51 (JSON)
- 2026Importance Weighting for Unlabeled-unlabeled Learning under Distribution Shift10 Sep 2026
- 2026AUC Maximization from Biased Positive-unlabeled Data with Confidence10 Sep 2026
- 2026Bayes-Optimal BER and AUC: Estimation and Evaluation of Estimators2 Sep 2026
- 2026Robust Losses from Univariate Base Functions for Noisy-Label Learning18 Jul 2026
- 2026Generalized Distribution-Free Semi-Supervised Learning with Risk Rewrite11 Jul 2026
- 2026Communication-Efficient Federated AUC Maximization with Cyclic Client Participation4 Jan 2026
- 2025Accessible, Realistic, and Fair Evaluation of Positive-Unlabeled Learning Algorithms29 Sep 2025
- 2025Learning from Uncertain Similarity and Unlabeled Data15 Sep 2025
- 2025Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognition27 Jun 2025
- 2025Establishing Linear Surrogate Regret Bounds for Convex Smooth Losses via Convolutional Fenchel-Young Losses14 May 2025
- 2024Active Negative Loss: A Robust Framework for Learning with Noisy Labels3 Dec 2024
- 2024Exploring Loss Design Techniques For Decision Tree Robustness To Label Noise27 May 2024
12 newest of 51 All 51 (JSON)