# Leveraged Weighted Loss for Partial Label Learning

arXiv: https://arxiv.org/abs/2106.05731 · HTML: https://mlsanity.com/paper/2106.05731/

## Key facts

- Cited by 66 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 51 references that are in the map.
- First posted on arXiv 10 Jun 2021.

## Builds on (most cited first, 16 of 16)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms](https://mlsanity.com/paper/1708.07747/) (2017)
- [Temporal Ensembling for Semi-Supervised Learning](https://mlsanity.com/paper/1610.02242/) (2016)
- [Deep Learning for Classical Japanese Literature](https://mlsanity.com/paper/1812.01718/) (2018)
- [Are Anchor Points Really Indispensable in Label-Noise Learning?](https://mlsanity.com/paper/1906.00189/) (2019)
- [Progressive Identification of True Labels for Partial-Label Learning](https://mlsanity.com/paper/2002.08053/) (2020)
- [Provably Consistent Partial-Label Learning](https://mlsanity.com/paper/2007.08929/) (2020)
- [Learning from Complementary Labels](https://mlsanity.com/paper/1705.07541/) (2017)
- [Complementary-Label Learning for Arbitrary Losses and Models](https://mlsanity.com/paper/1810.04327/) (2018)
- [Learning with Multiple Complementary Labels](https://mlsanity.com/paper/1912.12927/) (2019)
- [Partial Label Learning with Self-Guided Retraining](https://mlsanity.com/paper/1902.03045/) (2019)
- [Structured Prediction with Partial Labelling through the Infimum Loss](https://mlsanity.com/paper/2003.00920/) (2020)
- [Learning from Ambiguously Labeled Face Images](https://mlsanity.com/paper/1702.04455/) (2017)
- [GM-PLL: Graph Matching based Partial Label Learning](https://mlsanity.com/paper/1901.03073/) (2019)
- [A Regularization Approach for Instance-Based Superset Label Learning](https://mlsanity.com/paper/1904.02832/) (2019)
- [Network Cooperation with Progressive Disambiguation for Partial Label Learning](https://mlsanity.com/paper/2002.11919/) (2020)

## Built on by (most cited first, 30 of 66)

- [Instance-Dependent Partial Label Learning](https://mlsanity.com/paper/2110.12911/) (2021)
- [SoLar: Sinkhorn Label Refinery for Imbalanced Partial-Label Learning](https://mlsanity.com/paper/2209.10365/) (2022)
- [Progressive Purification for Instance-Dependent Partial Label Learning](https://mlsanity.com/paper/2206.00830/) (2022)
- [Long-Tailed Partial Label Learning via Dynamic Rebalancing](https://mlsanity.com/paper/2302.05080/) (2023)
- [Efficient Algorithms for Learning from Coarse Labels](https://mlsanity.com/paper/2108.09805/) (2021)
- [PiCO+: Contrastive Label Disambiguation for Robust Partial Label Learning](https://mlsanity.com/paper/2201.08984/) (2022)
- [On the Robustness of Average Losses for Partial-Label Learning](https://mlsanity.com/paper/2106.06152/) (2021)
- [Candidate Pseudolabel Learning: Enhancing Vision-Language Models by Prompt Tuning with Unlabeled Data](https://mlsanity.com/paper/2406.10502/) (2024)
- [On Learning Latent Models with Multi-Instance Weak Supervision](https://mlsanity.com/paper/2306.13796/) (2023)
- [Binary Classification with Confidence Difference](https://mlsanity.com/paper/2310.05632/) (2023)
- [Realistic Evaluation of Deep Partial-Label Learning Algorithms](https://mlsanity.com/paper/2502.10184/) (2025)
- [CroSel: Cross Selection of Confident Pseudo Labels for Partial-Label Learning](https://mlsanity.com/paper/2303.10365/) (2023)
- [Towards Effective Visual Representations for Partial-Label Learning](https://mlsanity.com/paper/2305.06080/) (2023)
- [Disambiguated Attention Embedding for Multi-Instance Partial-Label Learning](https://mlsanity.com/paper/2305.16912/) (2023)
- [Learning with Complementary Labels Revisited: The Selected-Completely-at-Random Setting Is More Practical](https://mlsanity.com/paper/2311.15502/) (2023)
- [Learning with Partial Labels from Semi-supervised Perspective](https://mlsanity.com/paper/2211.13655/) (2022)
- [ALIM: Adjusting Label Importance Mechanism for Noisy Partial Label Learning](https://mlsanity.com/paper/2301.12077/) (2023)
- [Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations](https://mlsanity.com/paper/2305.12715/) (2023)
- [Learning with Proper Partial Labels](https://mlsanity.com/paper/2112.12303/) (2021)
- [A General Framework for Learning from Weak Supervision](https://mlsanity.com/paper/2402.01922/) (2024)
- [Tuning Vision-Language Models with Candidate Labels by Prompt Alignment](https://mlsanity.com/paper/2407.07638/) (2024)
- [Multi-Instance Partial-Label Learning with Margin Adjustment](https://mlsanity.com/paper/2501.12597/) (2025)
- [Rethinking the Learning Paradigm for Facial Expression Recognition](https://mlsanity.com/paper/2209.15402/) (2022)
- [IRNet: Iterative Refinement Network for Noisy Partial Label Learning](https://mlsanity.com/paper/2211.04774/) (2022)
- [Unreliable Partial Label Learning with Recursive Separation](https://mlsanity.com/paper/2302.09891/) (2023)
- [Partial Label Learning for Emotion Recognition from EEG](https://mlsanity.com/paper/2302.13170/) (2023)
- [A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition](https://mlsanity.com/paper/2305.12485/) (2023)
- [Partial-Label Regression](https://mlsanity.com/paper/2306.08968/) (2023)
- [Exploiting Conjugate Label Information for Multi-Instance Partial-Label Learning](https://mlsanity.com/paper/2408.14369/) (2024)
- [Controller-Guided Partial Label Consistency Regularization with Unlabeled Data](https://mlsanity.com/paper/2210.11194/) (2022)

## Abstract (arXiv)

As an important branch of weakly supervised learning, partial label learning deals with data where each instance is assigned with a set of candidate labels, whereas only one of them is true. Despite many methodology studies on learning from partial labels, there still lacks theoretical understandings of their risk consistent properties under relatively weak assumptions, especially on the link between theoretical results and the empirical choice of parameters. In this paper, we propose a family of loss functions named textitLeveraged Weighted (LW) loss, which for the first time introduces the leverage parameter β to consider the trade-off between losses on partial labels and non-partial ones. From the theoretical side, we derive a generalized result of risk consistency for the LW loss in learning from partial labels, based on which we provide guidance to the choice of the leverage parameter β. In experiments, we verify the theoretical guidance, and show the high effectiveness of our proposed LW loss on both benchmark and real datasets compared with other state-of-the-art partial label learning algorithms.
