# Theoretical Proportion Label Perturbation for Learning from Label Proportions in Large Bags

arXiv: https://arxiv.org/abs/2408.14130 · HTML: https://mlsanity.com/paper/2408.14130/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 36 references that are in the map.
- First posted on arXiv 26 Aug 2024.

## Builds on (most cited first, 21 of 21)

- [Understanding deep learning requires rethinking generalization](https://mlsanity.com/paper/1611.03530/) (2016)
- [Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels](https://mlsanity.com/paper/1804.06872/) (2018)
- [Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach](https://mlsanity.com/paper/1609.03683/) (2016)
- [Learning from Noisy Labels with Deep Neural Networks: A Survey](https://mlsanity.com/paper/2007.08199/) (2020)
- [Regularizing Neural Networks by Penalizing Confident Output Distributions](https://mlsanity.com/paper/1701.06548/) (2017)
- [Using Pre-Training Can Improve Model Robustness and Uncertainty](https://mlsanity.com/paper/1901.09960/) (2019)
- [Combating noisy labels by agreement: A joint training method with co-regularization](https://mlsanity.com/paper/2003.02752/) (2020)
- [Normalized Loss Functions for Deep Learning with Noisy Labels](https://mlsanity.com/paper/2006.13554/) (2020)
- [Webly Supervised Learning of Convolutional Networks](https://mlsanity.com/paper/1505.01554/) (2015)
- [On Learning from Label Proportions](https://mlsanity.com/paper/1402.5902/) (2014)
- [Learning from Label Proportions with Consistency Regularization](https://mlsanity.com/paper/1910.13188/) (2019)
- [Deep multi-class learning from label proportions](https://mlsanity.com/paper/1905.12909/) (2019)
- [Learning from Label Proportions by Learning with Label Noise](https://mlsanity.com/paper/2203.02496/) (2022)
- [Co-training for Demographic Classification Using Deep Learning from Label Proportions](https://mlsanity.com/paper/1709.04108/) (2017)
- [Learning from Label Proportions with Generative Adversarial Networks](https://mlsanity.com/paper/1909.02180/) (2019)
- [Two-stage Training for Learning from Label Proportions](https://mlsanity.com/paper/2105.10635/) (2021)
- [Negative Pseudo Labeling using Class Proportion for Semantic Segmentation in Pathology](https://mlsanity.com/paper/2007.08044/) (2020)
- [Learning from Label Proportion with Online Pseudo-Label Decision by Regret Minimization](https://mlsanity.com/paper/2302.08947/) (2023)
- [MixBag: Bag-Level Data Augmentation for Learning from Label Proportions](https://mlsanity.com/paper/2308.08822/) (2023)
- [Learning from Partial Label Proportions for Whole Slide Image Segmentation](https://mlsanity.com/paper/2405.09041/) (2024)
- [Proportion Estimation by Masked Learning from Label Proportion](https://mlsanity.com/paper/2405.04815/) (2024)

## Built on by (most cited first, 2 of 2)

- [Weakly-Supervised Domain Adaptation with Proportion-Constrained Pseudo-Labeling](https://mlsanity.com/paper/2506.22301/) (2025)
- [Leveraging Label Proportion Prior for Class-Imbalanced Semi-Supervised Learning](https://mlsanity.com/paper/2603.02957/) (2026)

## Abstract (arXiv)

Learning from label proportions (LLP) is a kind of weakly supervised learning that trains an instance-level classifier from label proportions of bags, which consist of sets of instances without using instance labels. A challenge in LLP arises when the number of instances in a bag (bag size) is numerous, making the traditional LLP methods difficult due to GPU memory limitations. This study aims to develop an LLP method capable of learning from bags with large sizes. In our method, smaller bags (mini-bags) are generated by sampling instances from large-sized bags (original bags), and these mini-bags are used in place of the original bags. However, the proportion of a mini-bag is unknown and differs from that of the original bag, leading to overfitting. To address this issue, we propose a perturbation method for the proportion labels of sampled mini-bags to mitigate overfitting to noisy label proportions. This perturbation is added based on the multivariate hypergeometric distribution, which is statistically modeled. Additionally, loss weighting is implemented to reduce the negative impact of proportions sampled from the tail of the distribution. Experimental results demonstrate that the proportion label perturbation and loss weighting achieve classification accuracy comparable to that obtained without sampling. Our codes are available at https://github.com/stainlessnight/LLP-LargeBags.