Learning from N-Tuple Data with M Positive Instances: Unbiased Risk Estimation and Theoretical Guarantees
Not on the map. Why?
Abstract (arXiv)
Weakly supervised learning often operates with coarse aggregate signals rather than instance labels. We study a setting where each training example is an n-tuple containing exactly m positives, while only the count m per tuple is observed. This NTMP (N-tuple with M positives) supervision arises in, e.g., image classification with region proposals and multi-instance measurements. We show that tuple counts admit a trainable unbiased risk estimator (URE) by linking the tuple-generation process to latent instance marginals. Starting from fixed (n,m), we derive a closed-form URE and extend it to variable tuple sizes, variable counts, and their combination. Identification holds whenever the effective mixing rate is separated from the class prior. We establish generalization bounds via Rademacher complexity and prove statistical consistency with standard rates under mild regularity assumptions. To improve finite-sample stability, we introduce simple ReLU corrections to the URE that preserve asymptotic correctness. Across benchmarks converted to NTMP tasks, the approach consistently outperforms representative weak-supervision baselines and yields favorable precision-recall and F1 trade-offs. It remains robust under class-prior imbalance and across diverse tuple configurations, demonstrating that count-only supervision can be exploited effectively through a theoretically grounded and practically stable objective.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
22 of 50 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2017Positive-Unlabeled Learning with Non-Negative Risk Estimatorcited by 219
- 2018Learning from positive and unlabeled data: a surveycited by 219
- 2016Multiple Instance Learning: A Survey of Problem Characteristics and Applicationscited by 164
- 2020Progressive Identification of True Labels for Partial-Label Learningcited by 102
- 2017Learning with Biased Complementary Labelscited by 93
- 2017Learning from Complementary Labelscited by 88
10 more
- 2018Complementary-Label Learning for Arbitrary Losses and Modelscited by 57
- 2019Partial Label Learning with Self-Guided Retrainingcited by 47
- 2018On the Minimal Supervision for Training Any Binary Classifier from Only Unlabeled Datacited by 43
- 2018Classification from Pairwise Similarity and Unlabeled Datacited by 36
- 2019Mitigating Overfitting in Supervised Classification from Two Unlabeled Datasets: A Consistent Risk Correction Approachcited by 29
- 2019Learning from Label Proportions with Generative Adversarial Networkscited by 25
- 2017Binary Classification from Positive-Confidence Datacited by 23
- 2020Binary Classification from Positive Data with Skewed Confidencecited by 8
- 2019Classification from Triplet Comparison Datacited by 6
- 2020Multi-Complementary and Unlabeled Learning for Arbitrary Losses and Modelscited by 5
Built on by
Not cited yet.