Mixture Proportion Estimation via Kernel Embedding of Distributions
Not on the map. Why?
Abstract (arXiv)
Mixture proportion estimation (MPE) is the problem of estimating the weight of a component distribution in a mixture, given samples from the mixture and component. This problem constitutes a key part in many "weakly supervised learning" problems like learning with positive and unlabelled samples, learning with label noise, anomaly detection and crowdsourcing. While there have been several methods proposed to solve this problem, to the best of our knowledge no efficient algorithm with a proven convergence rate towards the true proportion exists for this problem. We fill this gap by constructing a provably correct algorithm for MPE, and derive convergence rates under certain assumptions on the distribution. Our method is based on embedding distributions onto an RKHS, and implementing it only requires solving a simple convex quadratic programming problem a few times. We run our algorithm on several standard classification datasets, and demonstrate that it performs comparably to or better than other algorithms on most datasets.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 13; 2023: 11; 2024: 9; 2025: 13; 2026: 13.
67 papers.
Sort:
By area:
- 2021To Smooth or Not? When Label Smoothing Meets Noisy Labelscited by 70
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Mixture Proportion Estimation and PU Learning: A Modern Approachcited by 52
- 2022Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspectivecited by 37
- 2021Unsupervised Domain Adaptation of Black-Box Source Modelscited by 32
- 2022Domain Adaptation under Open Set Label Shiftcited by 32
- 2022ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentationcited by 26
- 2022Adapting to Online Label Shift with Provable Guaranteescited by 26
- 2022Learnware: Small Models Do Bigcited by 16
- 2024Label-Noise Robust Diffusion Modelscited by 16
- 2023Learning with Complementary Labels Revisited: The Selected-Completely-at-Random Setting Is More Practicalcited by 10
- 2023Mixture Proportion Estimation Beyond Irreducibilitycited by 9
38 more
- 2023Beyond Myopia: Learning from Positive and Unlabeled Data through Holistic Predictive Trendscited by 9
- 2021Quantifying disparities in intimate partner violence: a machine learning method to correct for underreportingcited by 8
- 2022Positive Unlabeled Contrastive Learningcited by 8
- 2022Positive-Unlabeled Learning using Random Forests via Recursive Greedy Risk Minimizationcited by 8
- 2023ZScribbleSeg: Zen and the Art of Scribble Supervised Medical Image Segmentationcited by 8
- 2023Class Prior-Free Positive-Unlabeled Learning with Taylor Variational Loss for Hyperspectral Remote Sensing Imagerycited by 8
- 2021Positive-Unlabeled Classification under Class-Prior Shift: A Prior-invariant Approach Based on Density Ratio Estimationcited by 7
- 2021Self-paced Resistance Learning against Overfitting on Noisy Labelscited by 6
- 2022One-Class Risk Estimation for One-Class Hyperspectral Image Classificationcited by 6
- 2025Learning from positive and unlabeled examples -Finite size sample boundscited by 6
- 2023Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervisioncited by 4
- 2024Robust Offline Imitation Learning from Diverse Auxiliary Datacited by 4
- 2022Double logistic regression approach to biased positive-unlabeled datacited by 3
- 2024Positive and Unlabeled Data: Model, Estimation, Inference, and Classificationcited by 3
- 2025Rethinking Consistent Multi-Label Classification Under Inexact Supervisioncited by 3
- 2023Leveraging Contaminated Datasets to Learn Clean-Data Distribution with Purified Generative Adversarial Networkscited by 2
- 2023Binary Classification with Instance and Label Dependent Label Noisecited by 2
- 2023A Generalized Unbiased Risk Estimator for Learning with Augmented Classescited by 2
- 2024Deep Positive-Unlabeled Anomaly Detection for Contaminated Unlabeled Datacited by 2
- 2024Unraveling the Impact of Heterophilic Structures on Graph Positive-Unlabeled Learningcited by 2
- 2024Meta-learning for Positive-unlabeled Classificationcited by 2
- 2025Positive-Unlabeled Diffusion Models for Preventing Sensitive Data Generationcited by 2
- 2021A Novel Perspective for Positive-Unlabeled Learning via Noisy Labelscited by 1
- 2022Learning from Positive and Unlabeled Data with Augmented Classescited by 1
- 2024Verifying the Selected Completely at Random Assumption in Positive-Unlabeled Learningcited by 1
- 2025Weakly-Supervised Contrastive Learning for Imprecise Class Labelscited by 1
- 2025Conformal Data Contamination Tests for In-distribution Data Acquisitioncited by 1
- 2025Accessible, Realistic, and Fair Evaluation of Positive-Unlabeled Learning Algorithmscited by 1
- 2026SMI: Statistical Membership Inference for Reliable Unlearned Model Auditingcited by 1
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shiftcited by 1
- 2022Risk bounds for PU learning under Selected At Random assumptioncited by 0
- 2022A Boosting Algorithm for Positive-Unlabeled Learningcited by 0
- 2022Complementary Labels Learning with Augmented Classescited by 0
- 2023Positive Unlabeled Learning Selected Not At Random (PULSNAR): class proportion estimation when the SCAR assumption does not holdcited by 0
- 2023Regression with Sensor Data Containing Incomplete Observationscited by 0
- 2024An Unbiased Risk Estimator for Partial Label Learning with Augmented Classescited by 0
- 2024ESA: Example Sieve Approach for Multi-Positive and Unlabeled Learningcited by 0
- 2025Prior shift estimation for positive unlabeled data through the lens of kernel embeddingcited by 0
50 most cited of 67 All 67 (JSON)
- 2026Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classification30 Sep 2026
- 2026GeoCFM: Positive-Only Conditional Flow Matching for Mineral Occurrence Sampling28 Sep 2026
- 2026Partial AUC Maximization from Positive-unlabeled Data25 Sep 2026
- 2026When Is Benchmark Contamination Detectable? Information Limits and Power-Calibrated Audits8 Aug 2026
- 2026Recent advances in weakly supervised learning: New supervision paradigms, assumption relaxations, and practical solutions7 Aug 2026
- 2026Generalized Distribution-Free Semi-Supervised Learning with Risk Rewrite11 Jul 2026
- 2026Dataset Usage Inference without Shadow Models or Held-out Data24 Jun 2026
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift23 Jun 2026
- 2026AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection7 Jun 2026
- 2026Focused PU learning from imbalanced data14 May 2026
- 2026ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision7 May 2026
- 2026Mixture Proportion Estimation and Weakly-supervised Kernel Test for Conditional Independence8 Apr 2026
38 more
- 2026SMI: Statistical Membership Inference for Reliable Unlearned Model Auditing1 Feb 2026
- 2025Angular Regularization for Positive-Unlabeled Learning on the Hypersphere7 Dec 2025
- 2025Rethinking Consistent Multi-Label Classification Under Inexact Supervision5 Oct 2025
- 2025Noisy-Pair Robust Representation Alignment for Positive-Unlabeled Learning30 Sep 2025
- 2025Accessible, Realistic, and Fair Evaluation of Positive-Unlabeled Learning Algorithms29 Sep 2025
- 2025Unsupervised Domain Adaptation for Binary Classification with an Unobservable Source Subpopulation24 Sep 2025
- 2025Semiparametric Learning from Open-Set Label Shift Data18 Sep 2025
- 2025Conformal Data Contamination Tests for In-distribution Data Acquisition18 Jul 2025
- 2025Learning from positive and unlabeled examples -Finite size sample bounds10 Jul 2025
- 2025Weakly-Supervised Contrastive Learning for Imprecise Class Labels28 May 2025
- 2025Unsupervised Latent Pattern Analysis for Estimating Type 2 Diabetes Risk in Undiagnosed Populations27 May 2025
- 2025On the Learning with Augmented Class via Forests14 May 2025
- 2025Positive-Unlabeled Diffusion Models for Preventing Sensitive Data Generation5 Mar 2025
- 2025Prior shift estimation for positive unlabeled data through the lens of kernel embedding28 Feb 2025
- 2024ESA: Example Sieve Approach for Multi-Positive and Unlabeled Learning3 Dec 2024
- 2024Robust Offline Imitation Learning from Diverse Auxiliary Data4 Oct 2024
- 2024An Unbiased Risk Estimator for Partial Label Learning with Augmented Classes29 Sep 2024
- 2024Positive and Unlabeled Data: Model, Estimation, Inference, and Classification13 Jul 2024
- 2024Meta-learning for Positive-unlabeled Classification6 Jun 2024
- 2024Unraveling the Impact of Heterophilic Structures on Graph Positive-Unlabeled Learning30 May 2024
- 2024Deep Positive-Unlabeled Anomaly Detection for Contaminated Unlabeled Data29 May 2024
- 2024Verifying the Selected Completely at Random Assumption in Positive-Unlabeled Learning29 Mar 2024
- 2024Label-Noise Robust Diffusion Models27 Feb 2024
- 2023Learning with Complementary Labels Revisited: The Selected-Completely-at-Random Setting Is More Practical27 Nov 2023
- 2023Beyond Myopia: Learning from Positive and Unlabeled Data through Holistic Predictive Trends6 Oct 2023
- 2023Class Prior-Free Positive-Unlabeled Learning with Taylor Variational Loss for Hyperspectral Remote Sensing Imagery29 Aug 2023
- 2023Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervision12 Jun 2023
- 2023A Generalized Unbiased Risk Estimator for Learning with Augmented Classes12 Jun 2023
- 2023Binary Classification with Instance and Label Dependent Label Noise6 Jun 2023
- 2023Mixture Proportion Estimation Beyond Irreducibility2 Jun 2023
- 2023Regression with Sensor Data Containing Incomplete Observations26 Apr 2023
- 2023Positive Unlabeled Learning Selected Not At Random (PULSNAR): class proportion estimation when the SCAR assumption does not hold14 Mar 2023
- 2023Leveraging Contaminated Datasets to Learn Clean-Data Distribution with Purified Generative Adversarial Networks3 Feb 2023
- 2023ZScribbleSeg: Zen and the Art of Scribble Supervised Medical Image Segmentation12 Jan 2023
- 2022Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspective6 Dec 2022
- 2022Complementary Labels Learning with Augmented Classes19 Nov 2022
- 2022One-Class Risk Estimation for One-Class Hyperspectral Image Classification27 Oct 2022
- 2022Positive-Unlabeled Learning using Random Forests via Recursive Greedy Risk Minimization16 Oct 2022
50 newest of 67 All 67 (JSON)
- 2021To Smooth or Not? When Label Smoothing Meets Noisy Labelscited by 70
- 2021Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularizationcited by 62
- 2021Mixture Proportion Estimation and PU Learning: A Modern Approachcited by 52
- 2022Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspectivecited by 37
- 2021Unsupervised Domain Adaptation of Black-Box Source Modelscited by 32
- 2022Domain Adaptation under Open Set Label Shiftcited by 32
- 2022ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentationcited by 26
- 2022Adapting to Online Label Shift with Provable Guaranteescited by 26
- 2022Learnware: Small Models Do Bigcited by 16
- 2023Learning with Complementary Labels Revisited: The Selected-Completely-at-Random Setting Is More Practicalcited by 10
- 2023Mixture Proportion Estimation Beyond Irreducibilitycited by 9
- 2023Beyond Myopia: Learning from Positive and Unlabeled Data through Holistic Predictive Trendscited by 9
12 most cited of 62 All 62 (JSON)
- 2026Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classification30 Sep 2026
- 2026Partial AUC Maximization from Positive-unlabeled Data25 Sep 2026
- 2026When Is Benchmark Contamination Detectable? Information Limits and Power-Calibrated Audits8 Aug 2026
- 2026Recent advances in weakly supervised learning: New supervision paradigms, assumption relaxations, and practical solutions7 Aug 2026
- 2026Generalized Distribution-Free Semi-Supervised Learning with Risk Rewrite11 Jul 2026
- 2026Dataset Usage Inference without Shadow Models or Held-out Data24 Jun 2026
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift23 Jun 2026
- 2026AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection7 Jun 2026
- 2026Focused PU learning from imbalanced data14 May 2026
- 2026ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision7 May 2026
- 2026Mixture Proportion Estimation and Weakly-supervised Kernel Test for Conditional Independence8 Apr 2026
- 2025Angular Regularization for Positive-Unlabeled Learning on the Hypersphere7 Dec 2025
12 newest of 62 All 62 (JSON)