Phase Transitions in the Pooled Data Problem
Not on the map. Why?
Abstract (arXiv)
In this paper, we study the pooled data problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we identify an exact asymptotic threshold on the required number of tests with optimal decoding, and prove a phase transition between complete success and complete failure. In addition, we present a novel noisy variation of the problem, and provide an information-theoretic framework for characterizing the required number of tests for general random noise models. Our results reveal that noise can make the problem considerably more difficult, with strict increases in the scaling laws even at low noise levels. Finally, we demonstrate similar behavior in an approximate recovery setting, where a given number of errors is allowed in the decoded labels.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 0; 2025: 1.
6 papers.
- 2023Learning from Label Proportions: Bootstrapping Supervised Learners via Belief Propagationcited by 7
- 2022Distributed Reconstruction of Noisy Pooled Datacited by 1
- 2023Efficient Neural Network based Classification and Outlier Detection for Image Moderation using Compressed Sensing and Group Testingcited by 1
- 2023Efficient Approximate Recovery from Pooled Data Using Doubly Regular Pooling Schemescited by 0
- 2023On a Near-Optimal & Efficient Algorithm for the Sparse Pooled Data Problemcited by 0
- 2025Verifiable Deep Quantitative Group Testingcited by 0
- 2025Verifiable Deep Quantitative Group Testing8 Dec 2025
- 2023On a Near-Optimal & Efficient Algorithm for the Sparse Pooled Data Problem22 Dec 2023
- 2023Learning from Label Proportions: Bootstrapping Supervised Learners via Belief Propagation12 Oct 2023
- 2023Efficient Neural Network based Classification and Outlier Detection for Image Moderation using Compressed Sensing and Group Testing12 May 2023
- 2023Efficient Approximate Recovery from Pooled Data Using Doubly Regular Pooling Schemes28 Feb 2023
- 2022Distributed Reconstruction of Noisy Pooled Data14 Apr 2022