Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes
Not on the map. Why?
Abstract (arXiv)
In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample exceeds a sequentially chosen threshold. Our estimator is (ε, δ)-PAC for any distribution with a bounded mean μ ∈ [-λ, λ] and a bounded k-th central moment mathbbE[|X-μ|k] ≤ σk for any fixed k > 1. Moreover, our sample complexity is order-optimal in all such tail regimes, i.e., for every such k value. For k neq 2, our estimator's sample complexity matches the unquantized minimax lower bounds plus an unavoidable O(log(λ/σ)) localization cost. For the finite-variance case (k=2), our estimator's sample complexity has an extra multiplicative O(log(σ/ε)) penalty, and we establish a novel information-theoretic lower bound showing that this penalty is a fundamental limit of 1-bit quantization. We also establish a significant adaptivity gap: for both threshold queries and more general interval queries, the sample complexity of any non-adaptive estimator must scale linearly with the search space parameter λ/σ, rendering it vastly less sample efficient than our adaptive approach. Finally, we present algorithmic variants that (i) handle an unknown sampling budget, (ii) adapt to an unknown scale parameter σ given (possibly loose) bounds, (iii) require only two stages of adaptivity to achieve order-optimal sample complexity at the expense of more general 1-bit queries, and (iv) leverage multiple local samples per 1-bit query to proportionally reduce communication costs.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 37 of its 69 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
37 of 69 references.
References · 37
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
- 2013lil' UCB : An Optimal Exploration Algorithm for Multi-Armed Banditscited by 148
- 2016Distributed Mean Estimation with Limited Communicationcited by 134
- 2019Mean estimation and regression under heavy-tailed distributions--a surveycited by 133
- 2021EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learningcited by 53
- 2021DRIVE: One-bit Distributed Mean Estimationcited by 52
- 2015Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequalitycited by 50
- 2017Sub-Gaussian estimators of the mean of a random vectorcited by 47
- 2016Randomized Distributed Mean Estimation: Accuracy vs Communicationcited by 39
- 2018Geometric Lower Bounds for Distributed Parameter Estimation under Communication Constraintscited by 33
- 2018Inference under Information Constraints I: Lower Bounds from Chi-Square Contractioncited by 31
- 2014On Communication Cost of Distributed Statistical Estimation and Dimensionalitycited by 24
25 more
- 2013Fundamental Limits of Online and Distributed Algorithms for Statistical Learning and Estimationcited by 23
- 2019Inference under Information Constraints II: Communication Constraints and Shared Randomnesscited by 22
- 2020Unified lower bounds for interactive high-dimensional estimation under information constraintscited by 22
- 2020Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithmscited by 16
- 2021Solving Multi-Arm Bandit Using a Few Bits of Communicationcited by 16
- 2020Interactive Inference under Information Constraintscited by 15
- 2022Correlated quantization for distributed mean estimation and optimizationcited by 14
- 2020Optimal Mean Estimation without a Variancecited by 13
- 2021Pricing Query Complexity of Revenue Maximizationcited by 12
- 2018Adaptive distributed methods under communication constraintscited by 9
- 2021Optimal Rates for Nonparametric Density Estimation under Communication Constraintscited by 9
- 2019Mean Estimation from One-Bit Measurementscited by 8
- 2018Distributed Nonparametric Regression under Communication Constraintscited by 7
- 2023Efficient median of means estimatorcited by 7
- 2020Distributed function estimation: adaptation using minimal communicationcited by 6
- 2025Sequential 1-bit Mean Estimation with Near-Optimal Sample Complexitycited by 5
- 2021Distributed Nonparametric Function Estimation: Optimal Rate of Convergence and Cost of Adaptationcited by 4
- 2023Communication-Constrained Bandits under Additive Gaussian Noisecited by 4
- 2023Optimality in Mean Estimation: Beyond Worst-Case, Beyond Sub-Gaussian, and Beyond 1+α Momentscited by 4
- 2023Beyond Catoni: Sharper Rates for Heavy-Tailed and Robust Mean Estimationcited by 4
- 2025Quantile Multi-Armed Bandits with 1-bit Feedbackcited by 4
- 2026Robust Mean Estimation under Quantizationcited by 4
- 2023Sharp Noisy Binary Search with Monotonic Probabilitiescited by 3
- 2022Distributed Nonparametric Estimation under Communication Constraintscited by 2
- 2025Generalized Linear Models with 1-Bit Measurements: Asymptotics of the Maximum Likelihood Estimatorcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Open Problem: Is Interaction Necessary for Order-Optimal 1-bit Mean Estimation?cited by 2
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraintscited by 1
- 2026Interaction Is Not Necessary for Order-Optimal 1-Bit Mean Estimationcited by 1
- 2026VALG: An Agentic System for ML Theory Researchcited by 1
- 2026Exact Minimax One-Bit Unbiased Compression: Heavy-Tail Necessity and Finite-Randomness Approximationcited by 0
- 2026Exact Minimax One-Bit Unbiased Compression: Heavy-Tail Necessity and Finite-Randomness Approximation20 Aug 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026Interaction Is Not Necessary for Order-Optimal 1-Bit Mean Estimation3 Aug 2026
- 2026Open Problem: Is Interaction Necessary for Order-Optimal 1-bit Mean Estimation?3 Jul 2026
- 2026Batched Stochastic Linear Bandits with 1-Bit Communication Constraints29 May 2026