mlsanityData to 7 Oct 2026

Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes

arXiv 2604.07796 ↗First posted 9 Apr 2026stat.ML cs.IT cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample exceeds a sequentially chosen threshold. Our estimator is (ε, δ)-PAC for any distribution with a bounded mean μ ∈ [-λ, λ] and a bounded k-th central moment mathbbE[|X-μ|k] ≤ σk for any fixed k > 1. Moreover, our sample complexity is order-optimal in all such tail regimes, i.e., for every such k value. For k neq 2, our estimator's sample complexity matches the unquantized minimax lower bounds plus an unavoidable O(log(λ/σ)) localization cost. For the finite-variance case (k=2), our estimator's sample complexity has an extra multiplicative O(log(σ/ε)) penalty, and we establish a novel information-theoretic lower bound showing that this penalty is a fundamental limit of 1-bit quantization. We also establish a significant adaptivity gap: for both threshold queries and more general interval queries, the sample complexity of any non-adaptive estimator must scale linearly with the search space parameter λ/σ, rendering it vastly less sample efficient than our adaptive approach. Finally, we present algorithmic variants that (i) handle an unknown sampling budget, (ii) adapt to an unknown scale parameter σ given (possibly loose) bounds, (iii) require only two stages of adaptivity to achieve order-optimal sample complexity at the expense of more general 1-bit queries, and (iv) leverage multiple local samples per 1-bit query to proportionally reduce communication costs.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 37 of its 69 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

37 of 69 references.

References · 37

  1. 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
  2. 2013lil' UCB : An Optimal Exploration Algorithm for Multi-Armed Banditscited by 148
  3. 2016Distributed Mean Estimation with Limited Communicationcited by 134
  4. 2019Mean estimation and regression under heavy-tailed distributions--a surveycited by 133
  5. 2021EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learningcited by 53
  6. 2021DRIVE: One-bit Distributed Mean Estimationcited by 52
  7. 2015Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequalitycited by 50
  8. 2017Sub-Gaussian estimators of the mean of a random vectorcited by 47
  9. 2016Randomized Distributed Mean Estimation: Accuracy vs Communicationcited by 39
  10. 2018Geometric Lower Bounds for Distributed Parameter Estimation under Communication Constraintscited by 33
  11. 2018Inference under Information Constraints I: Lower Bounds from Chi-Square Contractioncited by 31
  12. 2014On Communication Cost of Distributed Statistical Estimation and Dimensionalitycited by 24
25 more
  1. 2013Fundamental Limits of Online and Distributed Algorithms for Statistical Learning and Estimationcited by 23
  2. 2019Inference under Information Constraints II: Communication Constraints and Shared Randomnesscited by 22
  3. 2020Unified lower bounds for interactive high-dimensional estimation under information constraintscited by 22
  4. 2020Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithmscited by 16
  5. 2021Solving Multi-Arm Bandit Using a Few Bits of Communicationcited by 16
  6. 2020Interactive Inference under Information Constraintscited by 15
  7. 2022Correlated quantization for distributed mean estimation and optimizationcited by 14
  8. 2020Optimal Mean Estimation without a Variancecited by 13
  9. 2021Pricing Query Complexity of Revenue Maximizationcited by 12
  10. 2018Adaptive distributed methods under communication constraintscited by 9
  11. 2021Optimal Rates for Nonparametric Density Estimation under Communication Constraintscited by 9
  12. 2019Mean Estimation from One-Bit Measurementscited by 8
  13. 2018Distributed Nonparametric Regression under Communication Constraintscited by 7
  14. 2023Efficient median of means estimatorcited by 7
  15. 2020Distributed function estimation: adaptation using minimal communicationcited by 6
  16. 2025Sequential 1-bit Mean Estimation with Near-Optimal Sample Complexitycited by 5
  17. 2021Distributed Nonparametric Function Estimation: Optimal Rate of Convergence and Cost of Adaptationcited by 4
  18. 2023Communication-Constrained Bandits under Additive Gaussian Noisecited by 4
  19. 2023Optimality in Mean Estimation: Beyond Worst-Case, Beyond Sub-Gaussian, and Beyond 1+α Momentscited by 4
  20. 2023Beyond Catoni: Sharper Rates for Heavy-Tailed and Robust Mean Estimationcited by 4
  21. 2025Quantile Multi-Armed Bandits with 1-bit Feedbackcited by 4
  22. 2026Robust Mean Estimation under Quantizationcited by 4
  23. 2023Sharp Noisy Binary Search with Monotonic Probabilitiescited by 3
  24. 2022Distributed Nonparametric Estimation under Communication Constraintscited by 2
  25. 2025Generalized Linear Models with 1-Bit Measurements: Asymptotics of the Maximum Likelihood Estimatorcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.