Optimal high-dimensional and nonparametric distributed testing under communication constraints
Not on the map. Why?
Abstract (arXiv)
We derive minimax testing errors in a distributed framework where the data is split over multiple machines and their communication to a central machine is limited to b bits. We investigate both the d- and infinite-dimensional signal detection problem under Gaussian white noise. We also derive distributed testing algorithms reaching the theoretical lower bounds. Our results show that distributed testing is subject to fundamentally different phenomena that are not observed in distributed estimation. Among our findings, we show that testing protocols that have access to shared randomness can perform strictly better in some regimes than those that do not. We also observe that consistent nonparametric distributed testing is always possible, even with as little as 1-bit of communication and the corresponding test outperforms the best local test using only the information available at a single local machine. Furthermore, we also derive adaptive nonparametric distributed testing strategies and the corresponding theoretical lower bounds.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 45 references that are in the map. First posted on arXiv 2 Feb 2022.
Builds on
13 of 45 references.
References · 13
- 2015Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequalitycited by 50
- 2018Geometric Lower Bounds for Distributed Parameter Estimation under Communication Constraintscited by 33
- 2018Inference under Information Constraints I: Lower Bounds from Chi-Square Contractioncited by 31
- 2013Fundamental Limits of Online and Distributed Algorithms for Statistical Learning and Estimationcited by 23
- 2019Inference under Information Constraints II: Communication Constraints and Shared Randomnesscited by 22
- 2020Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithmscited by 16
- 2017Hypothesis Testing For Densities and High-Dimensional Multinomials: Sharp Local Minimax Ratescited by 11
- 2014Optimality guarantees for distributed statistical estimationcited by 9
- 2018Adaptive distributed methods under communication constraintscited by 9
- 2018Distributed Nonparametric Regression under Communication Constraintscited by 7
- 2020Distributed function estimation: adaptation using minimal communicationcited by 6
- 2020Optimal distributed composite testing in high-dimensional Gaussian models with 1-bit communicationcited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2.
3 papers.
- 2024Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraintscited by 7
- 2024Federated Nonparametric Hypothesis Testing with Differential Privacy Constraints: Optimal Rates and Adaptive Testscited by 5
- 2022Distributed Nonparametric Estimation under Communication Constraintscited by 2
- 2024Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraints10 Jun 2024
- 2024Federated Nonparametric Hypothesis Testing with Differential Privacy Constraints: Optimal Rates and Adaptive Tests10 Jun 2024
- 2022Distributed Nonparametric Estimation under Communication Constraints21 Apr 2022