Communication-efficient distributed eigenspace estimation with arbitrary node failures
Not on the map. Why?
Abstract (arXiv)
We develop an eigenspace estimation algorithm for distributed environments with arbitrary node failures, where a subset of computing nodes can return structurally valid but otherwise arbitrarily chosen responses. Notably, this setting encompasses several important scenarios that arise in distributed computing and data-collection environments such as silent/soft errors, outliers or corrupted data at certain nodes, and adversarial responses. Our estimator builds upon and matches the performance of a recently proposed non-robust estimator up to an additive tildeO(σ √α) error, where σ2 is the variance of the existing estimator and α is the fraction of corrupted nodes.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 48 references that are in the map. First posted on arXiv 31 May 2022.
Builds on
17 of 48 references.
References · 17
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 711
- 2019Robust Aggregation for Federated Learningcited by 317
- 2020Byzantine-Robust Learning on Heterogeneous Datasets via Bucketingcited by 128
- 2020Spectral Methods for Data Science: A Statistical Perspectivecited by 112
- 2019Recent Advances in Algorithmic High-Dimensional Robust Statisticscited by 101
- 2018Byzantine Stochastic Gradient Descentcited by 81
- 2017Resilience: A Criterion for Learning in the Presence of Arbitrary Outlierscited by 43
- 2017Outlier-robust moment-estimation via sum-of-squarescited by 27
- 2019Outlier-Robust High-Dimensional Sparse Estimation via Iterative Filteringcited by 23
- 2020Is Network the Bottleneck of Distributed Training?cited by 20
- 2016Faster Eigenvector Computation via Shift-and-Invert Preconditioningcited by 18
5 more
- 2020Byzantine-Resilient SGD in High Dimensions on Heterogeneous Datacited by 17
- 2014Improved Distributed Principal Component Analysiscited by 14
- 2019A Unified Approach to Robust Mean Estimationcited by 11
- 2017Communication-efficient Algorithms for Distributed Stochastic Principal Component Analysiscited by 10
- 2020Communication-efficient distributed eigenspace estimationcited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.