List-Decodable Coded Computing: Breaking the Adversarial Toleration Barrier
Not on the map. Why?
Abstract (arXiv)
We consider the problem of coded computing, where a computational task is performed in a distributed fashion in the presence of adversarial workers. We propose techniques to break the adversarial toleration threshold barrier previously known in coded computing. More specifically, we leverage list-decoding techniques for folded Reed-Solomon codes and propose novel algorithms to recover the correct codeword using side information. In the coded computing setting, we show how the master node can perform certain carefully designed extra computations to obtain the side information. The workload of computing this side information is negligible compared to the computations done by each worker. This side information is then utilized to prune the output of the list decoder and uniquely recover the true outcome. We further propose folded Lagrange coded computing (FLCC) to incorporate the developed techniques into a specific coded computing setting. Our results show that FLCC outperforms LCC by breaking the barrier on the number of adversaries that can be tolerated. In particular, the corresponding threshold in FLCC is improved by a factor of two asymptotically compared to that of LCC.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 62 references that are in the map. First posted on arXiv 27 Jan 2021.
Builds on
21 of 62 references.
References · 21
- 2020Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learningcited by 78
- 2015Speeding Up Distributed Machine Learning Using Codescited by 76
- 2018Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacycited by 66
- 2017Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplicationcited by 32
- 2020Coded Computing for Low-Latency Federated Learning over Wireless Edge Networkscited by 32
- 2018On the Optimal Recovery Threshold of Coded Matrix Multiplicationcited by 27
- 2020A Scalable Approach for Privacy-Preserving Collaborative Machine Learningcited by 21
- 2019CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learningcited by 20
- 2020Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial Computingcited by 19
- 2020Analog Lagrange Coded Computingcited by 13
- 2017Coded Computation over Heterogeneous Clusterscited by 12
- 2016A Unified Coding Framework for Distributed Computing with Straggling Serverscited by 8
9 more
- 2018A Unified Coded Deep Neural Network Training Strategy Based on Generalized PolyDot Codes for Matrix Multiplicationcited by 8
- 2020Entangled Polynomial Codes for Secure, Private, and Batch Distributed Matrix Multiplication: Breaking the "Cubic" Barriercited by 8
- 2019Edge Computing in the Dark: Leveraging Contextual-Combinatorial Bandit and Coded Computingcited by 4
- 2019Distributed Matrix-Vector Multiplication: A Convolutional Coding Approachcited by 3
- 2019Collaborative Decoding of Polynomial Codes for Distributed Computationcited by 3
- 2020Numerically Stable Binary Gradient Codingcited by 3
- 2020Privacy-Preserving Distributed Learning in the Analog Domaincited by 3
- 2017Coding for Distributed Fog Computingcited by 2
- 2019Coded Distributed Computing: Performance Limits and Code Designscited by 2
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 1.
4 papers.
- 2021ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systemscited by 5
- 2021Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learningcited by 4
- 2023ByzSecAgg: A Byzantine-Resistant Secure Aggregation Scheme for Federated Learning Based on Coded Computing and Vector Commitmentcited by 4
- 2022Generalized Lagrange Coded Computing: A Flexible Computation-Communication Tradeoff for Resilient, Secure, and Private Computationcited by 0
- 2023ByzSecAgg: A Byzantine-Resistant Secure Aggregation Scheme for Federated Learning Based on Coded Computing and Vector Commitment20 Feb 2023
- 2022Generalized Lagrange Coded Computing: A Flexible Computation-Communication Tradeoff for Resilient, Secure, and Private Computation24 Apr 2022
- 2021ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems20 Sep 2021
- 2021Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learning27 Jul 2021