Distributed Fixed Point Methods with Compressed Iterates
Not on the map. Why?
Abstract (arXiv)
We propose basic and natural assumptions under which iterative optimization methods with compressed iterates can be analyzed. This problem is motivated by the practice of federated learning, where a large model stored in the cloud is compressed before it is sent to a mobile device, which then proceeds with training based on local data. We develop standard and variance reduced methods, and establish communication complexity bounds. Our algorithms are the first distributed methods with compressed iterates, and the first fixed point methods with compressed iterates.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 3; 2024: 1; 2025: 2.
11 papers.
- 2023DoCoFL: Downlink Compression for Cross-Device Federated Learningcited by 28
- 2021Partial Variable Training for Efficient On-Device Federated Learningcited by 14
- 2022Federated Random Reshuffling with Compression and Variance Reductioncited by 12
- 2023Improving Accelerated Federated Learning with Compression and Importance Samplingcited by 8
- 2022Online Model Compression for Federated Learning with Large Modelscited by 7
- 2022Shifted Compression Framework: Generalizations and Improvementscited by 6
- 2022Personalized Federated Learning with Communication Compressioncited by 6
- 2023Towards a Better Theoretical Understanding of Independent Subnetwork Trainingcited by 6
- 2024Local Methods with Adaptivity via Scalingcited by 1
- 2025Tight analyses of first-order methods with error feedbackcited by 1
- 2025First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptionscited by 1
- 2025First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptions25 Dec 2025
- 2025Tight analyses of first-order methods with error feedback5 Jun 2025
- 2024Local Methods with Adaptivity via Scaling2 Jun 2024
- 2023Towards a Better Theoretical Understanding of Independent Subnetwork Training28 Jun 2023
- 2023Improving Accelerated Federated Learning with Compression and Importance Sampling5 Jun 2023
- 2023DoCoFL: Downlink Compression for Cross-Device Federated Learning1 Feb 2023
- 2022Personalized Federated Learning with Communication Compression12 Sep 2022
- 2022Shifted Compression Framework: Generalizations and Improvements21 Jun 2022
- 2022Federated Random Reshuffling with Compression and Variance Reduction8 May 2022
- 2022Online Model Compression for Federated Learning with Large Models6 May 2022
- 2021Partial Variable Training for Efficient On-Device Federated Learning11 Oct 2021