Federated Learning on Riemannian Manifolds
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) has found many important applications in smart-phone-APP based machine learning applications. Although many algorithms have been studied for FL, to the best of our knowledge, algorithms for FL with nonconvex constraints have not been studied. This paper studies FL over Riemannian manifolds, which finds important applications such as federated PCA and federated kPCA. We propose a Riemannian federated SVRG (RFedSVRG) method to solve federated optimization over Riemannian manifolds. We analyze its convergence rate under different scenarios. Numerical experiments are conducted to compare RFedSVRG with the Riemannian counterparts of FedAvg and FedProx. We observed from the numerical experiments that the advantages of RFedSVRG are significant.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 12 Jun 2022.
Builds on
19 of 32 references.
References · 19
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
- 2016Federated Optimization: Distributed Machine Learning for On-Device Intelligencecited by 558
- 2021Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradientscited by 122
- 2013Manopt, a Matlab toolbox for optimization on manifoldscited by 112
- 2020FedSplit: An algorithmic framework for fast federated optimizationcited by 108
- 2016Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiationcited by 93
- 2016First-order Methods for Geodesically Convex Optimizationcited by 92
- 2020From Local SGD to Local Fixed-Point Methods for Federated Learningcited by 74
7 more
- 2016Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifoldscited by 64
- 2016Global rates of convergence for nonconvex optimization on manifoldscited by 61
- 2021Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learningcited by 52
- 2021Decentralized Riemannian Gradient Descent on the Stiefel Manifoldcited by 33
- 2021On the Local Linear Rate of Consensus on the Stiefel Manifoldcited by 8
- 2021Distributed Principal Component Analysis with Limited Communicationcited by 6
- 2017Distributed Optimization on Riemannian Manifolds for multi-agent networkscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 4; 2026: 3.
13 papers.
Sort:
- 2024Federated Learning on Riemannian Manifolds with Differential Privacycited by 5
- 2024Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Datacited by 5
- 2024Riemannian coordinate descent algorithms on matrix manifoldscited by 4
- 2024Riemannian Federated Learning via Averaging Gradient Streamscited by 4
- 2026FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnetcited by 2
- 2024Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reductioncited by 1
- 2025Aggregation on Learnable Manifolds for Asynchronous Federated Optimizationcited by 1
- 2025New Insights on Unfolding and Fine-tuning Quantum Federated Learningcited by 1
- 2025Federated Learning on Riemannian Manifolds: A Gradient-Free Projection-Based Approachcited by 1
- 2023Federated Classification in Hyperbolic Spaces via Secure Aggregation of Convex Hullscited by 0
- 2025ONG: Orthogonal Natural Gradient Descentcited by 0
- 2026Sheaf-Based Federated Representation Learningcited by 0
1 more
- 2026Sheaf-Based Federated Representation Learning8 Aug 2026
- 2026A Stable Aggregation Method for Quantum Federated Learning25 Jun 2026
- 2026FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet24 Apr 2026
- 2025ONG: Orthogonal Natural Gradient Descent24 Aug 2025
- 2025Federated Learning on Riemannian Manifolds: A Gradient-Free Projection-Based Approach30 Jul 2025
- 2025New Insights on Unfolding and Fine-tuning Quantum Federated Learning24 Jun 2025
- 2025Aggregation on Learnable Manifolds for Asynchronous Federated Optimization18 Mar 2025
- 2024Riemannian Federated Learning via Averaging Gradient Streams11 Sep 2024
- 2024Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data12 Jun 2024
- 2024Riemannian coordinate descent algorithms on matrix manifolds4 Jun 2024
- 2024Federated Learning on Riemannian Manifolds with Differential Privacy15 Apr 2024
- 2024Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reduction11 Mar 2024
1 more
- 2024Federated Learning on Riemannian Manifolds with Differential Privacycited by 5
- 2024Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Datacited by 5
- 2024Riemannian coordinate descent algorithms on matrix manifoldscited by 4
- 2024Riemannian Federated Learning via Averaging Gradient Streamscited by 4
- 2026FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnetcited by 2
- 2024Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reductioncited by 1
- 2025Aggregation on Learnable Manifolds for Asynchronous Federated Optimizationcited by 1
- 2025New Insights on Unfolding and Fine-tuning Quantum Federated Learningcited by 1
- 2025Federated Learning on Riemannian Manifolds: A Gradient-Free Projection-Based Approachcited by 1
- 2023Federated Classification in Hyperbolic Spaces via Secure Aggregation of Convex Hullscited by 0
- 2025ONG: Orthogonal Natural Gradient Descentcited by 0
- 2026Sheaf-Based Federated Representation Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Sheaf-Based Federated Representation Learning8 Aug 2026
- 2026A Stable Aggregation Method for Quantum Federated Learning25 Jun 2026
- 2026FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet24 Apr 2026
- 2025ONG: Orthogonal Natural Gradient Descent24 Aug 2025
- 2025Federated Learning on Riemannian Manifolds: A Gradient-Free Projection-Based Approach30 Jul 2025
- 2025New Insights on Unfolding and Fine-tuning Quantum Federated Learning24 Jun 2025
- 2025Aggregation on Learnable Manifolds for Asynchronous Federated Optimization18 Mar 2025
- 2024Riemannian Federated Learning via Averaging Gradient Streams11 Sep 2024
- 2024Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data12 Jun 2024
- 2024Riemannian coordinate descent algorithms on matrix manifolds4 Jun 2024
- 2024Federated Learning on Riemannian Manifolds with Differential Privacy15 Apr 2024
- 2024Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reduction11 Mar 2024
12 newest of 13 All 13 (JSON)