mlsanityData to 14 Oct 2026

Rapid Grassmannian Averaging with Chebyshev Polynomials

arXiv 2410.08956 ↗First posted 11 Oct 2024math.NA cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose new algorithms to efficiently average a collection of points on a Grassmannian manifold in both the centralized and decentralized settings. Grassmannian points are used ubiquitously in machine learning, computer vision, and signal processing to represent data through (often low-dimensional) subspaces. While averaging these points is crucial to many tasks (especially in the decentralized setting), existing methods unfortunately remain computationally expensive due to the non-Euclidean geometry of the manifold. Our proposed algorithms, Rapid Grassmannian Averaging (RGrAv) and Decentralized Rapid Grassmannian Averaging (DRGrAv), overcome this challenge by leveraging the spectral structure of the problem to rapidly compute an average using only small matrix multiplications and QR factorizations. We provide a theoretical guarantee of optimality and present numerical experiments which demonstrate that our algorithms outperform state-of-the-art methods in providing high accuracy solutions in minimal time. Additional experiments showcase the versatility of our algorithms to tasks such as K-means clustering on video motion data, establishing RGrAv and DRGrAv as powerful tools for generic Grassmannian averaging.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 56 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

14 of 56 references.

References · 14

  1. 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
  2. 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 138
  3. 2017Network Topology and Communication-Computation Tradeoffs in Decentralized Optimizationcited by 122
  4. 2021Decentralized Federated Averagingcited by 114
  5. 2016Building Deep Networks on Grassmann Manifoldscited by 58
  6. 2021Decentralized Riemannian Gradient Descent on the Stiefel Manifoldcited by 33
  7. 2021DeEPCA: Decentralized Exact PCA with Linear Convergence Ratecited by 18
  8. 2013Dictionary Learning and Sparse Coding on Grassmann Manifolds: An Extrinsic Solutioncited by 13
  9. 2023Decentralized projected Riemannian gradient method for smooth optimization on compact submanifoldscited by 9
  10. 2021A Linearly Convergent Algorithm for Distributed Principal Component Analysiscited by 8
  11. 2023Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifoldcited by 7
  12. 2023Scalable and Privacy-Preserving Federated Principal Component Analysiscited by 5
2 more
  1. 2021Distributed Principal Subspace Analysis for Partitioned Big Data: Algorithms, Analysis, and Implementationcited by 4
  2. 2024Huber means on Riemannian manifoldscited by 3

Built on by

Not cited yet.