# On the matrix square root via geometric optimization

arXiv: https://arxiv.org/abs/1507.08366 · HTML: https://mlsanity.com/paper/1507.08366/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Jul 2015.

## Built on by (most cited first, 3 of 3)

- [Low-complexity subspace-descent over symmetric positive definite manifold](https://mlsanity.com/paper/2305.02041/) (2023)
- [On a class of geodesically convex optimization problems solved via Euclidean MM methods](https://mlsanity.com/paper/2206.11426/) (2022)
- [Disciplined Geodesically Convex Programming](https://mlsanity.com/paper/2407.05261/) (2024)

## Abstract (arXiv)

This paper is triggered by the preprint "Computing Matrix Squareroot via Non Convex Local Search" by Jain et al. (textittextcolorbluearXiv:1507.05854), which analyzes gradient-descent for computing the square root of a positive definite matrix. Contrary to claims of~citetjain2015, our experiments reveal that Newton-like methods compute matrix square roots rapidly and reliably, even for highly ill-conditioned matrices and without requiring commutativity. We observe that gradient-descent converges very slowly primarily due to tiny step-sizes and ill-conditioning. We derive an alternative first-order method based on geodesic convexity: our method admits a transparent convergence analysis (< 1 page), attains linear rate, and displays reliable convergence even for rank deficient problems. Though superior to gradient-descent, ultimately our method is also outperformed by a well-known scaled Newton method. Nevertheless, the primary value of our work is its conceptual value: it shows that for deriving gradient based methods for the matrix square root, the manifold geometric view of positive definite matrices can be much more advantageous than the Euclidean view.
