# Global Convergence of Gradient EM for Over-Parameterized Gaussian Mixtures

arXiv: https://arxiv.org/abs/2506.06584 · HTML: https://mlsanity.com/paper/2506.06584/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Jun 2025.

## Built on by (most cited first, 4 of 4)

- [On the Benefits of Weight Normalization for Overparameterized Matrix Sensing](https://mlsanity.com/paper/2510.01175/) (2025)
- [Global Convergence of Gradient Descent for Score Matching in Gaussian Mixtures via Reverse Fisher Divergence](https://mlsanity.com/paper/2606.19876/) (2026)
- [Local linear convergence of gradient methods for overparameterized Gaussian mixtures](https://mlsanity.com/paper/2605.30936/) (2026)
- [Is √d Separation Necessary for Gradient EM to Learn Gaussian Mixtures in High Dimensions?](https://mlsanity.com/paper/2610.07551/) (2026)

## Abstract (arXiv)

Learning Gaussian Mixture Models (GMMs) is a fundamental problem in statistics and machine learning, with the Expectation-Maximization (EM) algorithm and its popular variant gradient EM being arguably the most widely used algorithms in practice. In the exact-parameterized setting, where both the ground truth GMM and the learning model have the same number of components m, a vast line of work has aimed to establish rigorous recovery guarantees for EM. However, global convergence has only been proven for the case of m=2, and EM is known to fail to recover the ground truth when m≥ 3. In this paper, we consider the textitover-parameterized setting, where the learning model uses n>m components to fit an m-component ground truth GMM. In contrast to the exact-parameterized case, we provide a guarantee for convergence to the globally optimal solution (the ground truth) for gradient EM. Specifically, for any well-separated GMMs, we prove that with only mild over-parameterization n = Omega(mlog m), randomly initialized gradient EM converges to the ground truth with polynomial time and samples. Our analysis proceeds in two stages and introduces a suite of novel tools for Gaussian Mixture analysis to study the dynamics of gradient EM and characterize the geometric landscape of the likelihood loss. This is the first global convergence and recovery result for EM or Gradient EM beyond the special case of m=2.