mlsanityData to 14 Oct 2026

EM's Convergence in Gaussian Latent Tree Models

arXiv 2211.11904 ↗First posted 21 Nov 2022cs.LG math.ST stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

We study the optimization landscape of the log-likelihood function and the convergence of the Expectation-Maximization (EM) algorithm in latent Gaussian tree models, i.e. tree-structured Gaussian graphical models whose leaf nodes are observable and non-leaf nodes are unobservable. We show that the unique non-trivial stationary point of the population log-likelihood is its global maximum, and establish that the expectation-maximization algorithm is guaranteed to converge to it in the single latent variable case. Our results for the landscape of the log-likelihood function in general latent tree models provide support for the extensive practical use of maximum likelihood based-methods in this setting. Our results for the EM algorithm extend an emerging line of work on obtaining global convergence guarantees for this celebrated algorithm. We show our results for the non-trivial stationary points of the log-likelihood by arguing that a certain system of polynomial equations obtained from the EM updates has a unique non-trivial solution. The global convergence of the EM algorithm follows by arguing that all trivial fixed points are higher-order saddle points.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 39 references that are in the map. First posted on arXiv 21 Nov 2022.

Builds on

15 of 39 references.

References · 15

  1. 2014Statistical guarantees for the EM algorithm: From population to sample-based analysiscited by 133
  2. 2016Ten Steps of EM Suffice for Mixtures of Two Gaussianscited by 40
  3. 2018Singularity, Misspecification, and the Convergence Rate of EMcited by 38
  4. 2016Global analysis of Expectation Maximization for mixtures of two Gaussianscited by 31
  5. 2019EM Converges for a Mixture of Many Linear Regressionscited by 27
  6. 2018Global Convergence of EM Algorithm for Mixtures of Two Component Linear Regressioncited by 25
  7. 2020On the Minimax Optimality of the EM Algorithm for Learning Two-Component Mixed Linear Regressioncited by 24
  8. 2017Estimating the Coefficients of a Mixture of Two Linear Regressions by Expectation Maximizationcited by 19
  9. 2018Benefits of over-parameterization with EMcited by 10
  10. 2019On the Analysis of EM for truncated mixtures of two Gaussianscited by 10
  11. 2014A Survey on Latent Tree Models and Applicationscited by 5
  12. 2018On the Behavior of the Expectation-Maximization Algorithm for Mixture Modelscited by 4
3 more
  1. 2021Maximum Likelihood Estimation for Brownian Motion Tree Models Based on One Samplecited by 4
  2. 2014Gaussian Tree Constraints Applied to Acoustic Linguistic Functional Datacited by 1
  3. 2015Efficient recycled algorithms for quantitative trait models on phylogeniescited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.