# Density Operator Expectation Maximization

arXiv: https://arxiv.org/abs/2507.22786 · HTML: https://mlsanity.com/paper/2507.22786/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 91 references that are in the map.
- First posted on arXiv 30 Jul 2025.

## Builds on (most cited first, 18 of 18)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms](https://mlsanity.com/paper/1708.07747/) (2017)
- [Deep Learning Face Attributes in the Wild](https://mlsanity.com/paper/1411.7766/) (2014)
- [q-means: A quantum algorithm for unsupervised machine learning](https://mlsanity.com/paper/1812.03584/) (2018)
- [Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models](https://mlsanity.com/paper/1609.02542/) (2016)
- [On the Sample Complexity of Quantum Boltzmann Machine Learning](https://mlsanity.com/paper/2306.14969/) (2023)
- [Gaussian-Bernoulli RBMs Without Tears](https://mlsanity.com/paper/2210.10318/) (2022)
- [Generative training of quantum Boltzmann machines with hidden units](https://mlsanity.com/paper/1905.09902/) (2019)
- [Quantum Machine Learning on Near-Term Quantum Devices: Current State of Supervised and Unsupervised Techniques for Real-World Applications](https://mlsanity.com/paper/2307.00908/) (2023)
- [Quantum Boltzmann machine learning of ground-state energies](https://mlsanity.com/paper/2410.12935/) (2024)
- [High-quality Thermal Gibbs Sampling with Quantum Annealing Hardware](https://mlsanity.com/paper/2109.01690/) (2021)
- [Natural gradient and parameter estimation for quantum Boltzmann machines](https://mlsanity.com/paper/2410.24058/) (2024)
- [Quantum Expectation-Maximization for Gaussian Mixture Models](https://mlsanity.com/paper/1908.06657/) (2019)
- [Expressive equivalence of classical and quantum restricted Boltzmann machines](https://mlsanity.com/paper/2502.17562/) (2025)
- [Quantum Expectation-Maximization Algorithm](https://mlsanity.com/paper/1908.06655/) (2019)
- [Quantum algorithm for Petz recovery channels and pretty good measurements](https://mlsanity.com/paper/2006.16924/) (2020)
- [Geometry of EM and related iterative algorithms](https://mlsanity.com/paper/2209.01301/) (2022)
- [End-to-end Training of Deep Boltzmann Machines by Unbiased Contrastive Divergence with Local Mode Initialization](https://mlsanity.com/paper/2305.19684/) (2023)

## Built on by (most cited first, 1 of 1)

- [Quantum Generative Adversarial Autoencoders: Learning latent representations for quantum data generation](https://mlsanity.com/paper/2509.16186/) (2025)

## Abstract (arXiv)

Machine learning with density operators, the mathematical foundation of quantum mechanics, is gaining prominence with rapid advances in quantum computing. Generative models based on density operators cannot yet handle tasks that are routinely handled by probabilistic models. The progress of latent variable models, a broad and influential class of probabilistic unsupervised models, was driven by the Expectation-Maximization framework. Deriving such a framework for density operators is challenging due to the non-commutativity of operators. To tackle this challenge, an inequality arising from the monotonicity of relative entropy is demonstrated to serve as an evidence lower bound for density operators. A minorant-maximization perspective on this bound leads to Density Operator Expectation Maximization (DO-EM), a general framework for training latent variable models defined through density operators. Through an information-geometric argument, the Expectation step in DO-EM is shown to be the Petz recovery map. The DO-EM algorithm is applied to Quantum Restricted Boltzmann Machines, adapting Contrastive Divergence to approximate the Maximization step gradient. Quantum interleaved Deep Boltzmann Machines and Quantum Gaussian-Bernoulli Restricted Boltzmann Machines, new models introduced in this work, outperform their probabilistic counterparts on generative tasks when trained with similar computational resources and identical hyperparameters.
