# Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders

arXiv: https://arxiv.org/abs/1703.02435 · HTML: https://mlsanity.com/paper/1703.02435/

## Key facts

- Cited by 47 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Mar 2017.

## Built on by (most cited first, 30 of 47)

- [KAN 2.0: Kolmogorov-Arnold Networks Meet Science](https://mlsanity.com/paper/2408.10205/) (2024)
- [Universal Adversarial Examples and Perturbations for Quantum Classifiers](https://mlsanity.com/paper/2102.07788/) (2021)
- [Interpretable Machine Learning in Physics: A Review](https://mlsanity.com/paper/2503.23616/) (2025)
- [Machine learning discovery of new phases in programmable quantum simulator snapshots](https://mlsanity.com/paper/2112.10789/) (2021)
- [Explainable Representation Learning of Small Quantum States](https://mlsanity.com/paper/2306.05694/) (2023)
- [Artificial intelligence for representing and characterizing quantum systems](https://mlsanity.com/paper/2509.04923/) (2025)
- [Learning Summary Statistics for Bayesian Inference with Autoencoders](https://mlsanity.com/paper/2201.12059/) (2022)
- [Exponentially improved efficient machine learning for quantum many-body states with provable guarantees](https://mlsanity.com/paper/2304.04353/) (2023)
- [Learning minimal representations of stochastic processes with variational autoencoders](https://mlsanity.com/paper/2307.11608/) (2023)
- [Phase Transitions in the Output Distribution of Large Language Models](https://mlsanity.com/paper/2405.17088/) (2024)
- [AdvNF: Reducing Mode Collapse in Conditional Normalising Flows using Adversarial Learning](https://mlsanity.com/paper/2401.15948/) (2024)
- [Interpretable representation learning of quantum data enabled by probabilistic variational autoencoders](https://mlsanity.com/paper/2506.11982/) (2025)
- [Neural network based order parameter for phase transitions and its applications in high-entropy alloys](https://mlsanity.com/paper/2109.05598/) (2021)
- [Unsupervised learning for anticipating critical transitions](https://mlsanity.com/paper/2501.01579/) (2025)
- [Unraveling Quantum Environments: Transformer-Assisted Learning in Lindblad Dynamics](https://mlsanity.com/paper/2505.06928/) (2025)
- [A simple framework for contrastive learning phases of matter](https://mlsanity.com/paper/2205.05607/) (2022)
- [Discovering quantum phenomena with Interpretable Machine Learning](https://mlsanity.com/paper/2604.16015/) (2026)
- [Learning entanglement breakdown as a phase transition by confusion](https://mlsanity.com/paper/2202.00348/) (2022)
- [A Group-Equivariant Autoencoder for Identifying Spontaneously Broken Symmetries](https://mlsanity.com/paper/2202.06319/) (2022)
- [Rotated Digit Recognition by Variational Autoencoders with Fixed Output Distributions](https://mlsanity.com/paper/2206.13388/) (2022)
- [A review of unsupervised learning in astronomy](https://mlsanity.com/paper/2406.17316/) (2024)
- [Advancing Spatio-temporal Storm Surge Prediction with Hierarchical Deep Neural Networks](https://mlsanity.com/paper/2410.12823/) (2024)
- [Disentanglement by means of action-induced representations](https://mlsanity.com/paper/2602.06741/) (2026)
- [Can a CNN trained on the Ising model detect the phase transition of the q-state Potts model?](https://mlsanity.com/paper/2104.03632/) (2021)
- [Weighted Quantum Channel Compiling through Proximal Policy Optimization](https://mlsanity.com/paper/2111.02426/) (2021)
- [Feature extraction of machine learning and phase transition point of Ising model](https://mlsanity.com/paper/2111.11166/) (2021)
- [Inferring topological transitions in pattern-forming processes with self-supervised learning](https://mlsanity.com/paper/2203.10204/) (2022)
- [Machine learning for structure-property relationships: Scalability and limitations](https://mlsanity.com/paper/2304.05502/) (2023)
- [Closed-Form Interpretation of Neural Network Latent Spaces with Symbolic Gradients](https://mlsanity.com/paper/2409.05305/) (2024)
- [Direct detection of plasticity onset through total-strain profile evolution](https://mlsanity.com/paper/2107.03738/) (2021)

## Abstract (arXiv)

We employ unsupervised machine learning techniques to learn latent parameters which best describe states of the two-dimensional Ising model and the three-dimensional XY model. These methods range from principal component analysis to artificial neural network based variational autoencoders. The states are sampled using a Monte-Carlo simulation above and below the critical temperature. We find that the predicted latent parameters correspond to the known order parameters. The latent representation of the states of the models in question are clustered, which makes it possible to identify phases without prior knowledge of their existence or the underlying Hamiltonian. Furthermore, we find that the reconstruction loss function can be used as a universal identifier for phase transitions.