Latent Spectroscopy: Posterior Collapse as a Feature
Not on the map. Why?
Abstract (arXiv)
We show that, in linear Gaussian VAEs, posterior collapse is a form of latent feature selection. Feature importance is set by each latent coordinate's contribution to reconstruction, itself given by the corresponding PCA eigenvalue. Varying the regularizer strength β reveals a ranked spectrum of collapse events, with thresholds set by the utility/PCA spectrum. A mode-by-mode analysis identifies the scale-invariant signal fraction as an order parameter obeying Landau scaling near collapse. WorldClim experiments confirm both the utility-threshold calibration and the predicted near-collapse scaling.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
12 of 22 references.
References · 12
- 2015Generating Sentences from a Continuous Spacecited by 612
- 2019Diagnosing and Enhancing VAE Modelscited by 193
- 2019Lagging Inference Networks and Posterior Collapse in Variational Autoencoderscited by 124
- 2019Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapsecited by 121
- 2020Simple and Effective VAE Training with Calibrated Decoderscited by 57
- 2019The Usual Suspects? Reassessing Blame for VAE Posterior Collapsecited by 52
- 2023Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealingcited by 12
- 2023High-dimensional Asymptotics of VAEs: Threshold of Posterior Collapse and Dataset-Size Dependence of Rate-Distortion Curvecited by 5
- 2023Exploring how a Generative AI interprets musiccited by 4
- 2025Posterior Collapse as a Phase Transition in Variational Autoencoderscited by 4
- 2025Learning symmetries in datasetscited by 1
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Datacited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026β-VAEs as Effective Theories: Tolerance-Dependent Dimension11 Aug 2026