mlsanityData to 14 Oct 2026

β-VAEs as Effective Theories: Tolerance-Dependent Dimension

arXiv 2608.10599 ↗First posted 11 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In a β-VAE, increasing the regularization strength acts as a spectral cutoff by collapsing low-utility latent coordinates. In the linear Gaussian VAE, the collapse order matches the ranking of reconstruction utilities exactly, because both are set by the PCA spectrum. We ask which parts of this picture survive in fully connected nonlinear VAEs trained on WorldClim. We find that nonlinear interactions shift and broaden collapse onsets, so thresholds no longer coincide exactly with utilities. However, the common ordering is preserved over the resolved ranks, so the spectral cutoff still acts as a utility cutoff and the effective-description logic carries through. The resulting effective-dimension curves reveal a head--tail tradeoff: increasing depth concentrates utility into the first few coordinates but worsens tail fidelity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 19 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

6 of 19 references.

References · 6

  1. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  2. 2019Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapsecited by 121
  3. 2016Why does deep and cheap learning work so well?cited by 100
  4. 2014An exact mapping between the Variational Renormalization Group and Deep Learningcited by 56
  5. 2019The Usual Suspects? Reassessing Blame for VAE Posterior Collapsecited by 52
  6. 2026Latent Spectroscopy: Posterior Collapse as a Featurecited by 1

Built on by

Not cited yet.