mlsanityData to 7 Oct 2026

Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability

arXiv 2606.21385 ↗First posted 19 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper explores unsupervised disentangled representation learning from a functional perspective. We define latent concepts as factors that influence observations through locally orthogonal directions, formalized as an orthogonality constraint on the Jacobian of the generative mapping. We prove that this condition yields identifiability of general nonlinear generative models, without requiring statistical independence or causal assumptions, provided the latent domain admits all combinations of factor values. Experiments with orthogonality-regularized normalizing flows empirically confirm the theory, demonstrate reliable recovery of ground-truth factors, and shed light on the success of VAEs. These findings challenge the prevailing impossibility claims for unsupervised disentanglement and provide a principled alternative foundation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 69 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

36 of 69 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016Density estimation using Real NVPcited by 2,029
  3. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  4. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  5. 2018Disentangling by Factorisingcited by 614
  6. 2019Neural Spline Flowscited by 590
  7. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  8. 2018Towards a Definition of Disentangled Representationscited by 294
  9. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  10. 2019Residual Flows for Invertible Generative Modelingcited by 256
  11. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 240
  12. 2016Variational Lossy Autoencodercited by 175
24 more
  1. 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 158
  2. 2022Weakly supervised causal representation learningcited by 140
  3. 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
  4. 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
  5. 2017Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observationscited by 100
  6. 2021Independent mechanism analysis, a new concept?cited by 96
  7. 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 90
  8. 2024Normalizing Flows are Capable Generative Modelscited by 89
  9. 2022On the Identifiability of Nonlinear ICA: Sparsity and Beyondcited by 84
  10. 2020Hidden Markov Nonlinear ICA: Unsupervised Learning from Nonstationary Time Seriescited by 76
  11. 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
  12. 2023Identifiability of latent-variable and structural-equation models: from linear to nonlinearcited by 58
  13. 2019Disentangling Factors of Variation Using Few Labelscited by 57
  14. 2017Towards Deeper Understanding of Variational Autoencoding Modelscited by 56
  15. 2023Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learningcited by 48
  16. 2020CausalVAE: Structured Causal Disentanglement in Variational Autoencodercited by 47
  17. 2021Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generationcited by 35
  18. 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
  19. 2021An Image is Worth More Than a Thousand Words: Towards Disentanglement in the Wildcited by 30
  20. 2022Embrace the Gap: VAEs Perform Independent Mechanism Analysiscited by 28
  21. 2021Commutative Lie Group VAE for Disentanglement Learningcited by 27
  22. 2023Self-Supervised Disentanglement by Leveraging Structure in Data Augmentationscited by 16
  23. 2023Independent Mechanism Analysis and the Manifold Hypothesiscited by 7
  24. 2024Sequential Representation Learning via Static-Dynamic Conditional Disentanglementcited by 4

Built on by

Not cited yet.