mlsanityData to 7 Oct 2026

Towards Unsupervised Causal Representation Learning via Latent Additive Noise Model Causal Autoencoders

arXiv 2512.22150 ↗First posted 15 Dec 2025cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Unsupervised representation learning seeks to recover latent generative factors, yet standard methods relying on statistical independence often fail to capture causal dependencies. A central challenge is identifiability: as established in disentangled representation learning and nonlinear ICA literature, disentangling causal variables from observational data is impossible without supervision, auxiliary signals, or strong inductive biases. In this work, we propose the Latent Additive Noise Model Causal Autoencoder (LANCA) to operationalize the Additive Noise Model (ANM) as a strong inductive bias for unsupervised discovery. Theoretically, we prove that while the ANM constraint does not guarantee unique identifiability in the general mixing case, it resolves component-wise indeterminacy by restricting the admissible transformations from arbitrary diffeomorphisms to the affine class. Methodologically, arguing that the stochastic encoding inherent to VAEs obscures the structural residuals required for latent causal discovery, LANCA employs a deterministic Wasserstein Auto-Encoder (WAE) coupled with a differentiable ANM Layer. This architecture transforms residual independence from a passive assumption into an explicit optimization objective. Empirically, LANCA outperforms state-of-the-art baselines on synthetic physics benchmarks (Pendulum, Flow), and on photorealistic environments (CANDLE), where it demonstrates superior robustness to spurious correlations arising from complex background scenes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 22 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

16 of 22 references.

References · 16

  1. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  2. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  3. 2018Disentangling by Factorisingcited by 614
  4. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  5. 2017Wasserstein Auto-Encoderscited by 371
  6. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  7. 2013Causal Discovery with Continuous Additive Noise Modelscited by 252
  8. 2021Towards Causal Representation Learningcited by 207
  9. 2022Disentangled Representation Learningcited by 111
  10. 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
  11. 2020Weakly Supervised Disentangled Generative Causal Representation Learningcited by 67
  12. 2020SoftSort: A Continuous Relaxation for the argsort Operatorcited by 66
4 more
  1. 2020CausalVAE: Structured Causal Disentanglement in Variational Autoencodercited by 47
  2. 2022Differentiable DAG Samplingcited by 46
  3. 2021On Causally Disentangled Representationscited by 22
  4. 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7

Built on by

Not cited yet.