Towards Identifiable Latent Additive Noise Models
Not on the map. Why?
Abstract (arXiv)
Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required for identifiability and by challenges in applying them to real-world settings. Most current approaches are applicable only to relatively restrictive model classes, such as linear or polynomial models, which limits their flexibility and robustness in practice. One promising approach to this problem seeks to address these issues by leveraging changes in causal influences among latent variables. In this vein we propose a more general and relaxed framework than typically applied, formulated by imposing constraints on the function classes applied. Within this framework, we establish partial identifiability results under weaker conditions, including scenarios where only a subset of causal influences change. We then extend our analysis to a broader class of latent post-nonlinear models. Building on these theoretical insights, we develop a flexible method for learning latent causal representations. We demonstrate the effectiveness of our approach on synthetic and semi-synthetic datasets, and further showcase its applicability in a case study on human motion analysis, a complex real-world domain that also highlights the potential to broaden the practical reach of identifiable CRL models.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 38 of its 84 references that are in the map. First posted on arXiv 23 Mar 2024.
Builds on
38 of 84 references.
References · 38
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 252
- 2020Representation Learning via Invariant Causal Mechanismscited by 197
- 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
- 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 158
- 2022Weakly supervised causal representation learningcited by 140
- 2022Interventional Causal Representation Learningcited by 140
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
26 more
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
- 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 91
- 2022Linear Causal Disentanglement via Interventionscited by 84
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2022Weakly Supervised Representation Learning with Sparse Perturbationscited by 64
- 2023Causal Component Analysiscited by 56
- 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
- 2022Causal Representation Learning for Instantaneous and Temporal Effects in Interactive Systemscited by 50
- 2022Latent Hierarchical Causal Structure Discovery with Rank Constraintscited by 50
- 2023Score-based Causal Representation Learning with Interventionscited by 49
- 2020CausalVAE: Structured Causal Disentanglement in Variational Autoencodercited by 47
- 2023A Survey on Causal Reinforcement Learningcited by 43
- 2020Meta-Learning for Few-Shot Land Cover Classificationcited by 34
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2022Identifying Weight-Variant Latent Causal Modelscited by 33
- 2024Score-based Causal Representation Learning: Linear and General Transformationscited by 27
- 2023Identifiable Latent Polynomial Causal Models Through the Lens of Changecited by 23
- 2022Causal Balancing for Domain Generalizationcited by 20
- 2017Robust causal structure learning with some hidden variablescited by 17
- 2022Learning Latent Causal Dynamicscited by 13
- 2018Variational Bayesian Dropout with a Hierarchical Priorcited by 7
- 2023Rank-Based Causal Discovery for Post-Nonlinear Modelscited by 7
- 2023Invariance & Causal Representation Learning: Prospects and Limitationscited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 1.
5 papers.
- 2024Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learningcited by 16
- 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?cited by 13
- 2025On the Value of Cross-Modal Misalignment in Multimodal Representation Learningcited by 9
- 2026What Makes a Representation Good for Single-Cell Perturbation Prediction?cited by 3
- 2024Linear causal disentanglement via higher-order cumulantscited by 1
- 2026What Makes a Representation Good for Single-Cell Perturbation Prediction?19 May 2026
- 2025On the Value of Cross-Modal Misalignment in Multimodal Representation Learning14 Apr 2025
- 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?12 Mar 2025
- 2024Linear causal disentanglement via higher-order cumulants5 Jul 2024
- 2024Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning20 Jun 2024