Linear Causal Disentanglement via Interventions
Not on the map. Why?
Abstract (arXiv)
Causal disentanglement seeks a representation of data involving latent variables that relate to one another via a causal model. A representation is identifiable if both the latent model and the transformation from latent to observed variables are unique. In this paper, we study observed variables that are a linear transformation of a linear latent causal model. Data from interventions are necessary for identifiability: if one latent variable is missing an intervention, we show that there exist distinct models that cannot be distinguished. Conversely, we show that a single intervention on each latent variable is sufficient for identifiability. Our proof uses a generalization of the RQ decomposition of a matrix that replaces the usual orthogonal and upper triangular conditions with analogues depending on a partial order on the rows of the matrix, with partial order determined by a latent causal model. We corroborate our theoretical results with a method for causal disentanglement that accurately recovers a latent causal model.
Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). Builds on 16 of its 51 references that are in the map. First posted on arXiv 29 Nov 2022.
Builds on
16 of 51 references.
References · 16
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2021Contrastive Learning Inverts the Data Generating Processcited by 220
- 2022Weakly supervised causal representation learningcited by 140
- 2022Interventional Causal Representation Learningcited by 140
- 2018Characterizing and Learning Equivalence Classes of Causal DAGs under Interventionscited by 76
- 2019Permutation-Based Causal Structure Learning with Unknown Intervention Targetscited by 69
- 2022Weakly Supervised Representation Learning with Sparse Perturbationscited by 64
- 2021Learning latent causal graphs via mixture oraclescited by 55
- 2021Identifiable Deep Generative Models via Sparse Decodingcited by 54
- 2022Causal Structure Learning: a Combinatorial Perspectivecited by 46
- 2021Properties from Mechanisms: An Equivariance Perspective on Identifiable Representation Learningcited by 30
4 more
- 2022Causal Structure Discovery between Clusters of Nodes Induced by Latent Factorscited by 18
- 2019Anchored Causal Inference in the Presence of Measurement Errorcited by 11
- 2021Scalable Intervention Target Estimation in Linear Modelscited by 10
- 2015Anchored Discrete Factor Analysiscited by 9
Built on by
Citing papers per year: 2023: 25; 2024: 20; 2025: 16; 2026: 23.
84 papers.
Sort:
By area:
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2023Causal Component Analysiscited by 56
- 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 56
- 2023Score-based Causal Representation Learning with Interventionscited by 49
- 2023Learning nonparametric latent causal graphs with unknown interventionscited by 34
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
- 2023Unpaired Multi-Domain Causal Representation Learningcited by 32
38 more
- 2023Leveraging sparse and shared feature activations for disentangled representation learningcited by 32
- 2023Causal Representation Learning Made Identifiable by Grouping of Observational Variablescited by 30
- 2024Unifying Causal Representation Learning with the Invariance Principlecited by 30
- 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
- 2023Multi-Domain Causal Representation Learning via Weak Distributional Invariancescited by 23
- 2023Identifiable Latent Polynomial Causal Models Through the Lens of Changecited by 23
- 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 22
- 2023Identifying Representations for Intervention Extrapolationcited by 21
- 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modelingcited by 21
- 2023Object-centric architectures enable efficient causal representation learningcited by 21
- 2023Identifying Linearly-Mixed Causal Representations from Multi-Node Interventionscited by 18
- 2023Self-Supervised Disentanglement by Leveraging Structure in Data Augmentationscited by 16
- 2024Analyzing (In)Abilities of SAEs via Formal Languagescited by 16
- 2023Targeted Reduction of Causal Modelscited by 15
- 2024Linear Causal Representation Learning from Unknown Multi-node Interventionscited by 14
- 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?cited by 13
- 2024Smoke and Mirrors in Causal Downstream Taskscited by 12
- 2024Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environmentcited by 12
- 2025Towards Interpretable Deep Generative Models via Causal Representation Learningcited by 12
- 2024Beyond DAGs: A Latent Partial Causal Model for Multimodal Learningcited by 9
- 2024Automated Discovery of Pairwise Interactions from Unstructured Datacited by 8
- 2024Language Agents Meet Causality -- Bridging LLMs and Causal World Modelscited by 8
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7
- 2025Robustness of Nonlinear Representation Learningcited by 7
- 2024Propensity Score Alignment of Unpaired Multimodal Datacited by 6
- 2025Debiasing Reward Models by Representation Learning with Guaranteescited by 6
- 2023Invariance & Causal Representation Learning: Prospects and Limitationscited by 5
- 2024Towards Identifiable Latent Additive Noise Modelscited by 5
- 2024Identifiability Analysis of Linear ODE Systems with Hidden Confounderscited by 5
- 2025Sanity Checking Causal Representation Learning on a Simple Real-World Systemcited by 5
- 2023Learning Causal Graphs via Monotone Triangular Transport Mapscited by 4
- 2023Neuro-Causal Factor Analysiscited by 4
- 2023Towards Characterizing Domain Counterfactuals For Invertible Latent Causal Modelscited by 4
- 2024Identifying General Mechanism Shifts in Linear Causal Representationscited by 4
- 2025The Third Pillar of Causal Analysis? A Measurement Perspective on Causal Representationscited by 4
- 2026Structural Causal Bottleneck Modelscited by 4
- 2026Causal Representation Learning from General Environments under Nonparametric Mixingcited by 4
- 2024Learning Invariant Causal Mechanism from Vision-Language Modelscited by 3
50 most cited of 84 All 84 (JSON)
- 2026Structure-agnostic Causal Representation Learning1 Oct 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?25 Sep 2026
- 2026Jigsaw-CRL: Recovering Global Latent Causal Order from Fragmented Multi-Client Interventions29 Aug 2026
- 2026Equilibrium Causal Games: Separation, Identification, and the Identifiability of Cyclic Latent States21 Jul 2026
- 2026Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation16 Jun 2026
- 2026Tensor-based second-order causal discovery16 Jun 2026
- 2026Learning task-specific subspaces via interventional post-training of speech foundation models16 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
- 2026Abduction-Deduction Entanglement: Domain Generalization via Representation Transplants24 May 2026
- 2026Score-Based Causal Discovery of Latent Variable Causal Models19 May 2026
- 2026What Makes a Representation Good for Single-Cell Perturbation Prediction?19 May 2026
38 more
- 2026Identifiable Multimodal Causal Representation Learning under Partial Latent Sharing18 May 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026A General Representation-Based Approach to Multi-Source Domain Adaptation26 Apr 2026
- 2026Identifiability of Potentially Degenerate Gaussian Mixture Models With Piecewise Affine Mixing14 Apr 2026
- 2026Beyond identifiability: Learning causal representations with few environments and finite samples26 Mar 2026
- 2026Multi-Domain Empirical Bayes for Linearly-Mixed Causal Representations19 Mar 2026
- 2026Structural Causal Bottleneck Models9 Mar 2026
- 2026Causal Neighbourhood Learning for Invariant Graph Representations20 Feb 2026
- 2026Causal Representation Meets Stochastic Modeling under Generic Geometry4 Feb 2026
- 2026Unsupervised Decomposition and Recombination with Discriminator-Driven Diffusion Models29 Jan 2026
- 2026Concept Component Analysis: A Principled Approach for Concept Extraction in LLMs28 Jan 2026
- 2025Causal Structure and Representation Learning with Biomedical Applications6 Nov 2025
- 2025Debiasing Reward Models by Representation Learning with Guarantees27 Oct 2025
- 2025ROPES: Robotic Pose Estimation via Score-Based Causal Representation Learning23 Oct 2025
- 2025Measure-Theoretic Anti-Causal Representation Learning16 Oct 2025
- 2025From Pixels to Factors: Learning Independently Controllable State Variables for Reinforcement Learning2 Oct 2025
- 2025Linear Causal Representation Learning by Topological Ordering, Pruning, and Disentanglement26 Sep 2025
- 2025Learning Robust Intervention Representations with Delta Embeddings6 Aug 2025
- 2025Trek-Based Parameter Identification for Linear Causal Models With Arbitrarily Structured Latent Variables24 Jul 2025
- 2025Incorporating Interventional Independence Improves Robustness against Interventional Distribution Shift7 Jul 2025
- 2025The Third Pillar of Causal Analysis? A Measurement Perspective on Causal Representations23 May 2025
- 2025Towards Identifiability of Interventional Stochastic Differential Equations21 May 2025
- 2025Extrapolation Guarantees for Perturbation Modeling Under the Additive Latent Shift Assumption25 Apr 2025
- 2025Towards Interpretable Deep Generative Models via Causal Representation Learning15 Apr 2025
- 2025Robustness of Nonlinear Representation Learning19 Mar 2025
- 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?12 Mar 2025
- 2025Sanity Checking Causal Representation Learning on a Simple Real-World System27 Feb 2025
- 2024Identifying General Mechanism Shifts in Linear Causal Representations31 Oct 2024
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Data31 Oct 2024
- 2024Identifiability Analysis of Linear ODE Systems with Hidden Confounders29 Oct 2024
- 2024Language Agents Meet Causality -- Bridging LLMs and Causal World Models25 Oct 2024
- 2024Identifiable Representation and Model Learning for Latent Dynamic Systems23 Oct 2024
- 2024Analyzing (In)Abilities of SAEs via Formal Languages15 Oct 2024
- 2024Automated Discovery of Pairwise Interactions from Unstructured Data11 Sep 2024
- 2024Unifying Causal Representation Learning with the Invariance Principle4 Sep 2024
- 2024Linear causal disentanglement via higher-order cumulants5 Jul 2024
- 2024Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment19 Jun 2024
- 2024Linear Causal Representation Learning from Unknown Multi-node Interventions9 Jun 2024
50 newest of 84 All 84 (JSON)
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 105
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2023Causal Component Analysiscited by 56
- 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 56
- 2023Score-based Causal Representation Learning with Interventionscited by 49
- 2023Learning nonparametric latent causal graphs with unknown interventionscited by 34
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
- 2023Unpaired Multi-Domain Causal Representation Learningcited by 32
12 most cited of 78 All 78 (JSON)
- 2026Structure-agnostic Causal Representation Learning1 Oct 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026Jigsaw-CRL: Recovering Global Latent Causal Order from Fragmented Multi-Client Interventions29 Aug 2026
- 2026Equilibrium Causal Games: Separation, Identification, and the Identifiability of Cyclic Latent States21 Jul 2026
- 2026Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation16 Jun 2026
- 2026Tensor-based second-order causal discovery16 Jun 2026
- 2026Learning task-specific subspaces via interventional post-training of speech foundation models16 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
- 2026Abduction-Deduction Entanglement: Domain Generalization via Representation Transplants24 May 2026
- 2026Score-Based Causal Discovery of Latent Variable Causal Models19 May 2026
- 2026What Makes a Representation Good for Single-Cell Perturbation Prediction?19 May 2026
- 2026Identifiable Multimodal Causal Representation Learning under Partial Latent Sharing18 May 2026
12 newest of 78 All 78 (JSON)