mlsanityData to 7 Oct 2026

Nonparametric Identifiability of Causal Representations from Unknown Interventions

arXiv 2306.00542 ↗First posted 1 Jun 2023stat.ML cs.AI cs.LGcited by 105

Not on the map. Why?

Abstract (arXiv)

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and post-intervention views or temporal structure; places restrictive assumptions, such as linearity, on the mixing function or latent causal model; or requires partial knowledge of the generative process, such as the causal graph or intervention targets. We instead consider the general setting in which both the causal model and the mixing function are nonparametric. The learning signal takes the form of multiple datasets, or environments, arising from unknown interventions in the underlying causal model. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data. We study the fundamental setting of two causal variables and prove that the observational distribution and one perfect intervention per node suffice for identifiability, subject to a genericity condition. This condition rules out spurious solutions that involve fine-tuning of the intervened and observational distributions, mirroring similar conditions for nonlinear cause-effect inference. For an arbitrary number of variables, we show that at least one pair of distinct perfect interventional domains per node guarantees identifiability. Further, we demonstrate that the strengths of causal influences among the latent variables are preserved by all equivalent solutions, rendering the inferred representation appropriate for drawing causal conclusions from new data. Our study provides the first identifiability results for the general nonparametric setting with unknown interventions, and elucidates what is possible and impossible for causal representation learning without more direct supervision.

Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). Builds on 84 of its 143 references that are in the map. First posted on arXiv 1 Jun 2023.

Builds on

84 of 143 references.

References · 84

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2013Intriguing properties of neural networkscited by 5,114
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  6. 2019Invariant Risk Minimizationcited by 1,832
  7. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  8. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  9. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  10. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
  11. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
  12. 2018Recognition in Terra Incognitacited by 655
38 more
  1. 2013Domain Generalization via Invariant Feature Representationcited by 622
  2. 2019Neural Spline Flowscited by 590
  3. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  4. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  5. 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
  6. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
  7. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  8. 2019Causality for Machine Learningcited by 242
  9. 2020Weakly-Supervised Disentanglement Without Compromisescited by 237
  10. 2021Contrastive Learning Inverts the Data Generating Processcited by 220
  11. 2020Differentiable Causal Discovery from Interventional Datacited by 218
  12. 2019Learning Sparse Nonparametric DAGscited by 207
  13. 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
  14. 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 158
  15. 2017Invariant Causal Prediction for Nonlinear Modelscited by 140
  16. 2022Weakly supervised causal representation learningcited by 140
  17. 2022Interventional Causal Representation Learningcited by 140
  18. 2021On Calibration and Out-of-domain Generalizationcited by 134
  19. 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
  20. 2020Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse Codingcited by 121
  21. 2018Anchor regression: heterogeneous data meets causalitycited by 116
  22. 2017Causal Consistency of Structural Equation Modelscited by 114
  23. 2018Abstracting Causal Modelscited by 104
  24. 2020On Linear Identifiability of Learned Representationscited by 103
  25. 2020ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICAcited by 102
  26. 2021Independent mechanism analysis, a new concept?cited by 96
  27. 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
  28. 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 91
  29. 2019The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICAcited by 86
  30. 2022Linear Causal Disentanglement via Interventionscited by 84
  31. 2019Weakly Supervised Disentanglement with Guaranteescited by 82
  32. 2016Discovering Causal Signals in Imagescited by 79
  33. 2020Hidden Markov Nonlinear ICA: Unsupervised Learning from Nonstationary Time Seriescited by 76
  34. 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
  35. 2015External Validity: From Do-Calculus to Transportability Across Populationscited by 75
  36. 2022Identifiability of deep generative models without auxiliary informationcited by 70
  37. 2020Weakly Supervised Disentangled Generative Causal Representation Learningcited by 67
  38. 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66

50 most cited of 84 All 84 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 16; 2024: 27; 2025: 28; 2026: 34.

105 papers.

Sort:

By area:

  1. 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
  2. 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
  3. 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
  4. 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
  5. 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 56
  6. 2023Learning nonparametric latent causal graphs with unknown interventionscited by 34
  7. 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
  8. 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
  9. 2024On the Challenges and Opportunities in Generative AIcited by 31
  10. 2023Causal Representation Learning Made Identifiable by Grouping of Observational Variablescited by 30
  11. 2024Unifying Causal Representation Learning with the Invariance Principlecited by 30
  12. 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
38 more
  1. 2025Thought Communication in Multiagent Collaborationcited by 28
  2. 2023Multi-Domain Causal Representation Learning via Weak Distributional Invariancescited by 23
  3. 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 22
  4. 2023Identifying Representations for Intervention Extrapolationcited by 21
  5. 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modelingcited by 21
  6. 2023Object-centric architectures enable efficient causal representation learningcited by 21
  7. 2024Counterfactual Image Editingcited by 20
  8. 2024Interaction Asymmetry: A General Principle for Learning Composable Abstractionscited by 19
  9. 2023Identifying Linearly-Mixed Causal Representations from Multi-Node Interventionscited by 18
  10. 2023Targeted Reduction of Causal Modelscited by 15
  11. 2023Learning Causal Representations from General Environments: Identifiability and Intrinsic Ambiguitycited by 14
  12. 2024Linear Causal Representation Learning from Unknown Multi-node Interventionscited by 14
  13. 2024All or None: Identifiable Linear Properties of Next-token Predictors in Language Modelingcited by 14
  14. 2025SmartCLIP: Modular Vision-language Alignment with Identification Guaranteescited by 14
  15. 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
  16. 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?cited by 13
  17. 2024Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environmentcited by 12
  18. 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
  19. 2025Towards Interpretable Deep Generative Models via Causal Representation Learningcited by 12
  20. 2025Identifiability of Deep Polynomial Neural Networkscited by 12
  21. 2024Counterfactual Generative Modeling with Variational Causal Inferencecited by 10
  22. 2023An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysiscited by 9
  23. 2025On the Value of Cross-Modal Misalignment in Multimodal Representation Learningcited by 9
  24. 2025Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Researchcited by 9
  25. 2023Deep Backtracking Counterfactuals for Causally Compliant Explanationscited by 8
  26. 2024C2P: Featuring Large Language Models with Causal Reasoningcited by 8
  27. 2025When Do Neural Networks Learn World Models?cited by 8
  28. 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7
  29. 2025Robustness of Nonlinear Representation Learningcited by 7
  30. 2026On the Identifiability of Controlled World Modelscited by 7
  31. 2024Propensity Score Alignment of Unpaired Multimodal Datacited by 6
  32. 2025What is causal about causal models and representations?cited by 6
  33. 2025Debiasing Reward Models by Representation Learning with Guaranteescited by 6
  34. 2024Towards Identifiable Latent Additive Noise Modelscited by 5
  35. 2025Sanity Checking Causal Representation Learning on a Simple Real-World Systemcited by 5
  36. 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?cited by 5
  37. 2024Toward the Identifiability of Comparative Deep Generative Modelscited by 4
  38. 2024The Causal Information Bottleneck and Optimal Causal Variable Abstractionscited by 4

50 most cited of 105 All 105 (JSON)