Nonparametric Identifiability of Causal Representations from Unknown Interventions
Not on the map. Why?
Abstract (arXiv)
We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and post-intervention views or temporal structure; places restrictive assumptions, such as linearity, on the mixing function or latent causal model; or requires partial knowledge of the generative process, such as the causal graph or intervention targets. We instead consider the general setting in which both the causal model and the mixing function are nonparametric. The learning signal takes the form of multiple datasets, or environments, arising from unknown interventions in the underlying causal model. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data. We study the fundamental setting of two causal variables and prove that the observational distribution and one perfect intervention per node suffice for identifiability, subject to a genericity condition. This condition rules out spurious solutions that involve fine-tuning of the intervened and observational distributions, mirroring similar conditions for nonlinear cause-effect inference. For an arbitrary number of variables, we show that at least one pair of distinct perfect interventional domains per node guarantees identifiability. Further, we demonstrate that the strengths of causal influences among the latent variables are preserved by all equivalent solutions, rendering the inferred representation appropriate for drawing causal conclusions from new data. Our study provides the first identifiability results for the general nonparametric setting with unknown interventions, and elucidates what is possible and impossible for causal representation learning without more direct supervision.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). Builds on 84 of its 143 references that are in the map. First posted on arXiv 1 Jun 2023.
Builds on
84 of 143 references.
References · 84
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Invariant Risk Minimizationcited by 1,832
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2018Recognition in Terra Incognitacited by 655
38 more
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2019Neural Spline Flowscited by 590
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
- 2019Causality for Machine Learningcited by 242
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 237
- 2021Contrastive Learning Inverts the Data Generating Processcited by 220
- 2020Differentiable Causal Discovery from Interventional Datacited by 218
- 2019Learning Sparse Nonparametric DAGscited by 207
- 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
- 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 158
- 2017Invariant Causal Prediction for Nonlinear Modelscited by 140
- 2022Weakly supervised causal representation learningcited by 140
- 2022Interventional Causal Representation Learningcited by 140
- 2021On Calibration and Out-of-domain Generalizationcited by 134
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
- 2020Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse Codingcited by 121
- 2018Anchor regression: heterogeneous data meets causalitycited by 116
- 2017Causal Consistency of Structural Equation Modelscited by 114
- 2018Abstracting Causal Modelscited by 104
- 2020On Linear Identifiability of Learned Representationscited by 103
- 2020ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICAcited by 102
- 2021Independent mechanism analysis, a new concept?cited by 96
- 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
- 2020Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)cited by 91
- 2019The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICAcited by 86
- 2022Linear Causal Disentanglement via Interventionscited by 84
- 2019Weakly Supervised Disentanglement with Guaranteescited by 82
- 2016Discovering Causal Signals in Imagescited by 79
- 2020Hidden Markov Nonlinear ICA: Unsupervised Learning from Nonstationary Time Seriescited by 76
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2015External Validity: From Do-Calculus to Transportability Across Populationscited by 75
- 2022Identifiability of deep generative models without auxiliary informationcited by 70
- 2020Weakly Supervised Disentangled Generative Causal Representation Learningcited by 67
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
50 most cited of 84 All 84 (JSON)
Built on by
Citing papers per year: 2023: 16; 2024: 27; 2025: 28; 2026: 34.
105 papers.
Sort:
By area:
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 56
- 2023Learning nonparametric latent causal graphs with unknown interventionscited by 34
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
- 2024On the Challenges and Opportunities in Generative AIcited by 31
- 2023Causal Representation Learning Made Identifiable by Grouping of Observational Variablescited by 30
- 2024Unifying Causal Representation Learning with the Invariance Principlecited by 30
- 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
38 more
- 2025Thought Communication in Multiagent Collaborationcited by 28
- 2023Multi-Domain Causal Representation Learning via Weak Distributional Invariancescited by 23
- 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 22
- 2023Identifying Representations for Intervention Extrapolationcited by 21
- 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modelingcited by 21
- 2023Object-centric architectures enable efficient causal representation learningcited by 21
- 2024Counterfactual Image Editingcited by 20
- 2024Interaction Asymmetry: A General Principle for Learning Composable Abstractionscited by 19
- 2023Identifying Linearly-Mixed Causal Representations from Multi-Node Interventionscited by 18
- 2023Targeted Reduction of Causal Modelscited by 15
- 2023Learning Causal Representations from General Environments: Identifiability and Intrinsic Ambiguitycited by 14
- 2024Linear Causal Representation Learning from Unknown Multi-node Interventionscited by 14
- 2024All or None: Identifiable Linear Properties of Next-token Predictors in Language Modelingcited by 14
- 2025SmartCLIP: Modular Vision-language Alignment with Identification Guaranteescited by 14
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
- 2025I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?cited by 13
- 2024Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environmentcited by 12
- 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
- 2025Towards Interpretable Deep Generative Models via Causal Representation Learningcited by 12
- 2025Identifiability of Deep Polynomial Neural Networkscited by 12
- 2024Counterfactual Generative Modeling with Variational Causal Inferencecited by 10
- 2023An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysiscited by 9
- 2025On the Value of Cross-Modal Misalignment in Multimodal Representation Learningcited by 9
- 2025Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Researchcited by 9
- 2023Deep Backtracking Counterfactuals for Causally Compliant Explanationscited by 8
- 2024C2P: Featuring Large Language Models with Causal Reasoningcited by 8
- 2025When Do Neural Networks Learn World Models?cited by 8
- 2024Identifiability Guarantees for Causal Disentanglement from Purely Observational Datacited by 7
- 2025Robustness of Nonlinear Representation Learningcited by 7
- 2026On the Identifiability of Controlled World Modelscited by 7
- 2024Propensity Score Alignment of Unpaired Multimodal Datacited by 6
- 2025What is causal about causal models and representations?cited by 6
- 2025Debiasing Reward Models by Representation Learning with Guaranteescited by 6
- 2024Towards Identifiable Latent Additive Noise Modelscited by 5
- 2025Sanity Checking Causal Representation Learning on a Simple Real-World Systemcited by 5
- 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?cited by 5
- 2024Toward the Identifiability of Comparative Deep Generative Modelscited by 4
- 2024The Causal Information Bottleneck and Optimal Causal Variable Abstractionscited by 4
50 most cited of 105 All 105 (JSON)
- 2026Structure-agnostic Causal Representation Learning1 Oct 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026Self-Reports Do Not Identify Self-Models: An Identifiability Test for Counterfactual Reports26 Sep 2026
- 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?25 Sep 2026
- 2026Jigsaw-CRL: Recovering Global Latent Causal Order from Fragmented Multi-Client Interventions29 Aug 2026
- 2026Space as an Interventional Invariant: Cross-Modal Predictive Geometry for Stratified Cities and Em-Spaced Intelligence10 Aug 2026
- 2026Conditionally Identifiable Latent-Environment Modeling for Out-of-Distribution Recommendation4 Aug 2026
- 2026On the Identifiability of Controlled World Models24 Jul 2026
- 2026Equilibrium Causal Games: Separation, Identification, and the Identifiability of Cyclic Latent States21 Jul 2026
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery14 Jul 2026
- 2026Disentangling Continuous-Time Latent Dynamics: Identifiability of Latent SDEs via Diffusion Shifts26 Jun 2026
- 2026Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability19 Jun 2026
38 more
- 2026Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation16 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
- 2026Learning Latent Dynamical Causal Processes for Single-Cell Perturbation Prediction25 May 2026
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Bench23 May 2026
- 2026What Makes a Representation Good for Single-Cell Perturbation Prediction?19 May 2026
- 2026Identifiable Multimodal Causal Representation Learning under Partial Latent Sharing18 May 2026
- 2026From Generalist to Specialist Representation12 May 2026
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposure8 May 2026
- 2026Causal Representation Learning from General Environments under Nonparametric Mixing26 Apr 2026
- 2026A General Representation-Based Approach to Multi-Source Domain Adaptation26 Apr 2026
- 2026Diverse Dictionary Learning19 Apr 2026
- 2026Identifiability of Potentially Degenerate Gaussian Mixture Models With Piecewise Affine Mixing14 Apr 2026
- 2026Beyond identifiability: Learning causal representations with few environments and finite samples26 Mar 2026
- 2026RECLAIM: Cyclic Causal Discovery Amid Measurement Noise21 Mar 2026
- 2026Multi-Domain Empirical Bayes for Linearly-Mixed Causal Representations19 Mar 2026
- 2026Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention15 Mar 2026
- 2026Proxy-Guided Measurement Calibration10 Mar 2026
- 2026Structural Causal Bottleneck Models9 Mar 2026
- 2026Test-Time Learning of Causal Structure from Interventional Data22 Feb 2026
- 2026Self-Supervised Learning from Structural Invariance2 Feb 2026
- 2026Factored Causal Representation Learning for Robust Reward Modeling in RLHF29 Jan 2026
- 2026Concept Component Analysis: A Principled Approach for Concept Extraction in LLMs28 Jan 2026
- 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?17 Dec 2025
- 2025Modular Jets for Supervised Pipelines: Diagnosing Mirage vs Identifiability5 Dec 2025
- 2025Debiasing Reward Models by Representation Learning with Guarantees27 Oct 2025
- 2025ROPES: Robotic Pose Estimation via Score-Based Causal Representation Learning23 Oct 2025
- 2025Thought Communication in Multiagent Collaboration23 Oct 2025
- 2025Measure-Theoretic Anti-Causal Representation Learning16 Oct 2025
- 2025From Pixels to Factors: Learning Independently Controllable State Variables for Reinforcement Learning2 Oct 2025
- 2025SmartCLIP: Modular Vision-language Alignment with Identification Guarantees29 Jul 2025
- 2025Incorporating Interventional Independence Improves Robustness against Interventional Distribution Shift7 Jul 2025
- 2025Intervening to Learn and Compose Causally Disentangled Representations7 Jul 2025
- 2025Modeling Hierarchical Spaces: A Review and Unified Framework for Surrogate-Based Architecture Design27 Jun 2025
- 2025Identifiability of Deep Polynomial Neural Networks20 Jun 2025
- 2025Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning12 Jun 2025
- 2025Learning Joint Interventional Effects from Single-Variable Interventions in Additive Models5 Jun 2025
- 2025When Does Closeness in Distribution Imply Representational Similarity? An Identifiability Perspective4 Jun 2025
- 2025From Invariant Representations to Invariant Data: Provable Robustness to Spurious Correlations via Noisy Counterfactual Matching30 May 2025
50 newest of 105 All 105 (JSON)
- 2025When Do Neural Networks Learn World Models?cited by 8
- 2026On the Identifiability of Controlled World Modelscited by 7
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discoverycited by 4
- 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?cited by 0
- 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?25 Sep 2026
- 2026On the Identifiability of Controlled World Models24 Jul 2026
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery14 Jul 2026
- 2025When Do Neural Networks Learn World Models?13 Feb 2025
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 56
- 2023Learning nonparametric latent causal graphs with unknown interventionscited by 34
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2024A Sparsity Principle for Partially Observable Causal Representation Learningcited by 34
- 2024On the Challenges and Opportunities in Generative AIcited by 31
- 2023Causal Representation Learning Made Identifiable by Grouping of Observational Variablescited by 30
- 2024Unifying Causal Representation Learning with the Invariance Principlecited by 30
- 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
12 most cited of 95 All 95 (JSON)
- 2026Structure-agnostic Causal Representation Learning1 Oct 2026
- 2026Identifying ODEs from Unstructured Data with Causal Representation Learning29 Sep 2026
- 2026Self-Reports Do Not Identify Self-Models: An Identifiability Test for Counterfactual Reports26 Sep 2026
- 2026Jigsaw-CRL: Recovering Global Latent Causal Order from Fragmented Multi-Client Interventions29 Aug 2026
- 2026Space as an Interventional Invariant: Cross-Modal Predictive Geometry for Stratified Cities and Em-Spaced Intelligence10 Aug 2026
- 2026Conditionally Identifiable Latent-Environment Modeling for Out-of-Distribution Recommendation4 Aug 2026
- 2026Equilibrium Causal Games: Separation, Identification, and the Identifiability of Cyclic Latent States21 Jul 2026
- 2026Disentangling Continuous-Time Latent Dynamics: Identifiability of Latent SDEs via Diffusion Shifts26 Jun 2026
- 2026Unsupervised Disentanglement Without Compromises : How Functional Orthogonality Enforces Identifiability19 Jun 2026
- 2026Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation16 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
- 2026Learning Latent Dynamical Causal Processes for Single-Cell Perturbation Prediction25 May 2026
12 newest of 95 All 95 (JSON)