Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustness
Not on the map. Why?
Abstract (arXiv)
The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards this goal have been proposed in recent times, a commonly accepted definition and validation procedure is missing. We provide a causal perspective on representation learning which covers disentanglement and domain shift robustness as special cases. Our causal framework allows us to introduce a new metric for the quantitative evaluation of deep latent variable models. We show how this metric can be estimated from labeled observational data and further provide an efficient estimation algorithm that scales linearly in the dataset size.
Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 18; 2023: 31; 2024: 9; 2025: 14; 2026: 10.
108 papers.
Sort:
By area:
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
- 2021Towards Causal Representation Learningcited by 209
- 2022Disentangled Representation Learningcited by 112
- 2021Counterfactual Generative Networkscited by 111
- 2021Causal Attention for Vision-Language Taskscited by 111
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2022GlanceNets: Interpretabile, Leak-proof Concept-based Modelscited by 73
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
38 more
- 2022Harnessing Out-Of-Distribution Examples via Augmenting Content and Stylecited by 43
- 2022Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Languagecited by 42
- 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
- 2022From Statistical to Causal Learningcited by 40
- 2021Transporting Causal Mechanisms for Unsupervised Domain Adaptationcited by 38
- 2022Disentanglement of Correlated Factors via Hausdorff Factorized Supportcited by 37
- 2023Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignmentcited by 32
- 2022Invariant Causal Mechanisms through Distribution Matchingcited by 31
- 2022Improving Multi-Task Generalization via Regularizing Spurious Correlationcited by 28
- 2023Group Robust Classification Without Any Group Informationcited by 25
- 2022DCI-ES: An Extended Disentanglement Framework with Connections to Identifiabilitycited by 23
- 2021Towards Building A Group-based Unsupervised Representation Disentanglement Frameworkcited by 22
- 2021On Causally Disentangled Representationscited by 22
- 2023Interpretability is in the Mind of the Beholder: A Causal Framework for Human-interpretable Representation Learningcited by 22
- 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modelingcited by 22
- 2023Self-Supervised Disentanglement by Leveraging Structure in Data Augmentationscited by 17
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNscited by 16
- 2025If Concept Bottlenecks are the Question, are Foundation Models the Answer?cited by 15
- 2023Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanismscited by 14
- 2023Generative Causal Representation Learning for Out-of-Distribution Motion Forecastingcited by 13
- 2021Bayesian multiscale deep generative model for the solution of high-dimensional inverse problemscited by 12
- 2023Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalizationcited by 12
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2021Intact-VAE: Estimating Treatment Effects under Unobserved Confoundingcited by 10
- 2021Object-Centric Representation Learning with Generative Spatial-Temporal Factorizationcited by 10
- 2021Matching Learned Causal Effects of Neural Networks with Domain Priorscited by 10
- 2022Deconfounding to Explanation Evaluation in Graph Neural Networkscited by 10
- 2021Disentanglement and Generalization Under Correlation Shiftscited by 8
- 2023Moderately Distributional Exploration for Domain Generalizationcited by 8
- 2023Hacking Task Confounder in Meta-Learningcited by 8
- 2025There Was Never a Bottleneck in Concept Bottleneck Modelscited by 8
- 2021Sill-Net: Feature Augmentation with Separated Illumination Representationcited by 7
- 2023Neuro-Symbolic Reasoning Shortcuts: Mitigation Strategies and their Limitationscited by 7
- 2023C-Disentanglement: Discovering Causally-Independent Generative Factors under an Inductive Bias of Confoundercited by 7
- 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?cited by 7
- 2022Class Is Invariant to Context and Vice Versa: On Learning Invariance for Out-Of-Distribution Generalizationcited by 6
- 2023Deep Kernel Principal Component Analysis for Multi-level Feature Learningcited by 6
- 2021Demystifying Inductive Biases for β-VAE Based Architecturescited by 5
50 most cited of 108 All 108 (JSON)
- 2026Weakly supervised concept Bottleneck Learning for Robust Two stage Object centric visual reasoning23 Aug 2026
- 2026Coordinated Disentanglement with Iterative Mode Discovery Under Hidden Correlations19 Jul 2026
- 2026Disentanglement-Based Equivariant Learning for Compositional VQA1 Jun 2026
- 2026Disentanglement Beyond Generative Models with Riemannian ICA21 May 2026
- 2026Concepts Worth Having: Refining VLM-Guided Concept Bottleneck Models with Minimal Annotations13 May 2026
- 2026CausalDetox: Causal Head Selection and Intervention for Language Model Detoxification16 Apr 2026
- 2026Causal Transfer in Medical Image Analysis25 Mar 2026
- 2026Causal Representation Learning on High-Dimensional Data: Benchmarks, Reproducibility, and Evaluation Metrics18 Mar 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2026Variational decomposition autoencoding improves disentanglement of latent representations11 Jan 2026
- 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?17 Dec 2025
- 2025Towards Unsupervised Causal Representation Learning via Latent Additive Noise Model Causal Autoencoders15 Dec 2025
38 more
- 2025Revealing Multimodal Causality with Large Language Models22 Sep 2025
- 2025Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence19 Sep 2025
- 2025Causal Representation Learning from Network Data2 Sep 2025
- 2025L-VAE: Variational Auto-Encoder with Learnable Beta for Disentangled Representation3 Jul 2025
- 2025Disentangled representations of microscopy images25 Jun 2025
- 2025There Was Never a Bottleneck in Concept Bottleneck Models5 Jun 2025
- 2025Causality and "In-the-Wild" Video-Based Person Re-ID: A Survey26 May 2025
- 2025Parameter Estimation using Reinforcement Learning Causal Curiosity: Limits and Challenges13 May 2025
- 2025Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Models28 Apr 2025
- 2025If Concept Bottlenecks are the Question, are Foundation Models the Answer?28 Apr 2025
- 2025Identifying Metric Structures of Deep Latent Variable Models19 Feb 2025
- 2025Towards Robust and Reliable Concept Representations: Reliability-Enhanced Concept Embedding Model3 Feb 2025
- 2024Boosting Test Performance with Importance Sampling--a Subpopulation Perspective17 Dec 2024
- 2024Transferring disentangled representations: bridging the gap between synthetic and real images26 Sep 2024
- 2024Independence Constrained Disentangled Representation Learning from Epistemological Perspective4 Sep 2024
- 2024Rethinking Disentanglement under Dependent Factors of Variation13 Aug 2024
- 2024Towards the Causal Complete Cause of Multi-Modal Representation Learning19 Jul 2024
- 2024Measuring Orthogonality in Representations of Generative Models4 Jul 2024
- 2024Disentangled Representations for Causal Cognition30 Jun 2024
- 2024Reconsidering Faithfulness in Regular, Self-Explainable and Domain Invariant GNNs21 Jun 2024
- 2024Learning Invariant Causal Mechanism from Vision-Language Models24 May 2024
- 2023Hacking Task Confounder in Meta-Learning10 Dec 2023
- 2023Concept-free Causal Disentanglement with Variational Graph Auto-Encoder17 Nov 2023
- 2023Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations15 Nov 2023
- 2023Group Robust Classification Without Any Group Information28 Oct 2023
- 2023C-Disentanglement: Discovering Causally-Independent Generative Factors under an Inductive Bias of Confounder26 Oct 2023
- 2023Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization25 Oct 2023
- 2023Specify Robust Causal Representation from Mixed Observations21 Oct 2023
- 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modeling17 Oct 2023
- 2023Interpretability is in the Mind of the Beholder: A Causal Framework for Human-interpretable Representation Learning14 Sep 2023
- 2023Measuring the Effect of Causal Disentanglement on the Adversarial Robustness of Neural Network Models21 Aug 2023
- 20233D-IDS: Doubly Disentangled Dynamic Intrusion Detection2 Jul 2023
- 2023Conditionally Invariant Representation Learning for Disentangling Cellular Heterogeneity2 Jul 2023
- 2023Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanisms2 Jun 2023
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts31 May 2023
- 2023On Counterfactual Data Augmentation Under Confounding29 May 2023
- 2023Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment20 May 2023
- 2023Enriching Disentanglement: From Logical Definitions to Quantitative Metrics19 May 2023
50 newest of 108 All 108 (JSON)
- 2021Causal Attention for Vision-Language Taskscited by 111
- 2024Learning Invariant Causal Mechanism from Vision-Language Modelscited by 3
- 2024Learning Invariant Causal Mechanism from Vision-Language Models24 May 2024
- 2021Causal Attention for Vision-Language Tasks5 Mar 2021
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
- 2021Towards Causal Representation Learningcited by 209
- 2022Disentangled Representation Learningcited by 112
- 2021Counterfactual Generative Networkscited by 111
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2022GlanceNets: Interpretabile, Leak-proof Concept-based Modelscited by 73
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2022Harnessing Out-Of-Distribution Examples via Augmenting Content and Stylecited by 43
12 most cited of 102 All 102 (JSON)
- 2026Coordinated Disentanglement with Iterative Mode Discovery Under Hidden Correlations19 Jul 2026
- 2026Disentanglement-Based Equivariant Learning for Compositional VQA1 Jun 2026
- 2026Disentanglement Beyond Generative Models with Riemannian ICA21 May 2026
- 2026Concepts Worth Having: Refining VLM-Guided Concept Bottleneck Models with Minimal Annotations13 May 2026
- 2026CausalDetox: Causal Head Selection and Intervention for Language Model Detoxification16 Apr 2026
- 2026Causal Transfer in Medical Image Analysis25 Mar 2026
- 2026Causal Representation Learning on High-Dimensional Data: Benchmarks, Reproducibility, and Evaluation Metrics18 Mar 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2026Variational decomposition autoencoding improves disentanglement of latent representations11 Jan 2026
- 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?17 Dec 2025
- 2025Towards Unsupervised Causal Representation Learning via Latent Additive Noise Model Causal Autoencoders15 Dec 2025
- 2025Revealing Multimodal Causality with Large Language Models22 Sep 2025
12 newest of 102 All 102 (JSON)