The Third Pillar of Causal Analysis? A Measurement Perspective on Causal Representations
On the map: LLM reasoning → Causal reasoning in LLMs
Abstract (arXiv)
Causal reasoning and discovery, two fundamental tasks of causal analysis, often face challenges in applications due to the complexity, noisiness, and high-dimensionality of real-world data. Despite recent progress in identifying latent causal structures using causal representation learning (CRL), what makes learned representations useful for causal downstream tasks and how to evaluate them are still not well understood. In this paper, we reinterpret CRL using a measurement model framework, where the learned representations are viewed as proxy measurements of the latent causal variables. Our approach clarifies the conditions under which learned representations support downstream causal reasoning and provides a principled basis for quantitatively assessing the quality of representations using a new Test-based Measurement EXclusivity (T-MEX) score. We validate T-MEX across diverse causal inference scenarios, including numerical simulations and real-world ecological video analysis, demonstrating that the proposed framework and corresponding score effectively assess the identification of learned representations and their usefulness for causal downstream tasks.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 45 of its 74 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
45 of 74 references.
References · 45
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Invariant Risk Minimizationcited by 1,854
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2018Disentangling by Factorisingcited by 616
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
- 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
- 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 160
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 133
33 more
- 2023Causal-learn: Causal Discovery in Pythoncited by 109
- 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 106
- 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
- 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
- 2022On the Identifiability of Nonlinear ICA: Sparsity and Beyondcited by 85
- 2022Linear Causal Disentanglement via Interventionscited by 84
- 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
- 2017Approximate Kernel-based Conditional Independence Tests for Fast Non-Parametric Causal Discoverycited by 76
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 74
- 2017Conditional independence testing based on a nearest-neighbor estimator of conditional mutual informationcited by 70
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 68
- 2022Weakly Supervised Representation Learning with Sparse Perturbationscited by 65
- 2022Temporally Disentangled Representation Learningcited by 61
- 2023Causal Component Analysiscited by 56
- 2020A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluationcited by 52
- 2022Causal Representation Learning for Instantaneous and Temporal Effects in Interactive Systemscited by 51
- 2022Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learningcited by 44
- 2020Domain Adaptation as a Problem of Inference on Graphical Modelscited by 36
- 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
- 2023A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variablescited by 33
- 2023Leveraging sparse and shared feature activations for disentangled representation learningcited by 32
- 2024Unifying Causal Representation Learning with the Invariance Principlecited by 31
- 2023Identification of Nonlinear Latent Hierarchical Modelscited by 27
- 2023Multi-Domain Causal Representation Learning via Weak Distributional Invariancescited by 23
- 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 23
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
- 2022The Projected Covariance Measure for assumption-lean variable significance testingcited by 16
- 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 13
- 2024Smoke and Mirrors in Causal Downstream Taskscited by 12
- 2023Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variablescited by 11
- 2024Automated Discovery of Pairwise Interactions from Unstructured Datacited by 8
- 2025Sanity Checking Causal Representation Learning on a Simple Real-World Systemcited by 5
- 2022A general framework for the analysis of kernel-based testscited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Who Guards the Guardians? The Challenges of Evaluating Identifiability of Learned Representationscited by 0
- 2026Proxy-Guided Measurement Calibrationcited by 0
- 2026From Tokens to Policy: Causal and Interpretable Heterogeneous Treatment Effects Identificationcited by 0
- 2026Behavioral Latency as Weak Event-Time Supervision for EEG Reaction-Time Decodingcited by 0
- 2026Behavioral Latency as Weak Event-Time Supervision for EEG Reaction-Time Decoding29 Aug 2026
- 2026From Tokens to Policy: Causal and Interpretable Heterogeneous Treatment Effects Identification15 Jun 2026
- 2026Proxy-Guided Measurement Calibration10 Mar 2026
- 2026Who Guards the Guardians? The Challenges of Evaluating Identifiability of Learned Representations27 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Linear Causal Representation Learning by Topological Ordering, Pruning, and Disentanglement
- 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era
- 2026CausalReasoningBenchmark: A Real-World Benchmark for Disentangled Evaluation of Causal Identification and Estimation
- 2026Causality is Key for Interpretability Claims to Generalise
- 2024Discovering and Reasoning of Causality in the Hidden World with Large Language Models
- 2025Causality can systematically address the monsters under the bench(marks)
- 2025Addressing divergent representations from causal interventions on neural networks
- 2025Correlation or Causation: Analyzing the Causal Structures of LLM and LRM Reasoning Process