mlsanityData to 14 Oct 2026

The Third Pillar of Causal Analysis? A Measurement Perspective on Causal Representations

arXiv 2505.17708 ↗First posted 23 May 2025cs.LGcited by 4

On the map: LLM reasoning → Causal reasoning in LLMs

Abstract (arXiv)

Causal reasoning and discovery, two fundamental tasks of causal analysis, often face challenges in applications due to the complexity, noisiness, and high-dimensionality of real-world data. Despite recent progress in identifying latent causal structures using causal representation learning (CRL), what makes learned representations useful for causal downstream tasks and how to evaluate them are still not well understood. In this paper, we reinterpret CRL using a measurement model framework, where the learned representations are viewed as proxy measurements of the latent causal variables. Our approach clarifies the conditions under which learned representations support downstream causal reasoning and provides a principled basis for quantitatively assessing the quality of representations using a new Test-based Measurement EXclusivity (T-MEX) score. We validate T-MEX across diverse causal inference scenarios, including numerical simulations and real-world ecological video analysis, demonstrating that the proposed framework and corresponding score effectively assess the identification of learned representations and their usefulness for causal downstream tasks.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 45 of its 74 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

45 of 74 references.

References · 45

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2019Invariant Risk Minimizationcited by 1,854
  3. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  4. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
  5. 2018Disentangling by Factorisingcited by 616
  6. 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
  7. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
  8. 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
  9. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
  10. 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
  11. 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 160
  12. 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 133
33 more
  1. 2023Causal-learn: Causal Discovery in Pythoncited by 109
  2. 2023Nonparametric Identifiability of Causal Representations from Unknown Interventionscited by 106
  3. 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
  4. 2023Learning Linear Causal Representations from Interventions under General Nonlinear Mixingcited by 92
  5. 2022On the Identifiability of Nonlinear ICA: Sparsity and Beyondcited by 85
  6. 2022Linear Causal Disentanglement via Interventionscited by 84
  7. 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
  8. 2017Approximate Kernel-based Conditional Independence Tests for Fast Non-Parametric Causal Discoverycited by 76
  9. 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 74
  10. 2017Conditional independence testing based on a nearest-neighbor estimator of conditional mutual informationcited by 70
  11. 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 68
  12. 2022Weakly Supervised Representation Learning with Sparse Perturbationscited by 65
  13. 2022Temporally Disentangled Representation Learningcited by 61
  14. 2023Causal Component Analysiscited by 56
  15. 2020A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluationcited by 52
  16. 2022Causal Representation Learning for Instantaneous and Temporal Effects in Interactive Systemscited by 51
  17. 2022Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learningcited by 44
  18. 2020Domain Adaptation as a Problem of Inference on Graphical Modelscited by 36
  19. 2023General Identifiability and Achievability for Causal Representation Learningcited by 34
  20. 2023A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variablescited by 33
  21. 2023Leveraging sparse and shared feature activations for disentangled representation learningcited by 32
  22. 2024Unifying Causal Representation Learning with the Invariance Principlecited by 31
  23. 2023Identification of Nonlinear Latent Hierarchical Modelscited by 27
  24. 2023Multi-Domain Causal Representation Learning via Weak Distributional Invariancescited by 23
  25. 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 23
  26. 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
  27. 2022The Projected Covariance Measure for assumption-lean variable significance testingcited by 16
  28. 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 13
  29. 2024Smoke and Mirrors in Causal Downstream Taskscited by 12
  30. 2023Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variablescited by 11
  31. 2024Automated Discovery of Pairwise Interactions from Unstructured Datacited by 8
  32. 2025Sanity Checking Causal Representation Learning on a Simple Real-World Systemcited by 5
  33. 2022A general framework for the analysis of kernel-based testscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Linear Causal Representation Learning by Topological Ordering, Pruning, and Disentanglement
  2. 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era
  3. 2026CausalReasoningBenchmark: A Real-World Benchmark for Disentangled Evaluation of Causal Identification and Estimation
  4. 2026Causality is Key for Interpretability Claims to Generalise
  5. 2024Discovering and Reasoning of Causality in the Hidden World with Large Language Models
  6. 2025Causality can systematically address the monsters under the bench(marks)
  7. 2025Addressing divergent representations from causal interventions on neural networks
  8. 2025Correlation or Causation: Analyzing the Causal Structures of LLM and LRM Reasoning Process