mlsanityData to 14 Oct 2026

When Do Learned Blocks Preserve Causal Meaning? Block Identifiability and Constructive Causal Abstractions

arXiv 2610.18155 ↗First posted 13 Oct 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Standard identifiability theory assumes one-dimensional latent factors, but learned representations can encode latent information across multidimensional blocks whose internal coordinates are not uniquely determined. When such blocks are used to represent and intervene on higher-level concepts, it is unclear whether their causal meaning survives the transformations left unresolved by block-identifiability. We connect block-identifiability to constructive causal abstraction. We show that block-diagonal invertible transformations followed by compatible coordinate permutations form the maximal class that preserves every constructive causal abstraction built on those blocks. This guarantee assumes that the correspondence between blocks and concepts is updated with the representation. A small synthetic experiment with additive autoencoders shows that high-level interventions can be transferred between independently learned representations while approximately preserving their intended effects.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

14 of 25 references.

References · 14

  1. 2020Object-Centric Learning with Slot Attentioncited by 876
  2. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  3. 2021Causal Abstractions of Neural Networkscited by 422
  4. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
  5. 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 209
  6. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
  7. 2017Causal Consistency of Structural Equation Modelscited by 118
  8. 2025Sparse Autoencoders Do Not Find Canonical Units of Analysiscited by 88
  9. 2019Approximate Causal Abstractioncited by 63
  10. 2023Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolationcited by 58
  11. 2023Jointly Learning Consistent Causal Abstractions Over Multiple Interventional Distributionscited by 23
  12. 2025From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?cited by 7
2 more
  1. 2026Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifoldscited by 5
  2. 2026Unsupervised Causal Abstractions Discoverycited by 1

Built on by

Not cited yet.