mlsanityData to 14 Oct 2026

Posterior-Calibrated Causal Circuits in Variational Autoencoders: Why Image-Domain Interpretability Fails on Tabular Data

arXiv 2603.21236 ↗First posted 22 Mar 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Although mechanism-based interpretability has generated an abundance of insight for discriminative network analysis, generative models are less understood -- particularly outside of image-related applications. We investigate how much of the causal circuitry found within image-related variational autoencoders (VAEs) will generalize to tabular data, as VAEs are increasingly used for imputation, anomaly detection, and synthetic data generation. In addition to extending a four-level causal intervention framework to four tabular and one image benchmark across five different VAE architectures (with 75 individual training runs per architecture and three random seed values for each run), this paper introduces three new techniques: posterior-calibration of Causal Effect Strength (CES), path-specific activation patching, and Feature-Group Disentanglement (FGD). The results from our experiments demonstrate that: (i) Tabular VAEs have circuits with modularity that is approximately 50% lower than their image counterparts. (ii) β-VAE experiences nearly complete collapse in CES scores when applied to heterogeneous tabular features (0.043 CES score for tabular data compared to 0.133 CES score for images), which can be directly attributed to reconstruction quality degradation (r = -0.886 correlation coefficient between CES and MSE). (iii) CES successfully captures nine of eleven statistically significant architecture differences using Holm--vSid'ak corrections. (iv) Interventions with high specificity predict the highest downstream AUC values (r = 0.460, p < .001). This study challenges the common assumption that architectural guidance from image-related studies can be transferred to tabular datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

20 of 40 references.

References · 20

  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  5. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  6. 2016Deep Variational Information Bottleneckcited by 930
  7. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  8. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  9. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
  10. 2019Modeling Tabular data using Conditional GANcited by 699
  11. 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
  12. 2018Disentangling by Factorisingcited by 616
8 more
  1. 2021Causal Abstractions of Neural Networkscited by 422
  2. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
  3. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
  4. 2018Synthesizing Tabular Data using Generative Adversarial Networkscited by 92
  5. 2018EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAEcited by 87
  6. 2019Theory and Evaluation Metrics for Learning Disentangled Representationscited by 57
  7. 2020A Commentary on the Unsupervised Learning of Disentangled Representationscited by 13
  8. 2025A Multi-Level Causal Intervention Framework for Mechanistic Interpretability in Variational Autoencoderscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Analyzing (In)Abilities of SAEs via Formal Languages
  2. 2026From Geometric Recovery to Causal Validation: A Reproducible Audit of Sparse Autoencoder Features, from Superposition Geometry to Causal Inertness
  3. 2025Beyond the Black Box: Identifiable Interpretation and Control in Generative Models via Causal Minimality
  4. 2025Interpretable and Testable Vision Features via Sparse Autoencoders
  5. 2026Causal Dimensionality of Transformer Representations: Measurement, Scaling, and Layer Structure
  6. 2025Sparse Autoencoders, Again?
  7. 2025CoVAE: Consistency Training of Variational Autoencoders
  8. 2026Representational Simplicity and Circuit Size Dissociate in a Threshold-Dependent Way: A Controlled Test via Adversarial Training