Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning
Not on the map. Why?
Abstract (arXiv)
We treat the internals of generative models as mechanistic objects rather than black boxes. We introduce Attribution Graphs (AGs), which extend GradCAM++ to circuit-level representations, and Causal Probing, a do-calculus intervention method for identifying causal latent structures, enabling detection and correction of spurious correlations, demographic biases, and misaligned decision circuits during training. We further propose the Cognitive Alignment Score (CAS), quantifying agreement between model-internal representations and human concepts, a saliency-first privacy mechanism sharing only thresholded attribution nodes, a bias-aware regularizer aligning subgroup statistics, and a Reveal-to-Revise loop integrating attribution signals into parameter updates without separate fine-tuning. Evaluated on CelebA, FairFace, Jigsaw, and HateXplain, our method achieves 94.1% accuracy, 92.3% macro F1, 79.4% IoU-XAI, and 12.7 FID at 72--76% adversarial robustness, while reducing subgroup disparity Deltabias by 41%, demonstrating that mechanistic interpretability, fairness, and generative performance can be jointly optimized.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
38 of 56 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
26 more
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Improved Techniques for Training GANscited by 2,938
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2016Adversarial Machine Learning at Scalecited by 934
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2017Deep Reinforcement Learning that Matterscited by 727
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
- 2017Generative Adversarial Networks: An Overviewcited by 588
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
- 2019Explanations can be manipulated and geometry is to blamecited by 215
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2019FairFace: Face Attribute Dataset for Balanced Race, Gender, and Agecited by 87
- 2019Ablation Studies in Artificial Neural Networkscited by 58
- 2023Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Modelscited by 17
Built on by
Not cited yet.