mlsanityData to 7 Oct 2026

Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning

arXiv 2510.12957 ↗First posted 14 Oct 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We treat the internals of generative models as mechanistic objects rather than black boxes. We introduce Attribution Graphs (AGs), which extend GradCAM++ to circuit-level representations, and Causal Probing, a do-calculus intervention method for identifying causal latent structures, enabling detection and correction of spurious correlations, demographic biases, and misaligned decision circuits during training. We further propose the Cognitive Alignment Score (CAS), quantifying agreement between model-internal representations and human concepts, a saliency-first privacy mechanism sharing only thresholded attribution nodes, a bias-aware regularizer aligning subgroup statistics, and a Reveal-to-Revise loop integrating attribution signals into parameter updates without separate fine-tuning. Evaluated on CelebA, FairFace, Jigsaw, and HateXplain, our method achieves 94.1% accuracy, 92.3% macro F1, 79.4% IoU-XAI, and 12.7 FID at 72--76% adversarial robustness, while reducing subgroup disparity Deltabias by 41%, demonstrating that mechanistic interpretability, fairness, and generative performance can be jointly optimized.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

38 of 56 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  9. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  10. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  11. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  12. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
26 more
  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  4. 2016Improved Techniques for Training GANscited by 2,938
  5. 2014Conditional Generative Adversarial Netscited by 2,152
  6. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  7. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  8. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  9. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  10. 2016Adversarial Machine Learning at Scalecited by 934
  11. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  12. 2018Robustness May Be at Odds with Accuracycited by 873
  13. 2017Deep Reinforcement Learning that Matterscited by 727
  14. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  15. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  16. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
  17. 2017Generative Adversarial Networks: An Overviewcited by 588
  18. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
  19. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
  20. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
  21. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  22. 2019Explanations can be manipulated and geometry is to blamecited by 215
  23. 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
  24. 2019FairFace: Face Attribute Dataset for Balanced Race, Gender, and Agecited by 87
  25. 2019Ablation Studies in Artificial Neural Networkscited by 58
  26. 2023Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Modelscited by 17

Built on by

Not cited yet.