mlsanityData to 14 Oct 2026

Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability

arXiv 2501.18887 ↗First posted 31 Jan 2025cs.LG cs.AIcited by 3

On the map: Mechanistic interpretability → Circuits and mechanistic analysis

Abstract (arXiv)

The increasing complexity of AI systems has made understanding their behavior critical. Numerous interpretability methods have been developed to attribute model behavior to three key aspects: input features, training data, and internal model components, which emerged from explainable AI, data-centric AI, and mechanistic interpretability, respectively. However, these attribution methods are studied and applied rather independently, resulting in a fragmented landscape of methods and terminology. This position paper argues that feature, data, and component attribution methods share fundamental similarities, and a unified view of them benefits both interpretability and broader AI research. To this end, we first analyze popular methods for these three types of attributions and present a unified view demonstrating that these seemingly distinct methods employ similar techniques (such as perturbations, gradients, and linear approximations) over different aspects and thus differ primarily in their perspectives rather than techniques. Then, we demonstrate how this unified view enhances understanding of existing attribution methods, highlights shared concepts and evaluation criteria among these methods, and leads to new research directions both in interpretability research, by addressing common challenges and facilitating cross-attribution innovation, and in AI more broadly, with applications in model editing, steering, and regulation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Circuits and mechanistic analysis, one of 13 directions in Mechanistic interpretability. Builds on 82 of its 104 references that are in the map. First posted on arXiv 31 Jan 2025.

Builds on

82 of 104 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024The Computational Complexity of Circuit Discovery for Inner Interpretability10 Oct
  2. 2024A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models2 Jul
  3. 2024Mechanistic Interpretability for AI Safety -- A Review22 Apr
  4. 2023Attribution Patching Outperforms Automated Circuit Discovery16 Oct
  5. 2023Towards Automated Circuit Discovery for Mechanistic Interpretability28 Apr
  6. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small1 Nov

Other references · 76

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  6. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  7. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  8. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  9. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  10. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  11. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  12. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
38 more
  1. 2018Sanity Checks for Saliency Mapscited by 1,156
  2. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  3. 2020Concept Bottleneck Modelscited by 1,032
  4. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  5. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  6. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
  7. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
  8. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  9. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  10. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
  11. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  12. 2021Editing Factual Knowledge in Language Modelscited by 553
  13. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
  14. 2021Fast Model Editing at Scalecited by 498
  15. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
  16. 2021Causal Abstractions of Neural Networkscited by 422
  17. 2019The many Shapley values for model explanationcited by 344
  18. 2023Studying Large Language Model Generalization with Influence Functionscited by 326
  19. 2023TRAK: Attributing Model Behavior at Scalecited by 283
  20. 2013Direct and Indirect Effectscited by 280
  21. 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 255
  22. 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
  23. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  24. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
  25. 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
  26. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  27. 2022Datamodels: Predicting Predictions from Training Datacited by 189
  28. 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
  29. 2016Grad-CAM: Why did you say that?cited by 161
  30. 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
  31. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
  32. 2019The Shapley Taylor Interaction Indexcited by 143
  33. 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
  34. 2021Scaling Up Influence Functionscited by 132
  35. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
  36. 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 129
  37. 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126
  38. 2020FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debuggingcited by 120

50 most cited of 76 All 76 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective
  2. 2026Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods
  3. 2026The Standard Interpretable Model: A general theory of interpretable machine learning to deductively design interpretable methods using Lagrangian mechanics
  4. 2025Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii
  5. 2026The Metagame of Interpretability and Meta-Attributions
  6. 2025Explainable artificial intelligence (XAI): from inherent explainability to large language models
  7. 2026From Attribution to Action: A Human-Centered Application of Activation Steering
  8. 2026From Features to Actions: Explainability in Traditional and Agentic AI Systems