Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability
On the map: Mechanistic interpretability → Circuits and mechanistic analysis
Abstract (arXiv)
The increasing complexity of AI systems has made understanding their behavior critical. Numerous interpretability methods have been developed to attribute model behavior to three key aspects: input features, training data, and internal model components, which emerged from explainable AI, data-centric AI, and mechanistic interpretability, respectively. However, these attribution methods are studied and applied rather independently, resulting in a fragmented landscape of methods and terminology. This position paper argues that feature, data, and component attribution methods share fundamental similarities, and a unified view of them benefits both interpretability and broader AI research. To this end, we first analyze popular methods for these three types of attributions and present a unified view demonstrating that these seemingly distinct methods employ similar techniques (such as perturbations, gradients, and linear approximations) over different aspects and thus differ primarily in their perspectives rather than techniques. Then, we demonstrate how this unified view enhances understanding of existing attribution methods, highlights shared concepts and evaluation criteria among these methods, and leads to new research directions both in interpretability research, by addressing common challenges and facilitating cross-attribution innovation, and in AI more broadly, with applications in model editing, steering, and regulation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Circuits and mechanistic analysis, one of 13 directions in Mechanistic interpretability. Builds on 82 of its 104 references that are in the map. First posted on arXiv 31 Jan 2025.
Builds on
82 of 104 references.
Closest ancestors · 6
Same direction, newest first
- 2024The Computational Complexity of Circuit Discovery for Inner Interpretability10 Oct
- 2024A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models2 Jul
- 2024Mechanistic Interpretability for AI Safety -- A Review22 Apr
- 2023Attribution Patching Outperforms Automated Circuit Discovery16 Oct
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretability28 Apr
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small1 Nov
Other references · 76
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
38 more
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2020Concept Bottleneck Modelscited by 1,032
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2021Editing Factual Knowledge in Language Modelscited by 553
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2021Fast Model Editing at Scalecited by 498
- 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
- 2021Causal Abstractions of Neural Networkscited by 422
- 2019The many Shapley values for model explanationcited by 344
- 2023Studying Large Language Model Generalization with Influence Functionscited by 326
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2013Direct and Indirect Effectscited by 280
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 255
- 2018Learning to Explain: An Information-Theoretic Perspective on Model Interpretationcited by 248
- 2017Real Time Image Saliency for Black Box Classifierscited by 246
- 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
- 2016Grad-CAM: Why did you say that?cited by 161
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2021Scaling Up Influence Functionscited by 132
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 129
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126
- 2020FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debuggingcited by 120
50 most cited of 76 All 76 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective
- 2026Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods
- 2026The Standard Interpretable Model: A general theory of interpretable machine learning to deductively design interpretable methods using Lagrangian mechanics
- 2025Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii
- 2026The Metagame of Interpretability and Meta-Attributions
- 2025Explainable artificial intelligence (XAI): from inherent explainability to large language models
- 2026From Attribution to Action: A Human-Centered Application of Activation Steering
- 2026From Features to Actions: Explainability in Traditional and Agentic AI Systems