mlsanityData to 14 Oct 2026

In Defence of Post-hoc Explainability

arXiv 2412.17883 ↗First posted 23 Dec 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This position paper defends post-hoc explainability methods as legitimate tools for scientific knowledge production in machine learning. Addressing criticism of these methods' reliability and epistemic status, we develop a philosophical framework grounded in mediated understanding and bounded factivity. We argue that scientific insights can emerge through structured interpretation of model behaviour without requiring complete mechanistic transparency, provided explanations acknowledge their approximative nature and undergo rigorous empirical validation. Through analysis of recent biomedical ML applications, we demonstrate how post-hoc methods, when properly integrated into scientific practice, generate novel hypotheses and advance phenomenal understanding.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 23 Dec 2024.

Builds on

21 of 44 references.

References · 21

  1. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  2. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  3. 2016The Mythos of Model Interpretabilitycited by 721
  4. 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
  5. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
  6. 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
  7. 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
  8. 2019The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanationscited by 97
  9. 2022Impossibility Theorems for Feature Attributioncited by 78
  10. 2022Post hoc Explanations may be Ineffective for Detecting Unknown Spurious Correlationcited by 59
  11. 2019Issues with post-hoc counterfactual explanations: a discussioncited by 30
  12. 2019Evaluating Explanation Without Ground Truth in Interpretable Machine Learningcited by 29
9 more
  1. 2023Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Sciencecited by 27
  2. 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
  3. 2022Scientific Inference With Interpretable Machine Learning: Analyzing Models to Learn About Real-World Phenomenacited by 21
  4. 2024The Computational Complexity of Circuit Discovery for Inner Interpretabilitycited by 15
  5. 2024Interpretability Needs a New Paradigmcited by 11
  6. 2022Social Construction of XAI: Do We Need One Definition to Rule Them All?cited by 6
  7. 2024Revisiting the robustness of post-hoc interpretability methodscited by 5
  8. 2023Artificial Neural Nets and the Representation of Human Conceptscited by 3
  9. 2023Structural Risk Minimization for Learning Nonlinear Dynamicscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.