mlsanityData to 14 Oct 2026

Minimizing False-Positive Attributions in Explanations of Non-Linear Models

arXiv 2505.11210 ↗First posted 16 May 2025cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Suppressor variables can influence model predictions without being dependent on the target outcome, and they pose a significant challenge for Explainable AI (XAI) methods. These variables may cause false-positive feature attributions, undermining the utility of explanations. Although effective remedies exist for linear models, their extension to non-linear models and instance-based explanations has remained limited. We introduce PatternLocal, a novel XAI technique that addresses this gap. PatternLocal begins with a locally linear surrogate, e.g., LIME, KernelSHAP, or gradient-based methods, and transforms the resulting discriminative model weights into a generative representation, thereby suppressing the influence of suppressor variables while preserving local fidelity. In extensive hyperparameter optimization on the XAI-TRIS benchmark, PatternLocal consistently outperformed other XAI methods and reduced false-positive attributions when explaining non-linear tasks, thereby enabling more reliable and actionable insights. We further evaluate PatternLocal on an EEG motor imagery dataset, demonstrating physiologically plausible explanations.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

21 of 38 references.

References · 21

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  4. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  5. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  6. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  7. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  8. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  9. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
  10. 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 126
  11. 2019Towards Explainable Artificial Intelligencecited by 106
  12. 2022XAI for Transformers: Better Explanations through Conservative Propagationcited by 100
9 more
  1. 2017Learning how to explain neural networks: PatternNet and PatternAttributioncited by 84
  2. 2023GLIME: General, Stable and Local LIME Explanationcited by 21
  3. 2021Scrutinizing XAI using linear ground-truth data with suppressor variablescited by 18
  4. 2021PredDiff: Explanations and Interactions from Conditional Expectationscited by 17
  5. 2023Theoretical Behavior of XAI Methods in the Presence of Suppressor Variablescited by 12
  6. 2015Causal interpretation rules for encoding and decoding models in neuroimagingcited by 10
  7. 2023Benchmarking the Influence of Pre-training on Explanation Performance in MR Image Classificationcited by 8
  8. 2023XAI-TRIS: Non-linear image benchmarks to quantify false positive post-hoc attribution of feature importancecited by 7
  9. 2024Explainable AI needs formalizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.