TriGuard: Testing Model Safety with Attribution Entropy, Verification, and Drift
Not on the map. Why?
Abstract (arXiv)
Deep neural networks often achieve high accuracy, but ensuring their reliability under adversarial and distributional shifts remains a pressing challenge. We propose TriGuard, a unified safety evaluation framework that combines (1) formal robustness verification, (2) attribution entropy to quantify saliency concentration, and (3) a novel Attribution Drift Score measuring explanation stability. TriGuard reveals critical mismatches between model accuracy and interpretability: verified models can still exhibit unstable reasoning, and attribution-based signals provide complementary safety insights beyond adversarial accuracy. Extensive experiments across three datasets and five architectures show how TriGuard uncovers subtle fragilities in neural reasoning. We further demonstrate that entropy-regularized training reduces explanation drift without sacrificing performance. TriGuard advances the frontier in robust, interpretable model evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
20 of 30 references.
References · 20
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2017Interpretation of Neural Networks is Fragilecited by 444
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
8 more
- 2017The (Un)reliability of saliency methodscited by 333
- 2018On the Robustness of Interpretability Methodscited by 314
- 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 206
- 2019Towards Stable and Efficient Training of Verifiably Robust Neural Networkscited by 205
- 2020Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifierscited by 187
- 2018Training verified learners with learned verifierscited by 50
- 2021Sanity Simulations for Saliency Methodscited by 15
Built on by
Not cited yet.