CAMBench-QR : A Structure-Aware Benchmark for Post-Hoc Explanations with QR Understanding
Not on the map. Why?
Abstract (arXiv)
Visual explanations are often plausible but not structurally faithful. We introduce CAMBench-QR, a structure-aware benchmark that leverages the canonical geometry of QR codes (finder patterns, timing lines, module grid) to test whether CAM methods place saliency on requisite substructures while avoiding background. CAMBench-QR synthesizes QR/non-QR data with exact masks and controlled distortions, and reports structure-aware metrics (Finder/Timing Mass Ratios, Background Leakage, coverage AUCs, Distance-to-Structure) alongside causal occlusion, insertion/deletion faithfulness, robustness, and latency. We benchmark representative, efficient CAMs (LayerCAM, EigenGrad-CAM, XGrad-CAM) under two practical regimes of zero-shot and last-block fine-tuning. The benchmark, metrics, and training recipes provide a simple, reproducible yardstick for structure-aware evaluation of visual explanations. Hence we propose that CAMBENCH-QR can be used as a litmus test of whether visual explanations are truly structure-aware.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 20 Sep 2025.
Builds on
21 of 26 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2022A ConvNet for the 2020scited by 3,579
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 320
9 more
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 310
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
- 2023FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methodscited by 50
- 2020SS-CAM: Smoothed Score-CAM for Sharper Visual Feature Localizationcited by 46
- 2021Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networkscited by 36
- 2020IS-CAM: Integrated Score-CAM for axiomatic-based explanationscited by 29
- 2023Assessing Fidelity in XAI post-hoc techniques: A Comparative Study with Ground Truth Explanations Datasetscited by 15
Built on by
Not cited yet.