Finer-CAM: Spotting the Difference Reveals Finer Details for Visual Explanation
Not on the map. Why?
Abstract (arXiv)
Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish visually similar fine-grained classes. Prior efforts address this limitation by introducing more sophisticated explanation processes, but at the cost of extra complexity. In this paper, we propose Finer-CAM, a method that retains CAM's efficiency while achieving precise localization of discriminative regions. Our key insight is that the deficiency of CAM lies not in "how" it explains, but in "what" it explains. Specifically, previous methods attempt to identify all cues contributing to the target class's logit value, which inadvertently also activates regions predictive of visually similar classes. By explicitly comparing the target class with similar classes and spotting their differences, Finer-CAM suppresses features shared with other classes and emphasizes the unique, discriminative details of the target class. Finer-CAM is easy to implement, compatible with various CAM methods, and can be extended to multi-modal models for accurate localization of specific concepts. Additionally, Finer-CAM allows adjustable comparison strength, enabling users to selectively highlight coarse object contours or fine discriminative details. Quantitatively, we show that masking out the top 5% of activated pixels by Finer-CAM results in a larger relative confidence drop compared to baselines. The source code and demo are available at https://github.com/Imageomics/Finer-CAM.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 20 Jan 2025.
Builds on
33 of 46 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2014Going Deeper with Convolutionscited by 4,231
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
21 more
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
- 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 257
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
- 2019Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognitioncited by 95
- 2023Grounding Everything: Emerging Localization Properties in Vision-Language Transformerscited by 89
- 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
- 2020There and Back Again: Revisiting Backpropagation Saliency Methodscited by 60
- 2023A Simple Interpretable Transformer for Fine-Grained Image Classification and Analysiscited by 15
- 2024Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metricscited by 15
- 2017Learning Functional Causal Models with Generative Neural Networkscited by 14
- 2022Deletion and Insertion Tests in Regression Modelscited by 14
- 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Imagescited by 9
Built on by
Citing papers per year: 2025: 5; 2026: 9.
14 papers.
Sort:
By area:
- 2025AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Modelscited by 5
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Modelscited by 3
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2026MaskDiME: Adaptive Masked Diffusion for Precise and Efficient Visual Counterfactual Explanationscited by 2
- 2026Explanation-Guided Adversarial Training for Robust and Interpretable Modelscited by 1
- 2026Diffusion-CAM: Faithful Visual Explanations for dMLLMscited by 1
- 2025TextCAM: Explaining Class Activation Map with Textcited by 0
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Mapscited by 0
- 2026Learning Quantifiable Visual Explanations Without Ground-Truthcited by 0
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Studycited by 0
- 2026Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformerscited by 0
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanationscited by 0
- 2026A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data11 Sep 2026
- 2026Signal or Noise? Auditing Rotation-Induced Saliency Drift in Medical and Aerial Imaging2 Sep 2026
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanations12 Aug 2026
- 2026Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformers11 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026Learning Quantifiable Visual Explanations Without Ground-Truth18 May 2026
- 2026Diffusion-CAM: Faithful Visual Explanations for dMLLMs13 Apr 2026
- 2026Explanation-Guided Adversarial Training for Robust and Interpretable Models2 Mar 2026
- 2026MaskDiME: Adaptive Masked Diffusion for Precise and Efficient Visual Counterfactual Explanations21 Feb 2026
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Maps5 Nov 2025
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Models23 Oct 2025
- 2025TextCAM: Explaining Class Activation Map with Text1 Oct 2025
2 more
- 2026Diffusion-CAM: Faithful Visual Explanations for dMLLMscited by 1
- 2026Diffusion-CAM: Faithful Visual Explanations for dMLLMs13 Apr 2026
- 2025AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Modelscited by 5
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Modelscited by 3
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2026Explanation-Guided Adversarial Training for Robust and Interpretable Modelscited by 1
- 2025TextCAM: Explaining Class Activation Map with Textcited by 0
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Mapscited by 0
- 2026Learning Quantifiable Visual Explanations Without Ground-Truthcited by 0
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Studycited by 0
- 2026Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformerscited by 0
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanationscited by 0
- 2026Signal or Noise? Auditing Rotation-Induced Saliency Drift in Medical and Aerial Imagingcited by 0
- 2026A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Datacited by 0
- 2026A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data11 Sep 2026
- 2026Signal or Noise? Auditing Rotation-Induced Saliency Drift in Medical and Aerial Imaging2 Sep 2026
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanations12 Aug 2026
- 2026Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformers11 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026Learning Quantifiable Visual Explanations Without Ground-Truth18 May 2026
- 2026Explanation-Guided Adversarial Training for Robust and Interpretable Models2 Mar 2026
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Maps5 Nov 2025
- 2025BioCAP: Exploiting Synthetic Captions Beyond Labels in Biological Foundation Models23 Oct 2025
- 2025TextCAM: Explaining Class Activation Map with Text1 Oct 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Models10 Jun 2025