mlsanityData to 7 Oct 2026

Finer-CAM: Spotting the Difference Reveals Finer Details for Visual Explanation

arXiv 2501.11309 ↗First posted 20 Jan 2025cs.CV cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish visually similar fine-grained classes. Prior efforts address this limitation by introducing more sophisticated explanation processes, but at the cost of extra complexity. In this paper, we propose Finer-CAM, a method that retains CAM's efficiency while achieving precise localization of discriminative regions. Our key insight is that the deficiency of CAM lies not in "how" it explains, but in "what" it explains. Specifically, previous methods attempt to identify all cues contributing to the target class's logit value, which inadvertently also activates regions predictive of visually similar classes. By explicitly comparing the target class with similar classes and spotting their differences, Finer-CAM suppresses features shared with other classes and emphasizes the unique, discriminative details of the target class. Finer-CAM is easy to implement, compatible with various CAM methods, and can be extended to multi-modal models for accurate localization of specific concepts. Additionally, Finer-CAM allows adjustable comparison strength, enabling users to selectively highlight coarse object contours or fine discriminative details. Quantitatively, we show that masking out the top 5% of activated pixels by Finer-CAM results in a larger relative confidence drop compared to baselines. The source code and demo are available at https://github.com/Imageomics/Finer-CAM.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 20 Jan 2025.

Builds on

33 of 46 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  8. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  9. 2014Going Deeper with Convolutionscited by 4,231
  10. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  11. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  12. 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
21 more
  1. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  2. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  3. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  4. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  5. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  6. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  7. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
  8. 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
  9. 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 257
  10. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
  11. 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
  12. 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
  13. 2019Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognitioncited by 95
  14. 2023Grounding Everything: Emerging Localization Properties in Vision-Language Transformerscited by 89
  15. 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
  16. 2020There and Back Again: Revisiting Backpropagation Saliency Methodscited by 60
  17. 2023A Simple Interpretable Transformer for Fine-Grained Image Classification and Analysiscited by 15
  18. 2024Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metricscited by 15
  19. 2017Learning Functional Causal Models with Generative Neural Networkscited by 14
  20. 2022Deletion and Insertion Tests in Regression Modelscited by 14
  21. 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Imagescited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 9.

14 papers.

Sort:

By area: