mlsanityData to 7 Oct 2026

Explaining Object Detectors via Collective Contribution of Pixels

arXiv 2412.00666 ↗First posted 1 Dec 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Visual explanations for object detectors are crucial for enhancing their reliability. Object detectors identify and localize instances by assessing multiple visual features collectively. When generating explanations, overlooking these collective influences in detections may lead to missing compositional cues or capturing spurious correlations. However, existing methods typically focus solely on individual pixel contributions, neglecting the collective contribution of multiple pixels. To address this limitation, we propose a game-theoretic method based on Shapley values and interactions to explicitly capture both individual and collective pixel contributions. Our method provides explanations for both bounding box localization and class determination, highlighting regions crucial for detection. Extensive experiments demonstrate that the proposed method identifies important regions more accurately than state-of-the-art methods. The code is available at https://github.com/tttt-0814/VX-CODE

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 1 Dec 2024.

Builds on

52 of 74 references.

References · 52

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  9. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  12. 2015Fast R-CNNcited by 2,930
38 more
  1. 2018YOLOv3: An Incremental Improvementcited by 2,652
  2. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  4. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  5. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
  6. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
  7. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  8. 2016YOLO9000: Better, Faster, Strongercited by 1,429
  9. 2018Sanity Checks for Saliency Mapscited by 1,149
  10. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  11. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  12. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  13. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  14. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  15. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
  16. 2019The many Shapley values for model explanationcited by 341
  17. 2016Top-down Neural Attention by Excitation Backpropcited by 318
  18. 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
  19. 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
  20. 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
  21. 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
  22. 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 74
  23. 2021Towards Better Explanations of Class Activation Mappingcited by 47
  24. 2018Understanding Individual Decisions of CNNs via Contrastive Backpropagationcited by 40
  25. 2021Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networkscited by 36
  26. 2020One Explanation is Not Enough: Structured Attention Graphs for Image Classificationcited by 32
  27. 2022Shap-CAM: Visual Explanations for Convolutional Neural Networks based on Shapley Valuecited by 23
  28. 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
  29. 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
  30. 2021PredDiff: Explanations and Interactions from Conditional Expectationscited by 16
  31. 2021Circle Representation for Medical Object Detectioncited by 15
  32. 2023Towards Better Explanations for Object Detectioncited by 14
  33. 2022Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methodscited by 12
  34. 2024When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Datasetcited by 10
  35. 2024Enhancing Wrist Fracture Detection with YOLOcited by 6
  36. 2024Identifying Important Group of Pixels using Interactionscited by 5
  37. 2023Multiple Different Black Box Explanations for Image Classifierscited by 4
  38. 2023BSED: Baseline Shapley-Based Explainable Detectorcited by 3

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.