Explaining Object Detectors via Collective Contribution of Pixels
Not on the map. Why?
Abstract (arXiv)
Visual explanations for object detectors are crucial for enhancing their reliability. Object detectors identify and localize instances by assessing multiple visual features collectively. When generating explanations, overlooking these collective influences in detections may lead to missing compositional cues or capturing spurious correlations. However, existing methods typically focus solely on individual pixel contributions, neglecting the collective contribution of multiple pixels. To address this limitation, we propose a game-theoretic method based on Shapley values and interactions to explicitly capture both individual and collective pixel contributions. Our method provides explanations for both bounding box localization and class determination, highlighting regions crucial for detection. Extensive experiments demonstrate that the proposed method identifies important regions more accurately than state-of-the-art methods. The code is available at https://github.com/tttt-0814/VX-CODE
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 1 Dec 2024.
Builds on
52 of 74 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
38 more
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2019The many Shapley values for model explanationcited by 341
- 2016Top-down Neural Attention by Excitation Backpropcited by 318
- 2018Abduction-Based Explanations for Machine Learning Modelscited by 159
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2021FastSHAP: Real-Time Shapley Value Estimationcited by 123
- 2021Are Convolutional Neural Networks or Transformers more like human vision?cited by 109
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 74
- 2021Towards Better Explanations of Class Activation Mappingcited by 47
- 2018Understanding Individual Decisions of CNNs via Contrastive Backpropagationcited by 40
- 2021Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networkscited by 36
- 2020One Explanation is Not Enough: Structured Attention Graphs for Image Classificationcited by 32
- 2022Shap-CAM: Visual Explanations for Convolutional Neural Networks based on Shapley Valuecited by 23
- 2024Interpreting Object-level Foundation Models via Visual Precision Searchcited by 20
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2021PredDiff: Explanations and Interactions from Conditional Expectationscited by 16
- 2021Circle Representation for Medical Object Detectioncited by 15
- 2023Towards Better Explanations for Object Detectioncited by 14
- 2022Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methodscited by 12
- 2024When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Datasetcited by 10
- 2024Enhancing Wrist Fracture Detection with YOLOcited by 6
- 2024Identifying Important Group of Pixels using Interactionscited by 5
- 2023Multiple Different Black Box Explanations for Image Classifierscited by 4
- 2023BSED: Baseline Shapley-Based Explainable Detectorcited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.