OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data
Not on the map. Why?
Abstract (arXiv)
While 3D object detection in LiDAR point clouds is well-established in academia and industry, the explainability of these models is a largely unexplored field. In this paper, we propose a method to generate attribution maps for the detected objects in order to better understand the behavior of such models. These maps indicate the importance of each 3D point in predicting the specific objects. Our method works with black-box models: We do not require any prior knowledge of the architecture nor access to the model's internals, like parameters, activations or gradients. Our efficient perturbation-based approach empirically estimates the importance of each point by testing the model with randomly generated subsets of the input point cloud. Our sub-sampling strategy takes into account the special characteristics of LiDAR data, such as the depth-dependent point density. We show a detailed evaluation of the attribution maps and demonstrate that they are interpretable and highly informative. Furthermore, we compare the attribution maps of recent 3D object detection architectures to provide insights into their decision-making processes.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 13 Apr 2022.
Builds on
52 of 63 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
38 more
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 410
- 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 368
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 259
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 20203D Object Detection with Pointformercited by 194
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 190
- 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
- 2020Pillar-based Object Detection for Autonomous Drivingcited by 137
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2018PointCloud Saliency Mapscited by 112
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 2019Extending Adversarial Attacks and Defenses to Deep 3D Point Cloud Classifierscited by 92
- 2020HVNet: Hybrid Voxel Network for LiDAR Based 3D Object Detectioncited by 82
- 2021Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detectioncited by 79
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 76
- 2021M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformerscited by 74
- 2019Adversarial Attack and Defense on Point Setscited by 63
- 2020There and Back Again: Revisiting Backpropagation Saliency Methodscited by 60
- 2019Robustness of 3D Deep Learning in an Adversarial Settingcited by 55
- 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
- 2020Minimal Adversarial Examples for Deep Learning on 3D Point Cloudscited by 41
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 3; 2025: 4; 2026: 1.
13 papers.
Sort:
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detectioncited by 13
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perceptioncited by 5
- 2023BSED: Baseline Shapley-Based Explainable Detectorcited by 3
- 2024One Wave To Explain Them All: A Unifying Perspective On Feature Attributioncited by 3
- 2023GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Datacited by 2
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectorscited by 2
- 2025InfoCons: Identifying Interpretable Critical Concepts in Point Clouds via Information Theorycited by 2
- 2025Representation Learning of Point Cloud Upsampling in Global and Local Inputscited by 1
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Drivingcited by 0
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networkscited by 0
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks8 Jun 2025
- 2025InfoCons: Identifying Interpretable Critical Concepts in Point Clouds via Information Theory26 May 2025
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Driving21 Mar 2025
- 2025Representation Learning of Point Cloud Upsampling in Global and Local Inputs13 Jan 2025
- 2024One Wave To Explain Them All: A Unifying Perspective On Feature Attribution2 Oct 2024
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectors21 May 2024
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review8 Feb 2024
- 2023GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Data31 Oct 2023
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perception25 Oct 2023
- 2023BSED: Baseline Shapley-Based Explainable Detector14 Aug 2023
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection16 Jul 2023
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2022Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanationscited by 17
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detectioncited by 13
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perceptioncited by 5
- 2023BSED: Baseline Shapley-Based Explainable Detectorcited by 3
- 2024One Wave To Explain Them All: A Unifying Perspective On Feature Attributioncited by 3
- 2023GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Datacited by 2
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectorscited by 2
- 2025InfoCons: Identifying Interpretable Critical Concepts in Point Clouds via Information Theorycited by 2
- 2025Representation Learning of Point Cloud Upsampling in Global and Local Inputscited by 1
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Drivingcited by 0
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networkscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Towards Trustworthy and Explainable AI for Perception Models: From Concept to Prototype Vehicle Deployment15 May 2026
- 2025Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks8 Jun 2025
- 2025InfoCons: Identifying Interpretable Critical Concepts in Point Clouds via Information Theory26 May 2025
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Driving21 Mar 2025
- 2025Representation Learning of Point Cloud Upsampling in Global and Local Inputs13 Jan 2025
- 2024One Wave To Explain Them All: A Unifying Perspective On Feature Attribution2 Oct 2024
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectors21 May 2024
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review8 Feb 2024
- 2023GACE: Geometry Aware Confidence Enhancement for Black-Box 3D Object Detectors on LiDAR-Data31 Oct 2023
- 2023ParisLuco3D: A high-quality target dataset for domain generalization of LiDAR perception25 Oct 2023
- 2023BSED: Baseline Shapley-Based Explainable Detector14 Aug 2023
- 2023KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection16 Jul 2023
12 newest of 13 All 13 (JSON)