mlsanityData to 14 Oct 2026

OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data

arXiv 2204.06577 ↗First posted 13 Apr 2022cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

While 3D object detection in LiDAR point clouds is well-established in academia and industry, the explainability of these models is a largely unexplored field. In this paper, we propose a method to generate attribution maps for the detected objects in order to better understand the behavior of such models. These maps indicate the importance of each 3D point in predicting the specific objects. Our method works with black-box models: We do not require any prior knowledge of the architecture nor access to the model's internals, like parameters, activations or gradients. Our efficient perturbation-based approach empirically estimates the importance of each point by testing the model with randomly generated subsets of the input point cloud. Our sub-sampling strategy takes into account the special characteristics of LiDAR data, such as the depth-dependent point density. We show a detailed evaluation of the attribution maps and demonstrate that they are interpretable and highly informative. Furthermore, we compare the attribution maps of recent 3D object detection architectures to provide insights into their decision-making processes.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 13 Apr 2022.

Builds on

52 of 63 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  8. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  9. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  10. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  11. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  12. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
38 more
  1. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  2. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  3. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  4. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  5. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  6. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  7. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
  8. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  9. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
  10. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
  11. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 612
  12. 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
  13. 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 410
  14. 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 368
  15. 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
  16. 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
  17. 2016Top-down Neural Attention by Excitation Backpropcited by 321
  18. 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
  19. 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 259
  20. 2021Voxel Transformer for 3D Object Detectioncited by 247
  21. 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
  22. 20203D Object Detection with Pointformercited by 194
  23. 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 190
  24. 2017Visualizing Deep Neural Network Decisions: Prediction Difference Analysiscited by 166
  25. 2020Pillar-based Object Detection for Autonomous Drivingcited by 137
  26. 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
  27. 2018PointCloud Saliency Mapscited by 112
  28. 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
  29. 2019Extending Adversarial Attacks and Defenses to Deep 3D Point Cloud Classifierscited by 92
  30. 2020HVNet: Hybrid Voxel Network for LiDAR Based 3D Object Detectioncited by 82
  31. 2021Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detectioncited by 79
  32. 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 76
  33. 2021M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformerscited by 74
  34. 2019Adversarial Attack and Defense on Point Setscited by 63
  35. 2020There and Back Again: Revisiting Backpropagation Saliency Methodscited by 60
  36. 2019Robustness of 3D Deep Learning in an Adversarial Settingcited by 55
  37. 2021HVPR: Hybrid Voxel-Point Representation for Single-stage 3D Object Detectioncited by 47
  38. 2020Minimal Adversarial Examples for Deep Learning on 3D Point Cloudscited by 41

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 3; 2025: 4; 2026: 1.

13 papers.

Sort: