Pillar-based Object Detection for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
We present a simple and flexible object detection framework optimized for autonomous driving. Building on the observation that point clouds in this application are extremely sparse, we propose a practical pillar-based approach to fix the imbalance issue caused by anchors. In particular, our algorithm incorporates a cylindrical projection into multi-view feature learning, predicts bounding box parameters per pillar rather than per point or per anchor, and includes an aligned pillar-to-point projection module to improve the final prediction. Our anchor-free approach avoids hyperparameter search associated with past methods, simplifying 3D object detection while significantly improving upon state-of-the-art.
Key facts. Cited by 137 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 42; 2023: 34; 2024: 16; 2025: 11; 2026: 2.
137 papers.
Sort:
By area:
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
38 more
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 144
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2021RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detectioncited by 115
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
- 2022SWFormer: Sparse Window Transformer for 3D Object Detection in Point Cloudscited by 92
- 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
- 2022Fully Sparse 3D Object Detectioncited by 84
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2021Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detectioncited by 79
- 20213D-MAN: 3D Multi-frame Attention Network for Object Detectioncited by 73
- 2022Point Density-Aware Voxels for LiDAR 3D Object Detectioncited by 70
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detectioncited by 65
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2022Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmapcited by 59
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Drivingcited by 59
- 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2022GD-MAE: Generative Decoder for MAE Pre-training on LiDAR Point Cloudscited by 57
- 2023PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Cloudscited by 54
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2022Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communicationcited by 47
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 20214D-Net for Learned Multi-Modal Alignmentcited by 44
- 2022Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graphcited by 42
- 2021To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernelscited by 39
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Drivingcited by 37
- 2021LIF-Seg: LiDAR and Camera Image Fusion for 3D LiDAR Semantic Segmentationcited by 34
- 2023Super Sparse 3D Object Detectioncited by 32
- 2023DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Cloudscited by 31
- 2022Towards Efficient 3D Object Detection with Knowledge Distillationcited by 29
50 most cited of 137 All 137 (JSON)
- 2026Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces21 Sep 2026
- 2026Mitigating Backdoors via Decoy Shortcuts and Knowledge Decoupling1 Aug 2026
- 2025LiteFusion: Taming 3D Object Detectors from Vision-Based to Multi-Modal with Minimal Adaptation23 Dec 2025
- 2025Learning Adaptive Pseudo-Label Selection for Semi-Supervised 3D Object Detection28 Sep 2025
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 20253DPillars: Pillar-based two-stage 3D object detection6 Sep 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025Rethinking Backbone Design for Lightweight 3D Object Detection in LiDAR1 Aug 2025
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2025GLRD: Global-Local Collaborative Reason and Debate with PSL for 3D Open-Vocabulary Detection26 Mar 2025
- 2025Semantic-Supervised Spatial-Temporal Fusion for LiDAR-based 3D Object Detection13 Mar 2025
- 2025SparseVoxFormer: Sparse Voxel-based Transformer for Multi-modal 3D Object Detection11 Mar 2025
38 more
- 2025RadarNeXt: Real-Time and Reliable 3D Object Detector Based On 4D mmWave Imaging Radar4 Jan 2025
- 2024LiDAttack: Robust Black-box Attack on LiDAR-based Object Detection4 Nov 2024
- 2024Can We Remove the Ground? Obstacle-aware Point Cloud Compression for Remote Object Detection1 Oct 2024
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehicles30 Sep 2024
- 2024Cross-Modal Self-Supervised Learning with Effective Contrastive Units for LiDAR Point Clouds10 Sep 2024
- 2024Selectively Dilated Convolution for Accuracy-Preserving Sparse Pillar-based Embedded 3D Object Detection25 Aug 2024
- 2024Explore the LiDAR-Camera Dynamic Adjustment Fusion for 3D Object Detection22 Jul 2024
- 2024Global-Local Collaborative Inference with LLM for Lidar-Based Open-Vocabulary Detection12 Jul 2024
- 2024BiCo-Fusion: Bidirectional Complementary LiDAR-Camera Fusion for Semantic- and Spatial-Aware 3D Object Detection27 Jun 2024
- 2024DiffuBox: Refining 3D Object Detection with Point Diffusion25 May 2024
- 2024No Time to Train: Empowering Non-Parametric Networks for Few-shot 3D Scene Segmentation5 Apr 2024
- 2024Volumetric Environment Representation for Vision-Language Navigation21 Mar 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2024M"obius Transform for Mitigating Perspective Distortions in Representation Learning7 Mar 2024
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous driving7 Mar 2024
- 2024Leveraging Anchor-based LiDAR 3D Object Detection via Point Assisted Sample Selection4 Mar 2024
- 2024Enhancing Lidar-based Object Detection in Adverse Weather using Offset Sequences in Time17 Jan 2024
- 2023iDet3D: Towards Efficient Interactive Object Detection for LiDAR Point Clouds24 Dec 2023
- 2023Self-supervised Adaptive Weighting for Cooperative Perception in V2V Communications16 Dec 2023
- 2023OpenSight: A Simple Open-Vocabulary Framework for LiDAR-Based Object Detection12 Dec 2023
- 2023Towards Transferable Multi-modal Perception Representation Learning for Autonomy: NeRF-Supervised Masked AutoEncoder23 Nov 2023
- 2023MVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detection25 Oct 2023
- 2023LEF: Late-to-Early Temporal Fusion for LiDAR 3D Object Detection28 Sep 2023
- 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving25 Sep 2023
- 2023SupFusion: Supervised LiDAR-Camera Fusion for 3D Object Detection13 Sep 2023
- 2023Representation Disparity-aware Distillation for 3D Object Detection20 Aug 2023
- 2023PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection8 Aug 2023
- 2023Select2Col: Leveraging Spatial-Temporal Importance of Semantic Information for Efficient Collaborative Perception31 Jul 2023
- 2023R2Det: Redemption from Range-view for Accurate 3D Object Detection21 Jul 2023
- 2023Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labeling16 Jul 2023
- 2023DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds9 Jun 2023
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypotheses9 Jun 2023
- 2023MoDAR: Using Motion Forecasting for 3D Object Detection in Point Cloud Sequences5 Jun 2023
- 2023View-to-Label: Multi-View Consistency for Self-Supervised 3D Object Detection29 May 2023
- 2023DynStatF: An Efficient Feature Fusion Strategy for LiDAR 3D Object Detection24 May 2023
- 2023SPADE: Sparse Pillar-based 3D Object Detection Accelerator for Autonomous Driving12 May 2023
- 2023PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer11 May 2023
- 2023PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds8 May 2023
50 newest of 137 All 137 (JSON)
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2025Perspective-Invariant 3D Object Detectioncited by 16
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers22 Mar 2022
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2022Backdoor Defense via Decoupling the Training Processcited by 149
12 most cited of 131 All 131 (JSON)
- 2026Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces21 Sep 2026
- 2026Mitigating Backdoors via Decoy Shortcuts and Knowledge Decoupling1 Aug 2026
- 2025LiteFusion: Taming 3D Object Detectors from Vision-Based to Multi-Modal with Minimal Adaptation23 Dec 2025
- 2025Learning Adaptive Pseudo-Label Selection for Semi-Supervised 3D Object Detection28 Sep 2025
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 20253DPillars: Pillar-based two-stage 3D object detection6 Sep 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025Rethinking Backbone Design for Lightweight 3D Object Detection in LiDAR1 Aug 2025
- 2025Semantic-Supervised Spatial-Temporal Fusion for LiDAR-based 3D Object Detection13 Mar 2025
- 2025SparseVoxFormer: Sparse Voxel-based Transformer for Multi-modal 3D Object Detection11 Mar 2025
- 2025RadarNeXt: Real-Time and Reliable 3D Object Detector Based On 4D mmWave Imaging Radar4 Jan 2025
- 2024LiDAttack: Robust Black-box Attack on LiDAR-based Object Detection4 Nov 2024
12 newest of 131 All 131 (JSON)