From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Network
Not on the map. Why?
Abstract (arXiv)
3D object detection from LiDAR point cloud is a challenging problem in 3D scene understanding and has many practical applications. In this paper, we extend our preliminary work PointRCNN to a novel and strong point-cloud-based 3D object detection framework, the part-aware and aggregation neural network (Part-A2 net). The whole framework consists of the part-aware stage and the part-aggregation stage. Firstly, the part-aware stage for the first time fully utilizes free-of-charge part supervisions derived from 3D ground-truth boxes to simultaneously predict high quality 3D proposals and accurate intra-object part locations. The predicted intra-object part locations within the same proposal are grouped by our new-designed RoI-aware point cloud pooling module, which results in an effective representation to encode the geometry-specific features of each 3D proposal. Then the part-aggregation stage learns to re-score the box and refine the box location by exploring the spatial relationship of the pooled intra-object part locations. Extensive experiments are conducted to demonstrate the performance improvements from each component of our proposed framework. Our Part-A2 net outperforms all existing 3D detection methods and achieves new state-of-the-art on KITTI 3D object detection dataset by utilizing only the LiDAR point cloud data. Code is available at https://github.com/sshaoshuai/PointCloudDet3D.
Key facts. Cited by 368 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 75; 2022: 91; 2023: 82; 2024: 63; 2025: 45; 2026: 12.
368 papers.
Sort:
By area:
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
38 more
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2021CKConv: Continuous Kernel Convolution For Sequential Datacited by 120
- 2021SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloudcited by 119
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 114
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
- 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
- 2021Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weathercited by 97
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 94
- 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
- 2022Fully Sparse 3D Object Detectioncited by 84
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2023Virtual Sparse Convolution for Multimodal 3D Object Detectioncited by 81
- 2021Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detectioncited by 79
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2021M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformerscited by 74
- 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2022LiDAR Snowfall Simulation for Robust 3D Object Detectioncited by 73
- 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 73
- 2022LargeKernel3D: Scaling up Kernels in 3D Sparse CNNscited by 72
- 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 70
- 2022AutoAlign: Pixel-Instance Feature Aggregation for Multi-Modal 3D Object Detectioncited by 70
- 2022Point Density-Aware Voxels for LiDAR 3D Object Detectioncited by 70
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2021Back-tracing Representative Points for Voting-based 3D Object Detection in Point Cloudscited by 67
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 67
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
50 most cited of 368 All 368 (JSON)
- 2026Beyond the Snowflakes: Disentangling Weather Effects from Confounding Meta-Factors in LiDAR Object Detection9 Oct 2026
- 2026PointLAM: Local Attentive Mamba for Efficient Point-based 3D Object Detection18 Sep 2026
- 2026KSG-Net: Key-Sparse and Global-Context Learning for Maritime 3D Ship Detection2 Sep 2026
- 2026On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection9 Jul 2026
- 2026Comprehensive Robustness Analysis of LiDAR-based 3D Object Detection in Autonomous Driving2 Jul 2026
- 2026Shape-Prior-Based Point Cloud Completion for Single-Stage Fully Sparse 3D Object Detection30 May 2026
- 2026Scene Reconstruction as Mapping Priors for 3D Detection21 May 2026
- 2026Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems11 Apr 2026
- 2026SD4R: Sparse-to-Dense Learning for 3D Object Detection with 4D Radar24 Feb 2026
- 2026Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection23 Feb 2026
- 2026Bonnet: Ultra-fast whole-body bone segmentation from CT scans30 Jan 2026
- 2026LCF3D: A Robust and Real-Time Late-Cascade Fusion Framework for 3D Object Detection in Autonomous Driving14 Jan 2026
38 more
- 2025A Comprehensive Safety Metric to Evaluate Perception in Autonomous Systems16 Dec 2025
- 2025Adaptive Dual-Weighted Gravitational Point Cloud Denoising Method11 Dec 2025
- 2025Generalized Event Partonomy Inference with Structured Hierarchical Predictive Learning3 Dec 2025
- 2025Rethinking the Encoding and Annotating of 3D Bounding Box: Corner-Aware 3D Object Detection from Point Clouds18 Nov 2025
- 2025WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection17 Nov 2025
- 2025UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNs3 Nov 2025
- 2025Been There, Scanned That: Nostalgia-Driven LiDAR Compression for Self-Driving Cars1 Nov 2025
- 2025M^3Detection: Multi-Frame Multi-Level Feature Fusion for Multi-Modal 3D Object Detection with Camera and 4D Imaging Radar31 Oct 2025
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles30 Oct 2025
- 2025Scaling Up Occupancy-centric Driving Scene Generation: Dataset and Method27 Oct 2025
- 2025SFGFusion: Surface Fitting Guided 3D Object Detection with 4D Radar and Camera Fusion22 Oct 2025
- 2025Towards 3D Objectness Learning in an Open World20 Oct 2025
- 2025ALISE: Annotation-Free LiDAR Instance Segmentation for Autonomous Driving7 Oct 2025
- 2025Learning Adaptive Pseudo-Label Selection for Semi-Supervised 3D Object Detection28 Sep 2025
- 20253DPillars: Pillar-based two-stage 3D object detection6 Sep 2025
- 2025PointSlice: Accurate and Efficient Slice-Based Representation for 3D Object Detection from Point Clouds1 Sep 2025
- 2025Enhancing Pseudo-Boxes via Data-Level LiDAR-Camera Fusion for Unsupervised 3D Object Detection28 Aug 2025
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations27 Aug 2025
- 2025SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather22 Aug 2025
- 2025Self-Supervised Sparse Sensor Fusion for Long Range Perception19 Aug 2025
- 2025CMF-IoU: Multi-Stage Cross-Modal Fusion 3D Object Detection with IoU Joint Prediction18 Aug 2025
- 2025Transferable Class Statistics and Multi-scale Feature Approximation for 3D Object Detection16 Aug 2025
- 2025Robust Single-Stage Fully Sparse 3D Object Detection via Detachable Latent Diffusion5 Aug 2025
- 2025On-the-Fly Object-aware Representative Point Selection in Point Cloud4 Aug 2025
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2025LDRFusion: A LiDAR-Dominant multimodal refinement framework for 3D object detection22 Jul 2025
- 2025Enhancing LiDAR Point Features with Foundation Model Priors for 3D Object Detection18 Jul 2025
- 2025Towards Accurate and Efficient 3D Object Detection for Autonomous Driving: A Mixture of Experts Computing System on Edge5 Jul 2025
- 20253DGeoDet: General-purpose Geometry-aware Image-based 3D Object Detection11 Jun 2025
- 2025FALO: Fast and Accurate LiDAR 3D Object Detection on Resource-Constrained Devices4 Jun 2025
- 2025A Multimodal Hybrid Late-Cascade Fusion Network for Enhanced 3D Object Detection25 Apr 2025
- 2025Self-Supervised Pre-training with Combined Datasets for 3D Perception in Autonomous Driving17 Apr 2025
- 2025Pillar-Voxel Fusion Network for 3D Object Detection in Airborne Hyperspectral Point Clouds13 Apr 2025
- 2025Intrinsic-feature-guided 3D Object Detection1 Apr 2025
- 2025Hi-ALPS -- An Experimental Robustness Quantification of Six LiDAR-based Object Detection Systems for Autonomous Driving21 Mar 2025
- 2025State Space Model Meets Transformer: A New Paradigm for 3D Object Detection18 Mar 2025
- 2025PSA-SSL: Pose and Size-aware Self-Supervised Learning on LiDAR Point Clouds18 Mar 2025
- 2025SFMNet: Sparse Focal Modulation for 3D Object Detection15 Mar 2025
50 newest of 368 All 368 (JSON)
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
- 2024LION: Linear Group RNN for 3D Object Detection in Point Cloudscited by 38
- 2024PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysiscited by 2
- 2025WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detectioncited by 0
- 2026Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detectioncited by 0
- 2026PointLAM: Local Attentive Mamba for Efficient Point-based 3D Object Detectioncited by 0
- 2026PointLAM: Local Attentive Mamba for Efficient Point-based 3D Object Detection18 Sep 2026
- 2026Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection23 Feb 2026
- 2025WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection17 Nov 2025
- 2024LION: Linear Group RNN for 3D Object Detection in Point Clouds25 Jul 2024
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection15 Jun 2024
- 2024PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis10 Jun 2024
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysis16 Feb 2024
- 2023Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object Detectioncited by 14
- 2025Robust Single-Stage Fully Sparse 3D Object Detection via Detachable Latent Diffusioncited by 12
- 2023Diffusion-based 3D Object Detection with Random Boxescited by 5
- 20233DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusioncited by 4
- 2023DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detectioncited by 2
- 2025Robust Single-Stage Fully Sparse 3D Object Detection via Detachable Latent Diffusion5 Aug 2025
- 2023Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object Detection5 Dec 2023
- 20233DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusion7 Nov 2023
- 2023DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detection25 Oct 2023
- 2023Diffusion-based 3D Object Detection with Random Boxes5 Sep 2023
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye Viewcited by 43
- 2022itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detectioncited by 14
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillationcited by 11
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation18 Mar 2024
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View27 Mar 2023
- 2022itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detection31 May 2022
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perception1 Nov 2021
- 2023On Offline Evaluation of 3D Object Detection for Autonomous Drivingcited by 11
- 2025Towards Accurate and Efficient 3D Object Detection for Autonomous Driving: A Mixture of Experts Computing System on Edgecited by 4
- 2025UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNscited by 3
- 2025Been There, Scanned That: Nostalgia-Driven LiDAR Compression for Self-Driving Carscited by 0
- 2025UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNs3 Nov 2025
- 2025Been There, Scanned That: Nostalgia-Driven LiDAR Compression for Self-Driving Cars1 Nov 2025
- 2025Towards Accurate and Efficient 3D Object Detection for Autonomous Driving: A Mixture of Experts Computing System on Edge5 Jul 2025
- 2023On Offline Evaluation of 3D Object Detection for Autonomous Driving24 Aug 2023
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 47
- 2025Perspective-Invariant 3D Object Detectioncited by 18
- 2025Perspective-Invariant 3D Object Detection23 Jul 2025
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers22 Mar 2022
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2021Multimodal Virtual Point 3D Detectioncited by 166
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 2021RangeDet:In Defense of Range View for LiDAR-based 3D Object Detectioncited by 140
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Cloudscited by 131
12 most cited of 343 All 343 (JSON)
- 2026Beyond the Snowflakes: Disentangling Weather Effects from Confounding Meta-Factors in LiDAR Object Detection9 Oct 2026
- 2026KSG-Net: Key-Sparse and Global-Context Learning for Maritime 3D Ship Detection2 Sep 2026
- 2026On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection9 Jul 2026
- 2026Comprehensive Robustness Analysis of LiDAR-based 3D Object Detection in Autonomous Driving2 Jul 2026
- 2026Shape-Prior-Based Point Cloud Completion for Single-Stage Fully Sparse 3D Object Detection30 May 2026
- 2026Scene Reconstruction as Mapping Priors for 3D Detection21 May 2026
- 2026Class-Adaptive Cooperative Perception for Multi-Class LiDAR-based 3D Object Detection in V2X Systems11 Apr 2026
- 2026SD4R: Sparse-to-Dense Learning for 3D Object Detection with 4D Radar24 Feb 2026
- 2026Bonnet: Ultra-fast whole-body bone segmentation from CT scans30 Jan 2026
- 2026LCF3D: A Robust and Real-Time Late-Cascade Fusion Framework for 3D Object Detection in Autonomous Driving14 Jan 2026
- 2025A Comprehensive Safety Metric to Evaluate Perception in Autonomous Systems16 Dec 2025
- 2025Adaptive Dual-Weighted Gravitational Point Cloud Denoising Method11 Dec 2025
12 newest of 343 All 343 (JSON)