SparseDet: Towards End-to-End 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose SparseDet for end-to-end 3D object detection from point cloud. Existing works on 3D object detection rely on dense object candidates over all locations in a 3D or 2D grid following the mainstream methods for object detection in 2D images. However, this dense paradigm requires expertise in data to fulfill the gap between label and detection. As a new detection paradigm, SparseDet maintains a fixed set of learnable proposals to represent latent candidates and directly perform classification and localization for 3D objects through stacked transformers. It demonstrates that effective 3D object detection can be achieved with none of post-processing such as redundant removal and non-maximum suppression. With a properly designed network, SparseDet achieves highly competitive detection accuracy while running with a more efficient speed of 34.5 FPS. We believe this end-to-end paradigm of SparseDet will inspire new thinking on the sparsity of 3D object detection.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 2 Jun 2022.
Builds on
33 of 39 references.
References · 33
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
21 more
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
- 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 366
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2017Submanifold Sparse Convolutional Networkscited by 223
- 2020EPNet: Enhancing Point Features with Image Semantics for 3D Object Detectioncited by 164
- 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
- 2015End-to-end people detection in crowded scenescited by 140
- 2019IoU Loss for 2D/3D Object Detectioncited by 128
- 2019Frustum ConvNet: Sliding Frustums to Aggregate Local Point-Wise Features for Amodal 3D Object Detectioncited by 124
- 2019Fast Point R-CNNcited by 119
- 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
- 2015Sparse 3D convolutional neural networkscited by 71
- 2014Spatially-sparse convolutional neural networkscited by 33
- 2017Improving Object Localization with Fitness NMS and Bounded IoU Losscited by 30
- 20193D Object Detection Using Scale Invariant and Feature Reweighting Networkscited by 23
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023Diffusion-based 3D Object Detection with Random Boxescited by 5
- 2023Diffusion-based 3D Object Detection with Random Boxes5 Sep 2023