Stereo CenterNet based 3D Object Detection for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Recently, three-dimensional (3D) detection based on stereo images has progressed remarkably; however, most advanced methods adopt anchor-based two-dimensional (2D) detection or depth estimation to address this problem. Nevertheless, high computational cost inhibits these methods from achieving real-time performance. In this study, we propose a 3D object detection method, Stereo CenterNet (SC), using geometric information in stereo imagery. SC predicts the four semantic key points of the 3D bounding box of the object in space and utilizes 2D left and right boxes, 3D dimension, orientation, and key points to restore the bounding box of the object in the 3D space. Subsequently, we adopt an improved photometric alignment module to further optimize the position of the 3D bounding box. Experiments conducted on the KITTI dataset indicate that the proposed SC exhibits the best speed-accuracy trade-off among advanced methods without using extra data.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 20 Mar 2021.
Builds on
42 of 57 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Mask R-CNNcited by 7,259
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2019Objects as Pointscited by 1,172
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
30 more
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2017Deep Layer Aggregationcited by 436
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
- 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
- 2019Disentangling Monocular 3D Object Detectioncited by 215
- 2020SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimationcited by 202
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
- 2020RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Drivingcited by 150
- 2019GS3D: An Efficient 3D Object Detection Framework for Autonomous Drivingcited by 106
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 101
- 2020DSGN: Deep Stereo Geometry Network for 3D Object Detectioncited by 100
- 2020End-to-End Pseudo-LiDAR for Image-Based 3D Object Detectioncited by 80
- 2020AFDet: Anchor Free One Stage 3D Object Detectioncited by 63
- 20163D Object Proposals using Stereo Imagery for Accurate Object Class Detectioncited by 58
- 2020Disp R-CNN: Stereo 3D Object Detection via Shape Prior Guided Instance Disparity Estimationcited by 43
- 2019Triangulation Learning Network: from Monocular to Stereo 3D Object Detectioncited by 40
- 2019Object-Centric Stereo Matching for 3D Object Detectioncited by 29
- 2018Stereo Vision-based Semantic 3D Object and Ego-motion Tracking for Autonomous Drivingcited by 26
- 2020ZoomNet: Part-Aware Adaptive Zooming Neural Network for 3D Object Detectioncited by 25
- 2020EAO-SLAM: Monocular Semi-Dense Object SLAM Based on Ensemble Data Associationcited by 24
- 2018Monocular Object and Plane SLAM in Structured Environmentscited by 23
- 2020Monocular Differentiable Rendering for Self-Supervised 3D Object Detectioncited by 23
- 2019Training-Time-Friendly Network for Real-Time Object Detectioncited by 17
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 3; 2025: 2; 2026: 1.
10 papers.
- 2024MonoCD: Monocular 3D Object Detection with Complementary Depthscited by 38
- 2024MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priorscited by 21
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 8
- 2021ESGN: Efficient Stereo Geometry Network for Fast 3D Object Detectioncited by 7
- 2022An Empirical Study of Pseudo-Labeling for Image-based 3D Object Detectioncited by 2
- 2025StereoDETR: Stereo-based Transformer for 3D Object Detectioncited by 2
- 2022Does depth estimation help object detection?cited by 1
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matchingcited by 1
- 2026DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detectioncited by 1
- 2022Visualizing and Alleviating the Effect of Radial Distortion on Camera Calibration Using Principal Linescited by 0
- 2026DDStereo: Efficient Dual Decoder Transformers for Stereo 3D Road Anomaly Detection23 Jun 2026
- 2025StereoDETR: Stereo-based Transformer for 3D Object Detection24 Nov 2025
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection7 May 2025
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching24 Dec 2024
- 2024MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors25 Oct 2024
- 2024MonoCD: Monocular 3D Object Detection with Complementary Depths4 Apr 2024
- 2022An Empirical Study of Pseudo-Labeling for Image-based 3D Object Detection15 Aug 2022
- 2022Visualizing and Alleviating the Effect of Radial Distortion on Camera Calibration Using Principal Lines28 Jun 2022
- 2022Does depth estimation help object detection?13 Apr 2022
- 2021ESGN: Efficient Stereo Geometry Network for Fast 3D Object Detection28 Nov 2021