Shape-Aware Monocular 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
The detection of 3D objects through a single perspective camera is a challenging issue. The anchor-free and keypoint-based models receive increasing attention recently due to their effectiveness and simplicity. However, most of these methods are vulnerable to occluded and truncated objects. In this paper, a single-stage monocular 3D object detection model is proposed. An instance-segmentation head is integrated into the model training, which allows the model to be aware of the visible shape of a target object. The detection largely avoids interference from irrelevant regions surrounding the target objects. In addition, we also reveal that the popular IoU-based evaluation metrics, which were originally designed for evaluating stereo or LiDAR-based detection methods, are insensitive to the improvement of monocular 3D object detection algorithms. A novel evaluation metric, namely average depth similarity (ADS) is proposed for the monocular 3D object detection models. Our method outperforms the baseline on both the popular and the proposed evaluation metrics while maintaining real-time efficiency.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 19 Apr 2022.
Builds on
41 of 48 references.
References · 41
- 2017Mask R-CNNcited by 7,277
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2018Group Normalizationcited by 1,524
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019Objects as Pointscited by 1,175
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2018Albumentations: fast and flexible image augmentationscited by 560
29 more
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
- 2017Deep Layer Aggregationcited by 436
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 327
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 278
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 249
- 2019Disentangling Monocular 3D Object Detectioncited by 217
- 2020SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimationcited by 204
- 2021Probabilistic and Geometric Depth: Detecting Objects in Perspectivecited by 191
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2021Objects are Different: Flexible Monocular 3D Object Detectioncited by 185
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2021Geometry Uncertainty Projection Network for Monocular 3D Object Detectioncited by 156
- 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
- 2020RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Drivingcited by 150
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 140
- 2021Probabilistic two-stage detectioncited by 130
- 2017Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular imagecited by 95
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 67
- 2021Ground-aware Monocular 3D Object Detection for Autonomous Drivingcited by 65
- 2020Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimationcited by 43
- 2020Disp R-CNN: Stereo 3D Object Detection via Shape Prior Guided Instance Disparity Estimationcited by 43
- 2021M3DSSD: Monocular 3D Single Stage Object Detectorcited by 39
- 2021Lidar Point Cloud Guided Monocular 3D Object Detectioncited by 29
- 2020Are we Missing Confidence in Pseudo-LiDAR Methods for Monocular 3D Object Detection?cited by 27
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 1; 2026: 1.
6 papers.
- 2023MonoGAE: Roadside Monocular 3D Object Detection with Ground-Aware Embeddingscited by 22
- 2023V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Networkcited by 2
- 2023S3-MonoDETR: Supervised Shape&Scale-perceptive Deformable Transformer for Monocular 3D Object Detectioncited by 0
- 2024Efficient Feature Aggregation and Scale-Aware Regression for Monocular 3D Object Detectioncited by 0
- 2025OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perceptioncited by 0
- 2026Selective Transfer Learning of Cross-Modality Distillation for Monocular 3D Object Detectioncited by 0
- 2026Selective Transfer Learning of Cross-Modality Distillation for Monocular 3D Object Detection8 Mar 2026
- 2025OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perception11 Jul 2025
- 2024Efficient Feature Aggregation and Scale-Aware Regression for Monocular 3D Object Detection5 Nov 2024
- 2023V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network10 Oct 2023
- 2023MonoGAE: Roadside Monocular 3D Object Detection with Ground-Aware Embeddings30 Sep 2023
- 2023S3-MonoDETR: Supervised Shape&Scale-perceptive Deformable Transformer for Monocular 3D Object Detection2 Sep 2023