# Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimation

arXiv: https://arxiv.org/abs/2002.01619 · HTML: https://mlsanity.com/paper/2002.01619/

## Key facts

- Cited by 43 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Feb 2020.

## Built on by (most cited first, 30 of 43)

- [Objects are Different: Flexible Monocular 3D Object Detection](https://mlsanity.com/paper/2104.02323/) (2021)
- [Geometry Uncertainty Projection Network for Monocular 3D Object Detection](https://mlsanity.com/paper/2107.13774/) (2021)
- [Delving into Localization Errors for Monocular 3D Object Detection](https://mlsanity.com/paper/2103.16237/) (2021)
- [3D Object Detection for Autonomous Driving: A Comprehensive Survey](https://mlsanity.com/paper/2206.09474/) (2022)
- [BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereo](https://mlsanity.com/paper/2209.10248/) (2022)
- [Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection](https://mlsanity.com/paper/2103.16470/) (2021)
- [MonoDistill: Learning Spatial Features for Monocular 3D Object Detection](https://mlsanity.com/paper/2201.10830/) (2022)
- [Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detection](https://mlsanity.com/paper/2112.04628/) (2021)
- [3D Object Detection from Images for Autonomous Driving: A Survey](https://mlsanity.com/paper/2202.02980/) (2022)
- [M3DSSD: Monocular 3D Single Stage Object Detector](https://mlsanity.com/paper/2103.13164/) (2021)
- [MonoGround: Detecting Monocular 3D Objects from the Ground](https://mlsanity.com/paper/2206.07372/) (2022)
- [Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving](https://mlsanity.com/paper/2203.02112/) (2022)
- [MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors](https://mlsanity.com/paper/2410.19590/) (2024)
- [MonoPGC: Monocular 3D Object Detection with Pixel Geometry Contexts](https://mlsanity.com/paper/2302.10549/) (2023)
- [MonoGRNet: A General Framework for Monocular 3D Object Detection](https://mlsanity.com/paper/2104.08797/) (2021)
- [Learning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detection](https://mlsanity.com/paper/2107.13931/) (2021)
- [AeDet: Azimuth-invariant Multi-view 3D Object Detection](https://mlsanity.com/paper/2211.12501/) (2022)
- [HeightFormer: Explicit Height Modeling without Extra Data for Camera-only 3D Object Detection in Bird's Eye View](https://mlsanity.com/paper/2307.13510/) (2023)
- [Learning a Structured Latent Space for Unsupervised Point Cloud Completion](https://mlsanity.com/paper/2203.15580/) (2022)
- [MonoCInIS: Camera Independent Monocular 3D Object Detection using Instance Segmentation](https://mlsanity.com/paper/2110.00464/) (2021)
- [IAFA: Instance-aware Feature Aggregation for 3D Object Detection from a Single Image](https://mlsanity.com/paper/2103.03480/) (2021)
- [Advancing Self-supervised Monocular Depth Learning with Sparse LiDAR](https://mlsanity.com/paper/2109.09628/) (2021)
- [Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detection](https://mlsanity.com/paper/2212.05265/) (2022)
- [Gated3D: Monocular 3D Object Detection From Temporal Illumination Cues](https://mlsanity.com/paper/2102.03602/) (2021)
- [Lite-FPN for Keypoint-based Monocular 3D Object Detection](https://mlsanity.com/paper/2105.00268/) (2021)
- [SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detection](https://mlsanity.com/paper/2308.13794/) (2023)
- [Shape-Aware Monocular 3D Object Detection](https://mlsanity.com/paper/2204.08717/) (2022)
- [Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detection](https://mlsanity.com/paper/2211.01556/) (2022)
- [BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection](https://mlsanity.com/paper/2211.17126/) (2022)
- [OBMO: One Bounding Box Multiple Objects for Monocular 3D Object Detection](https://mlsanity.com/paper/2212.10049/) (2022)

## Abstract (arXiv)

Monocular 3D object detection task aims to predict the 3D bounding boxes of objects based on monocular RGB images. Since the location recovery in 3D space is quite difficult on account of absence of depth information, this paper proposes a novel unified framework which decomposes the detection problem into a structured polygon prediction task and a depth recovery task. Different from the widely studied 2D bounding boxes, the proposed novel structured polygon in the 2D image consists of several projected surfaces of the target object. Compared to the widely-used 3D bounding box proposals, it is shown to be a better representation for 3D detection. In order to inversely project the predicted 2D structured polygon to a cuboid in the 3D physical world, the following depth recovery task uses the object height prior to complete the inverse projection transformation with the given camera projection matrix. Moreover, a fine-grained 3D box refinement scheme is proposed to further rectify the 3D detection results. Experiments are conducted on the challenging KITTI benchmark, in which our method achieves state-of-the-art detection accuracy.