MonoGRNet: A General Framework for Monocular 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose MonoGRNet for the amodal 3D object detection from a monocular image via geometric reasoning in both the observed 2D projection and the unobserved depth dimension. MonoGRNet decomposes the monocular 3D object detection task into four sub-tasks including 2D object detection, instance-level depth estimation, projected 3D center estimation and local corner regression. The task decomposition significantly facilitates the monocular 3D object detection, allowing the target 3D bounding boxes to be efficiently predicted in a single forward pass, without using object proposals, post-processing or the computationally expensive pixel-level depth estimation utilized by previous methods. In addition, MonoGRNet flexibly adapts to both fully and weakly supervised learning, which improves the feasibility of our framework in diverse settings. Experiments are conducted on KITTI, Cityscapes and MS COCO datasets. Results demonstrate the promising performance of our framework in various scenarios.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 59 of its 79 references that are in the map. First posted on arXiv 18 Apr 2021.
Builds on
59 of 79 references.
References · 59
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2017Mask R-CNNcited by 7,259
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
38 more
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2020SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimationcited by 202
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2019Learning Depth-Guided Convolutions for Monocular 3D Object Detectioncited by 169
- 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2020RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Drivingcited by 150
- 2016Learning Features by Watching Objects Movecited by 138
- 2019Accurate Monocular Object Detection via Color-Embedded 3D Reconstruction for Autonomous Drivingcited by 137
- 2017DSSD : Deconvolutional Single Shot Detectorcited by 130
- 2018ROI-10D: Monocular Lifting of 2D Detection to 6D Pose and Metric Shapecited by 123
- 2019Monocular 3D Object Detection with Pseudo-LiDAR Point Cloudcited by 113
- 2015Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Imagescited by 111
- 2019Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstructioncited by 106
- 2018PCL: Proposal Cluster Learning for Weakly Supervised Object Detectioncited by 97
- 2017Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular imagecited by 95
- 2016MultiNet: Real-time Joint Semantic Reasoning for Autonomous Drivingcited by 90
- 2018MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localizationcited by 84
- 2017Extreme clicking for efficient object annotationcited by 80
- 2018Joint Monocular 3D Vehicle Detection and Trackingcited by 77
- 2019Deep Fitting Degree Scoring Network for Monocular 3D Object Detectioncited by 67
- 20163D Object Proposals using Stereo Imagery for Accurate Object Class Detectioncited by 58
- 2020Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimationcited by 43
- 2019Triangulation Learning Network: from Monocular to Stereo 3D Object Detectioncited by 40
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 3; 2024: 2; 2025: 3; 2026: 2.
20 papers.
Sort:
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detectioncited by 49
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 29
- 2022Mix-Teaching: A Simple, Unified and Effective Semi-Supervised Learning Framework for Monocular 3D Object Detectioncited by 23
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoderscited by 15
- 2021Weakly Supervised Training of Monocular 3D Object Detectors Using Wide Baseline Multi-view Traffic Camera Datacited by 11
- 2021Lite-FPN for Keypoint-based Monocular 3D Object Detectioncited by 10
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 8
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detectioncited by 5
- 2024TiGDistill-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning Distillationcited by 4
- 2021MVM3Det: A Novel Method for Multi-view Monocular 3D Detectioncited by 3
- 2021AA3DNet: Attention Augmented Real Time 3D Object Detectioncited by 1
8 more
- 2021Joint stereo 3D object detection and implicit surface reconstructioncited by 1
- 2023MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficientcited by 1
- 2025PLOT: Pseudo-Labeling via Object Tracking for Monocular 3D Object Detectioncited by 1
- 2022IDMS: Instance Depth for Multi-scale Monocular 3D Object Detectioncited by 0
- 2023Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detectioncited by 0
- 2025SpikeSMOKE: Spiking Neural Networks for Monocular 3D Object Detection with Cross-Scale Gated Codingcited by 0
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Planecited by 0
- 2026XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimationcited by 0
- 2026XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation4 Aug 2026
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane20 Mar 2026
- 2025PLOT: Pseudo-Labeling via Object Tracking for Monocular 3D Object Detection3 Jul 2025
- 2025SpikeSMOKE: Spiking Neural Networks for Monocular 3D Object Detection with Cross-Scale Gated Coding9 Jun 2025
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection7 May 2025
- 2024TiGDistill-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning Distillation30 Dec 2024
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoders13 May 2024
- 2023MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient17 Oct 2023
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detection28 Sep 2023
- 2023Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detection19 Jun 2023
- 2022IDMS: Instance Depth for Multi-scale Monocular 3D Object Detection3 Dec 2022
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detection3 Nov 2022
8 more
- 2022Mix-Teaching: A Simple, Unified and Effective Semi-Supervised Learning Framework for Monocular 3D Object Detection10 Jul 2022
- 20223D Object Detection from Images for Autonomous Driving: A Survey7 Feb 2022
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detection21 Dec 2021
- 2021Joint stereo 3D object detection and implicit surface reconstruction25 Nov 2021
- 2021Weakly Supervised Training of Monocular 3D Object Detectors Using Wide Baseline Multi-view Traffic Camera Data21 Oct 2021
- 2021MVM3Det: A Novel Method for Multi-view Monocular 3D Detection22 Sep 2021
- 2021AA3DNet: Attention Augmented Real Time 3D Object Detection26 Jul 2021
- 2021Lite-FPN for Keypoint-based Monocular 3D Object Detection1 May 2021
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detectioncited by 49
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 29
- 2022Mix-Teaching: A Simple, Unified and Effective Semi-Supervised Learning Framework for Monocular 3D Object Detectioncited by 23
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoderscited by 15
- 2021Weakly Supervised Training of Monocular 3D Object Detectors Using Wide Baseline Multi-view Traffic Camera Datacited by 11
- 2021Lite-FPN for Keypoint-based Monocular 3D Object Detectioncited by 10
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 8
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detectioncited by 5
- 2024TiGDistill-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning Distillationcited by 4
- 2021MVM3Det: A Novel Method for Multi-view Monocular 3D Detectioncited by 3
- 2021AA3DNet: Attention Augmented Real Time 3D Object Detectioncited by 1
12 most cited of 20 All 20 (JSON)
- 2026XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation4 Aug 2026
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane20 Mar 2026
- 2025PLOT: Pseudo-Labeling via Object Tracking for Monocular 3D Object Detection3 Jul 2025
- 2025SpikeSMOKE: Spiking Neural Networks for Monocular 3D Object Detection with Cross-Scale Gated Coding9 Jun 2025
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection7 May 2025
- 2024TiGDistill-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning Distillation30 Dec 2024
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoders13 May 2024
- 2023MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient17 Oct 2023
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detection28 Sep 2023
- 2023Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detection19 Jun 2023
- 2022IDMS: Instance Depth for Multi-scale Monocular 3D Object Detection3 Dec 2022
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detection3 Nov 2022
12 newest of 20 All 20 (JSON)