Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
The objective of this paper is to learn context- and depth-aware feature representation to solve the problem of monocular 3D object detection. We make following contributions: (i) rather than appealing to the complicated pseudo-LiDAR based approach, we propose a depth-conditioned dynamic message propagation (DDMP) network to effectively integrate the multi-scale depth information with the image context;(ii) this is achieved by first adaptively sampling context-aware nodes in the image context and then dynamically predicting hybrid depth-dependent filter weights and affinity matrices for propagating information; (iii) by augmenting a center-aware depth encoding (CDE) task, our method successfully alleviates the inaccurate depth prior; (iv) we thoroughly demonstrate the effectiveness of our proposed approach and show state-of-the-art results among the monocular-based approaches on the KITTI benchmark dataset. Particularly, we rank 1st in the highly competitive KITTI monocular 3D object detection track on the submission day (November 16th, 2020). Code and models are released at urlhttps://github.com/fudan-zvg/DDMP
Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
43 of 51 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Graph Attention Networkscited by 8,854
- 2017Mask R-CNNcited by 7,259
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2017Deformable Convolutional Networkscited by 1,481
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019Objects as Pointscited by 1,172
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
31 more
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2018Pyramid Stereo Matching Networkcited by 486
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 251
- 2019Disentangling Monocular 3D Object Detectioncited by 215
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 201
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2019Learning Depth-Guided Convolutions for Monocular 3D Object Detectioncited by 169
- 2020MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationshipscited by 153
- 2020RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Drivingcited by 150
- 2019Accurate Monocular Object Detection via Color-Embedded 3D Reconstruction for Autonomous Drivingcited by 137
- 2018ROI-10D: Monocular Lifting of 2D Detection to 6D Pose and Metric Shapecited by 123
- 2020Kinematic 3D Object Detection in Monocular Videocited by 116
- 2019Monocular 3D Object Detection with Pseudo-LiDAR Point Cloudcited by 113
- 2019GS3D: An Efficient 3D Object Detection Framework for Autonomous Drivingcited by 106
- 2019Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstructioncited by 106
- 2018MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localizationcited by 84
- 2020HDNET: Exploiting HD Maps for 3D Object Detectioncited by 78
- 2019Deep Fitting Degree Scoring Network for Monocular 3D Object Detectioncited by 67
- 2019Dynamic Graph Message Passing Networkscited by 62
- 2020Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimationcited by 43
- 2020Associate-3Ddet: Perceptual-to-Conceptual Association for 3D Point Cloud Object Detectioncited by 31
- 2019Monocular 3D Object Detection and Box Fitting Trained End-to-End Using Intersection-over-Union Losscited by 30
- 2019Shift R-CNN: Deep Monocular 3D Object Detection with Closed-Form Geometric Constraintscited by 25
- 2020Crossing The Gap: A Deep Dive into Zero-Shot Sim-to-Real Transfer for Dynamicscited by 20
- 2017Evolving Boxes for Fast Vehicle Detectioncited by 6
- 20203DCFS: Fast and Robust Joint 3D Semantic-Instance Segmentation via Coupled Feature Selectioncited by 4
Built on by
Citing papers per year: 2021: 11; 2022: 29; 2023: 21; 2024: 14; 2025: 7; 2026: 2.
84 papers.
Sort:
By area:
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformercited by 108
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2022MonoDETR: Depth-guided Transformer for Monocular 3D Object Detectioncited by 85
- 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 66
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
38 more
- 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
- 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
- 2021Progressive Coordinate Transforms for Monocular 3D Object Detectioncited by 52
- 2022Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detectioncited by 49
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2022DID-M3D: Decoupling Instance Depth for Monocular 3D Object Detectioncited by 39
- 2023CAPE: Camera View Position Embedding for Multi-View 3D Object Detectioncited by 39
- 2024MonoCD: Monocular 3D Object Detection with Complementary Depthscited by 38
- 2022MonoGround: Detecting Monocular 3D Objects from the Groundcited by 37
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
- 2022Graph-DETR3D: Rethinking Overlapping Regions for Multi-View 3D Object Detectioncited by 35
- 2023Learning Occupancy for Monocular 3D Object Detectioncited by 35
- 2023MonoNeRD: NeRF-like Representations for Monocular 3D Object Detectioncited by 33
- 2022MonoJSG: Joint Semantic and Geometric Cost Volume for Monocular 3D Object Detectioncited by 30
- 2021Lidar Point Cloud Guided Monocular 3D Object Detectioncited by 29
- 2022Densely Constrained Depth Estimator for Monocular 3D Object Detectioncited by 27
- 2022Homography Loss for Monocular 3D Object Detectioncited by 24
- 2022Mix-Teaching: A Simple, Unified and Effective Semi-Supervised Learning Framework for Monocular 3D Object Detectioncited by 23
- 2024MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priorscited by 21
- 2021Learning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detectioncited by 20
- 2023Weakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistencycited by 18
- 2021Exploring Geometric Consistency for Monocular 3D Object Detectioncited by 17
- 2021MonoCInIS: Camera Independent Monocular 3D Object Detection using Instance Segmentationcited by 15
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoderscited by 15
- 2023ImGeoNet: Image-induced Geometry-aware Voxel Representation for Multi-view 3D Object Detectioncited by 14
- 2023SupFusion: Supervised LiDAR-Camera Fusion for 3D Object Detectioncited by 14
- 2021SGM3D: Stereo Guided Monocular 3D Object Detectioncited by 13
- 2023NeurOCS: Neural NOCS Supervision for Monocular 3D Object Localizationcited by 13
- 2024Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detectioncited by 11
- 2025Depth Anything at Any Conditioncited by 11
- 2021Lite-FPN for Keypoint-based Monocular 3D Object Detectioncited by 10
- 2022DSGN++: Exploiting Visual-Spatial Relation for Stereo-based 3D Detectorscited by 10
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learningcited by 10
- 2024MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detectioncited by 10
- 2024MonoWAD: Weather-Adaptive Diffusion Model for Robust Monocular 3D Object Detectioncited by 10
- 2023SSD-MonoDETR: Supervised Scale-aware Deformable Transformer for Monocular 3D Object Detectioncited by 9
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planningcited by 9
- 2022Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervisioncited by 7
50 most cited of 84 All 84 (JSON)
- 2026TRACE: Thermal Recognition Attentive-Framework for CO2 Emissions from Livestock27 Mar 2026
- 2026Selective Transfer Learning of Cross-Modality Distillation for Monocular 3D Object Detection8 Mar 2026
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts28 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
- 2025MonoLite3D: Lightweight 3D Object Properties Estimation4 Mar 2025
- 2025MonoDINO-DETR: Depth-Enhanced Monocular 3D Object Detection Using a Vision Foundation Model1 Feb 2025
- 2025AuxDepthNet: Real-Time Monocular 3D Object Detection with Depth-Sensitive Features7 Jan 2025
- 2024Efficient Feature Aggregation and Scale-Aware Regression for Monocular 3D Object Detection5 Nov 2024
- 2024MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors25 Oct 2024
- 2024MonoMM: A Multi-scale Mamba-Enhanced Network for Real-time Monocular 3D Object Detection1 Aug 2024
38 more
- 2024MonoWAD: Weather-Adaptive Diffusion Model for Robust Monocular 3D Object Detection23 Jul 2024
- 2024Learning Shared RGB-D Fields: Unified Self-supervised Pre-training for Label-efficient LiDAR-Camera 3D Perception28 May 2024
- 2024MonoDETRNext: Next-Generation Accurate and Efficient Monocular 3D Object Detector24 May 2024
- 2024Enhanced Object Tracking by Self-Supervised Auxiliary Depth Estimation Learning23 May 2024
- 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoders13 May 2024
- 2024Vision Foundation Model Driven Foreground-Aware Pseudo-LiDAR Generation for Monocular 3D Object Detection15 Apr 2024
- 2024Sparse Points to Dense Clouds: Enhancing 3D Detection with Limited LiDAR Data10 Apr 2024
- 2024MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detection7 Apr 2024
- 2024MonoCD: Monocular 3D Object Detection with Complementary Depths4 Apr 2024
- 2024Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detection26 Mar 2024
- 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection22 Mar 2024
- 2023Towards Transferable Multi-modal Perception Representation Learning for Autonomy: NeRF-Supervised Masked AutoEncoder23 Nov 2023
- 2023MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient17 Oct 2023
- 2023Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection9 Oct 2023
- 2023SupFusion: Supervised LiDAR-Camera Fusion for 3D Object Detection13 Sep 2023
- 2023AdvMono3D: Advanced Monocular 3D Object Detection with Depth-Aware Robust Adversarial Training3 Sep 2023
- 2023S3-MonoDETR: Supervised Shape&Scale-perceptive Deformable Transformer for Monocular 3D Object Detection2 Sep 2023
- 2023MonoNeRD: NeRF-like Representations for Monocular 3D Object Detection18 Aug 2023
- 2023ImGeoNet: Image-induced Geometry-aware Voxel Representation for Multi-view 3D Object Detection17 Aug 2023
- 2023Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning17 Jul 2023
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection5 Jul 2023
- 2023Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detection19 Jun 2023
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning3 Jun 2023
- 2023NeurOCS: Neural NOCS Supervision for Monocular 3D Object Localization28 May 2023
- 2023Learning Occupancy for Monocular 3D Object Detection25 May 2023
- 2023SSD-MonoDETR: Supervised Scale-aware Deformable Transformer for Monocular 3D Object Detection12 May 2023
- 2023OriCon3D: Effective 3D Object Detection using Orientation and Confidence27 Apr 2023
- 2023Monocular 3D Object Detection with Bounding Box Denoising in 3D by Perceiver3 Apr 2023
- 2023Augment and Criticize: Exploring Informative Samples for Semi-Supervised Monocular 3D Object Detection20 Mar 2023
- 2023CAPE: Camera View Position Embedding for Multi-View 3D Object Detection17 Mar 2023
- 2023Weakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistency15 Mar 2023
- 2023MonoEdge: Monocular 3D Object Detection Using Local Perspectives4 Jan 2023
- 2022From a Bird's Eye View to See: Joint Camera and Subject Registration without the Camera Calibration19 Dec 2022
- 2022Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection30 Nov 2022
- 2022ImLiDAR: Cross-Sensor Dynamic Message Propagation Network for 3D Object Detection17 Nov 2022
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detection3 Nov 2022
- 2022Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision29 Oct 2022
- 2022MonoSIM: Simulating Learning Behaviors of Heterogeneous Point Cloud Object Detectors for Monocular 3D Object Detection19 Aug 2022
50 newest of 84 All 84 (JSON)
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformercited by 108
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2022MonoDETR: Depth-guided Transformer for Monocular 3D Object Detectioncited by 85
- 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 66
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
12 most cited of 80 All 80 (JSON)
- 2026TRACE: Thermal Recognition Attentive-Framework for CO2 Emissions from Livestock27 Mar 2026
- 2026Selective Transfer Learning of Cross-Modality Distillation for Monocular 3D Object Detection8 Mar 2026
- 2025InsFusion: Rethink Instance-level LiDAR-Camera Fusion for 3D Object Detection10 Sep 2025
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts28 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025MonoLite3D: Lightweight 3D Object Properties Estimation4 Mar 2025
- 2025MonoDINO-DETR: Depth-Enhanced Monocular 3D Object Detection Using a Vision Foundation Model1 Feb 2025
- 2025AuxDepthNet: Real-Time Monocular 3D Object Detection with Depth-Sensitive Features7 Jan 2025
- 2024Efficient Feature Aggregation and Scale-Aware Regression for Monocular 3D Object Detection5 Nov 2024
- 2024MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors25 Oct 2024
- 2024Learning Shared RGB-D Fields: Unified Self-supervised Pre-training for Label-efficient LiDAR-Camera 3D Perception28 May 2024
- 2024MonoDETRNext: Next-Generation Accurate and Efficient Monocular 3D Object Detector24 May 2024
12 newest of 80 All 80 (JSON)