Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular image
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a novel approach, called Deep MANTA (Deep Many-Tasks), for many-task vehicle analysis from a given image. A robust convolutional network is introduced for simultaneous vehicle detection, part localization, visibility characterization and 3D dimension estimation. Its architecture is based on a new coarse-to-fine object proposal that boosts the vehicle detection. Moreover, the Deep MANTA network is able to localize vehicle parts even if these parts are not visible. In the inference, the network's outputs are used by a real time robust pose estimation algorithm for fine orientation estimation and 3D vehicle localization. We show in experiments that our method outperforms monocular state-of-the-art approaches on vehicle detection, orientation and 3D location tasks on the very challenging KITTI benchmark.
Key facts. Cited by 95 papers in the map (data through 13 Oct 2026). First posted on arXiv 22 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 25; 2023: 21; 2024: 4; 2025: 4; 2026: 3.
95 papers.
Sort:
By area:
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2021Objects are Different: Flexible Monocular 3D Object Detectioncited by 184
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2021Geometry Uncertainty Projection Network for Monocular 3D Object Detectioncited by 155
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 139
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
38 more
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2021Monocular 3D Object Detection: An Extrinsic Parameter Free Approachcited by 69
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 66
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detectioncited by 48
- 2021M3DSSD: Monocular 3D Single Stage Object Detectorcited by 39
- 2022MonoGround: Detecting Monocular 3D Objects from the Groundcited by 37
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2023MonoNeRD: NeRF-like Representations for Monocular 3D Object Detectioncited by 33
- 2022CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detectioncited by 32
- 2022Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Drivingcited by 30
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
- 2023WEDGE: A multi-weather autonomous driving dataset built from generative vision-language modelscited by 28
- 2022Densely Constrained Depth Estimator for Monocular 3D Object Detectioncited by 27
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulationcited by 26
- 2022Homography Loss for Monocular 3D Object Detectioncited by 24
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detectioncited by 23
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2021Monocular 3D Vehicle Detection Using Uncalibrated Traffic Cameras through Homographycited by 21
- 2021MonoGRNet: A General Framework for Monocular 3D Object Detectioncited by 20
- 2021Learning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detectioncited by 20
- 2021Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Imagecited by 20
- 2023MonoGAE: Roadside Monocular 3D Object Detection with Ground-Aware Embeddingscited by 20
- 2021PLUMENet: Efficient 3D Object Detection from Stereo Imagescited by 19
- 2023MonoATT: Online Monocular 3D Object Detection with Adaptive Token Transformercited by 18
- 2023Viewpoint Equivariance for Multi-View 3D Object Detectioncited by 18
- 2021MonoCInIS: Camera Independent Monocular 3D Object Detection using Instance Segmentationcited by 16
- 2021Optimal Pose and Shape Estimation for Category-level 3D Object Perceptioncited by 15
- 2023NeurOCS: Neural NOCS Supervision for Monocular 3D Object Localizationcited by 13
- 2021SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimationcited by 12
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objectscited by 12
- 2021Weakly Supervised Training of Monocular 3D Object Detectors Using Wide Baseline Multi-view Traffic Camera Datacited by 11
- 2022HFT: Lifting Perspective Representations via Hybrid Feature Transformationcited by 11
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detectioncited by 11
- 2021Lite-FPN for Keypoint-based Monocular 3D Object Detectioncited by 10
- 2023MoGDE: Boosting Mobile Monocular 3D Object Detection with Ground Depth Estimationcited by 9
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 9
- 2021Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaborationcited by 8
50 most cited of 95 All 95 (JSON)
- 2026Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation1 Sep 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026UniLiPs: Unified LiDAR Pseudo-Labeling with Geometry-Grounded Dynamic Scene Decomposition8 Jan 2026
- 2025BlinkBud: Detecting Hazards from Behind via Sampled Monocular 3D Detection on a Single Earbud1 Dec 2025
- 2025CHARM3R: Towards Unseen Camera Height Robust Monocular 3D Detector15 Aug 2025
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection7 May 2025
- 2025HeightFormer: Learning Height Prediction in Voxel Features for Roadside Vision Centric 3D Object Detection via Transformer13 Mar 2025
- 2024ROA-BEV: 2D Region-Oriented Attention for BEV-based 3D Object Detection14 Oct 2024
- 2024VaLID: Verification as Late Integration of Detections for LiDAR-Camera Fusion23 Sep 2024
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlook4 May 2024
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objects29 Mar 2024
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation2 Nov 2023
38 more
- 2023GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detection24 Oct 2023
- 2023MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient17 Oct 2023
- 2023Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection9 Oct 2023
- 2023Rotation Matters: Generalized Monocular 3D Object Detection for Various Camera Systems9 Oct 2023
- 2023MonoGAE: Roadside Monocular 3D Object Detection with Ground-Aware Embeddings30 Sep 2023
- 2023Polygon Intersection-over-Union Loss for Viewpoint-Agnostic Monocular 3D Vehicle Detection13 Sep 2023
- 2023The Interstate-24 3D Dataset: a new benchmark for 3D multi-camera vehicle tracking28 Aug 2023
- 2023MonoNeRD: NeRF-like Representations for Monocular 3D Object Detection18 Aug 2023
- 2023MonoNext: A 3D Monocular Object Detection with ConvNext1 Aug 2023
- 2023Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detection19 Jun 2023
- 2023Object Detection with Transformers: A Review7 Jun 2023
- 2023Monocular 2D Camera-based Proximity Monitoring for Human-Machine Collision Warning on Construction Sites29 May 2023
- 2023NeurOCS: Neural NOCS Supervision for Monocular 3D Object Localization28 May 2023
- 2023WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models12 May 2023
- 2023Diversifying the High-level Features for better Adversarial Transferability20 Apr 2023
- 2023Viewpoint Equivariance for Multi-View 3D Object Detection25 Mar 2023
- 2023MoGDE: Boosting Mobile Monocular 3D Object Detection with Ground Depth Estimation23 Mar 2023
- 2023MonoATT: Online Monocular 3D Object Detection with Adaptive Token Transformer23 Mar 2023
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation22 Mar 2023
- 2023Introducing Depth into Transformer-based 3D Object Detection25 Feb 2023
- 2022Monocular 3D Object Detection using Multi-Stage Approaches with Attention and Slicing aided hyper inference22 Dec 2022
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detection10 Dec 2022
- 2022ImLiDAR: Cross-Sensor Dynamic Message Propagation Network for 3D Object Detection17 Nov 2022
- 2022Ground Plane Matters: Picking Up Ground Plane Prior in Monocular 3D Object Detection3 Nov 2022
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detection2 Nov 2022
- 2022Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision29 Oct 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022Depth Is All You Need for Monocular 3D Detection5 Oct 2022
- 2022MonoSIM: Simulating Learning Behaviors of Heterogeneous Point Cloud Object Detectors for Monocular 3D Object Detection19 Aug 2022
- 2022DEVIANT: Depth EquiVarIAnt NeTwork for Monocular 3D Object Detection21 Jul 2022
- 2022Densely Constrained Depth Estimator for Monocular 3D Object Detection20 Jul 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
- 20223D Object Detection for Autonomous Driving: A Comprehensive Survey19 Jun 2022
- 2022MonoGround: Detecting Monocular 3D Objects from the Ground15 Jun 2022
- 2022Shape-Aware Monocular 3D Object Detection19 Apr 2022
- 2022HFT: Lifting Perspective Representations via Hybrid Feature Transformation11 Apr 2022
- 2022Homography Loss for Monocular 3D Object Detection2 Apr 2022
- 2022CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection1 Apr 2022
50 newest of 95 All 95 (JSON)
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2021Objects are Different: Flexible Monocular 3D Object Detectioncited by 184
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2021Geometry Uncertainty Projection Network for Monocular 3D Object Detectioncited by 155
- 2021Delving into Localization Errors for Monocular 3D Object Detectioncited by 139
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
12 most cited of 93 All 93 (JSON)
- 2026Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation1 Sep 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026UniLiPs: Unified LiDAR Pseudo-Labeling with Geometry-Grounded Dynamic Scene Decomposition8 Jan 2026
- 2025BlinkBud: Detecting Hazards from Behind via Sampled Monocular 3D Detection on a Single Earbud1 Dec 2025
- 2025CHARM3R: Towards Unseen Camera Height Robust Monocular 3D Detector15 Aug 2025
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection7 May 2025
- 2025HeightFormer: Learning Height Prediction in Voxel Features for Roadside Vision Centric 3D Object Detection via Transformer13 Mar 2025
- 2024ROA-BEV: 2D Region-Oriented Attention for BEV-based 3D Object Detection14 Oct 2024
- 2024VaLID: Verification as Late Integration of Detections for LiDAR-Camera Fusion23 Sep 2024
- 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlook4 May 2024
- 2024SeaBird: Segmentation in Bird's View with Dice Loss Improves Monocular 3D Detection of Large Objects29 Mar 2024
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation2 Nov 2023
12 newest of 93 All 93 (JSON)