3D Packing for Self-Supervised Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Although cameras are ubiquitous, robotic platforms typically rely on active sensors like LiDAR for direct 3D perception. In this work, we propose a novel self-supervised monocular depth estimation method combining geometry with a new deep network, PackNet, learned only from unlabeled monocular videos. Our architecture leverages novel symmetrical packing and unpacking blocks to jointly learn to compress and decompress detail-preserving representations using 3D convolutions. Although self-supervised, our method outperforms other self, semi, and fully supervised methods on the KITTI benchmark. The 3D inductive bias in PackNet enables it to scale with input resolution and number of parameters without overfitting, generalizing better on out-of-domain data such as the NuScenes dataset. Furthermore, it does not require large-scale supervised pretraining on ImageNet and can run in real-time. Finally, we release DDAD (Dense Depth for Automated Driving), a new urban driving dataset with more challenging and accurate depth evaluation, thanks to longer-range and denser ground-truth depth generated from high-density LiDARs mounted on a fleet of self-driving cars operating world-wide.
Key facts. Cited by 437 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 65; 2022: 85; 2023: 101; 2024: 79; 2025: 49; 2026: 58.
437 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
38 more
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
- 2021RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detectioncited by 115
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2022SWFormer: Sparse Window Transformer for 3D Object Detection in Point Cloudscited by 92
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2021Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistencycited by 58
- 2023Robust Monocular Depth Estimation under Challenging Conditionscited by 58
- 2021OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Drivingcited by 57
- 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 57
- 2022Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patchescited by 57
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
- 2024GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splattingcited by 50
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
50 most cited of 437 All 437 (JSON)
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models25 Sep 2026
- 2026CMAMBADEPTH: Self-supervised Monocular Depth Estimation with Channel Mamba and Hybrid Attention21 Sep 2026
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation4 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving24 Aug 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026Geometry-Grounded Unified 3D Perception for Autonomous Driving13 Aug 2026
- 2026An active-learning framework for real-time depth perception from monocular vision streams5 Aug 2026
38 more
- 2026Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors5 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026DepthART: Scaling Foundation Monocular Depth to Tiny Models19 Jul 2026
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning14 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026Towards Robust Driving Perception: A Flexible Scale-Driven Family for Self-Supervised Monocular Depth Estimation1 Jul 2026
- 2026DrivingDepth: Sparse-Prompted Pixel-wise Scale Correction for Driving Depth Estimation30 Jun 2026
- 2026AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World29 Jun 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving15 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformer4 Jun 2026
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset1 Jun 2026
- 2026Honey, I Shrunk the Arc de Triomphe!1 Jun 2026
- 2026SurGe: Improved Surface Geometry in Point Maps29 May 2026
- 2026SA4Depth: Consistent Pose-Depth Scale Alignment for Self-Supervised Monocular Depth Estimation27 May 2026
- 2026DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection22 May 2026
- 2026Unlocking Dense Metric Depth Estimation in VLMs15 May 2026
- 2026The Midas Touch for Metric Depth12 May 2026
- 2026LiBrA-Net: Lie-Algebraic Bilateral Affine Fields for Real-Time 4K Video Dehazing12 May 2026
- 2026Rebalancing gradient to improve self-supervised co-training of depth, odometry and optical flow predictions8 May 2026
- 2026CARD: A Multi-Modal Automotive Dataset for Dense 3D Reconstruction in Challenging Road Topography6 May 2026
- 2026SS3D: End2End Self-Supervised 3D from Web Videos24 Apr 2026
- 2026SceneScribe-1M: A Large-Scale Video Dataset with Comprehensive Geometric and Semantic Annotations9 Apr 2026
- 2026Monocular Depth Estimation From the Perspective of Feature Restoration: A Diffusion Enhanced Depth Restoration Approach9 Apr 2026
- 2026LiftFormer: Lifting and Frame Theory Based Monocular Depth Estimation Using Depth and Edge Oriented Subspace Representation8 Apr 2026
- 2026Cross-Vehicle 3D Geometric Consistency for Self-Supervised Surround Depth Estimation on Articulated Vehicles3 Apr 2026
- 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scale1 Apr 2026
- 2026UniDAC: Universal Metric Depth Estimation for Any Camera28 Mar 2026
- 2026OccAny: Generalized Unconstrained Urban 3D Occupancy24 Mar 2026
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion11 Mar 2026
- 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving4 Mar 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026StreamTTO: Efficient Online Test-Time Optimization for Video Depth Completion2 Mar 2026
- 2026DenseMLLM: Standard Multimodal LLMs for Dense Prediction15 Feb 2026
- 2026RAD: Retrieval-Augmented Monocular Metric Depth Estimation for Underrepresented Classes10 Feb 2026
50 newest of 437 All 437 (JSON)
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 47
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Modelcited by 12
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2024Stealing Stable Diffusion Prior for Robust Monocular Depth Estimationcited by 6
- 2024GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusioncited by 6
- 2025Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weathercited by 4
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
12 most cited of 17 All 17 (JSON)
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning14 Jul 2026
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion11 Mar 2026
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2025StableMTL: Repurposing Latent Diffusion Models for Multi-Task Learning from Partially Annotated Synthetic Datasets9 Jun 2025
- 2025Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weather18 May 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion18 Dec 2024
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation27 Nov 2024
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
- 2024GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusion15 Sep 2024
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
12 newest of 17 All 17 (JSON)
- 2025DepthLM: Metric Depth From Vision Language Modelscited by 29
- 2024Proximity QA: Unleashing the Power of Multi-Modal Large Language Models for Spatial Proximity Analysiscited by 6
- 2026Unlocking Dense Metric Depth Estimation in VLMscited by 2
- 2026DenseMLLM: Standard Multimodal LLMs for Dense Predictioncited by 0
- 2026Unlocking Dense Metric Depth Estimation in VLMs15 May 2026
- 2026DenseMLLM: Standard Multimodal LLMs for Dense Prediction15 Feb 2026
- 2025DepthLM: Metric Depth From Vision Language Models29 Sep 2025
- 2024Proximity QA: Unleashing the Power of Multi-Modal Large Language Models for Spatial Proximity Analysis31 Jan 2024
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
12 most cited of 408 All 408 (JSON)
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation4 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026Geometry-Grounded Unified 3D Perception for Autonomous Driving13 Aug 2026
- 2026An active-learning framework for real-time depth perception from monocular vision streams5 Aug 2026
- 2026Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors5 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026DepthART: Scaling Foundation Monocular Depth to Tiny Models19 Jul 2026
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
12 newest of 408 All 408 (JSON)