SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We propose SharpDepth, a novel approach to monocular metric depth estimation that combines the metric accuracy of discriminative depth estimation methods (e.g., Metric3D, UniDepth) with the fine-grained boundary sharpness typically achieved by generative methods (e.g., Marigold, Lotus). Traditional discriminative models trained on real-world data with sparse ground-truth depth can accurately predict metric depth but often produce over-smoothed or low-detail depth maps. Generative models, in contrast, are trained on synthetic data with dense ground truth, generating depth maps with sharp boundaries yet only providing relative depth with low accuracy. Our approach bridges these limitations by integrating metric accuracy with detailed boundary preservation, resulting in depth predictions that are both metrically precise and visually sharp. Our extensive zero-shot evaluations on standard depth estimation benchmarks confirm SharpDepth effectiveness, showing its ability to achieve both high depth accuracy and detailed representation, making it well-suited for applications requiring high-quality depth perception across diverse, real-world environments.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 57 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
48 of 57 references.
Closest ancestors · 6
Same direction, newest first
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion11 Mar
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
30 more
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2023Gaussian Splatting SLAMcited by 415
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 336
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 190
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
- 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
- 2021Towards Real-Time Monocular Depth Estimation for Robotics: A Surveycited by 57
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2023Booster: a Benchmark for Depth from Images of Specular and Transparent Surfacescited by 33
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2024PatchRefiner: Leveraging Synthetic Data for Real-Domain High-Resolution Monocular Metric Depth Estimationcited by 16
- 2021Real-time Monocular Depth Estimation with Sparse Supervision on Mobilecited by 12
- 2024Semi-supervised 3D Semantic Scene Completion with 2D Vision Foundation Model Guidancecited by 5
Built on by
Citing papers per year: 2025: 11; 2026: 10.
21 papers.
Sort:
By area:
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 54
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2025Depth Anything at Any Conditioncited by 12
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 7
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimationcited by 6
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Imagescited by 4
- 2026DVD: Deterministic Video Depth Estimation with Generative Priorscited by 4
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 3
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preferencecited by 2
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learningcited by 1
- 2025Toward A Better Understanding of Monocular Depth Evaluationcited by 1
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Renderingcited by 1
9 more
- 2026Any Resolution Any Geometry: From Multi-View To Multi-Patchcited by 1
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimationcited by 1
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Maskcited by 0
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systemscited by 0
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Samplingcited by 0
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusioncited by 0
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistencycited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimationcited by 0
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistency2 Apr 2026
- 2026DVD: Deterministic Video Depth Estimation with Generative Priors12 Mar 2026
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion11 Mar 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026Any Resolution Any Geometry: From Multi-View To Multi-Patch3 Mar 2026
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preference2 Mar 2026
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling10 Feb 2026
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Time9 Dec 2025
9 more
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025Toward A Better Understanding of Monocular Depth Evaluation22 Oct 2025
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation10 Oct 2025
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask4 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images11 Jun 2025
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models2 Jun 2025
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learning27 May 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preferencecited by 2
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimationcited by 1
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Samplingcited by 0
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusioncited by 0
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matchingcited by 0
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimationcited by 0
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation6 Sep 2026
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion11 Mar 2026
- 2026Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preference2 Mar 2026
- 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling10 Feb 2026
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 54
- 2025Depth Anything at Any Conditioncited by 12
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 7
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimationcited by 6
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Imagescited by 4
- 2026DVD: Deterministic Video Depth Estimation with Generative Priorscited by 4
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 3
- 2025Occlusion Boundary and Depth: Mutual Enhancement via Multi-Task Learningcited by 1
- 2025Toward A Better Understanding of Monocular Depth Evaluationcited by 1
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Renderingcited by 1
- 2026Any Resolution Any Geometry: From Multi-View To Multi-Patchcited by 1
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Maskcited by 0
12 most cited of 14 All 14 (JSON)
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistency2 Apr 2026
- 2026DVD: Deterministic Video Depth Estimation with Generative Priors12 Mar 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026Any Resolution Any Geometry: From Multi-View To Multi-Patch3 Mar 2026
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Time9 Dec 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025Toward A Better Understanding of Monocular Depth Evaluation22 Oct 2025
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation10 Oct 2025
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask4 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images11 Jun 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning
- 2024MetricGold: Leveraging Text-To-Image Latent Diffusion Models for Metric Depth Estimation
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources
- 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage
- 2026EagleDepth: Efficient Fine-Grained Depth Estimation via Pixel Diffusion Decoder
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matching