LocalBins: Improving Depth Estimation by Learning Local Distributions
Not on the map. Why?
Abstract (arXiv)
We propose a novel architecture for depth estimation from a single image. The architecture itself is based on the popular encoder-decoder architecture that is frequently used as a starting point for all dense regression tasks. We build on AdaBins which estimates a global distribution of depth values for the input image and evolve the architecture in two ways. First, instead of predicting global depth distributions, we predict depth distributions of local neighborhoods at every pixel. Second, instead of predicting depth distributions only towards the end of the decoder, we involve all layers of the decoder. We call this new architecture LocalBins. Our results demonstrate a clear improvement over the state-of-the-art in all metrics on the NYU-Depth V2 dataset. Code and pretrained models will be made publicly available.
Key facts. Cited by 94 papers in the map (data through 14 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
34 of 46 references.
References · 34
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Mask R-CNNcited by 7,277
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
22 more
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
- 2018Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps with Accurate Object Boundariescited by 145
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
- 2020CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistencycited by 107
- 2020Unsupervised Monocular Depth Learning in Dynamic Scenescited by 84
- 2020Guiding Monocular Depth Estimation Using Depth-Attention Volumecited by 82
- 2018Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimationcited by 78
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
- 2017Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimationcited by 70
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2019Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimationcited by 61
- 2019SharpNet: Fast and Accurate Recovery of Occluding Contours in Monocular Depth Estimationcited by 59
- 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
- 2019Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semanticscited by 49
- 2019Structure-Aware Residual Pyramid Network for Monocular Depth Estimationcited by 49
- 2018Detail Preserving Depth Estimation from a Single Image Using Attention Guided Networkscited by 31
- 2019Unsupervised Domain Adaptation for Depth Prediction from Imagescited by 29
- 2020Domain Decluttering: Simplifying Images to Mitigate Synthetic-Real Domain Shift and Improve Depth Estimationcited by 17
- 2021Self-Supervised Learning of Domain Invariant Features for Depth Estimationcited by 9
Built on by
Citing papers per year: 2022: 2; 2023: 23; 2024: 31; 2025: 19; 2026: 19.
94 papers.
Sort:
By area:
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 74
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 54
- 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 43
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
38 more
- 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentationcited by 30
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2024DepthLab: From Partial to Completecited by 27
- 2023Kick Back & Relax: Learning to Reconstruct the World by Watching SlowTVcited by 21
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2023Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Samplingcited by 19
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimationcited by 19
- 2024ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimationcited by 15
- 2023PolyMaX: General Dense Prediction with Mask Transformercited by 14
- 2023EVP: Enhanced Visual Perception using Inverse Multi-Attentive Feature Refinement and Regularized Image-Text Alignmentcited by 14
- 2023The Second Monocular Depth Estimation Challengecited by 12
- 2024Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoningcited by 12
- 2024EndoOmni: Zero-Shot Cross-Dataset Depth Estimation in Endoscopy by Robust Self-Learning from Noisy Labelscited by 12
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domaincited by 12
- 2024HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priorscited by 11
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networkscited by 10
- 2024The Third Monocular Depth Estimation Challengecited by 10
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sourcescited by 10
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completioncited by 9
- 2024Scalable Autoregressive Monocular Depth Estimationcited by 9
- 2023HTC-DC Net: Monocular Height Estimation from Single Remote Sensing Imagescited by 8
- 2025The Fourth Monocular Depth Estimation Challengecited by 8
- 2023FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scenecited by 7
- 2024PCDepth: Pattern-based Complementary Learning for Monocular Depth Estimation by Best of Both Worldscited by 7
- 2024Kick Back & Relax++: Scaling Beyond Ground-Truth Depth with SlowTV & CribsTVcited by 7
- 2024A Simple yet Effective Test-Time Adaptation for Zero-Shot Monocular Metric Depth Estimationcited by 6
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Imagecited by 6
- 2023Virtual Occlusions Through Implicit Depthcited by 5
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wildcited by 5
- 2025PatchRefiner V2: Fast and Lightweight Real-Domain High-Resolution Metric Depth Estimationcited by 5
- 2025A Survey on Ordinal Regression: Applications, Advances and Prospectscited by 5
- 2025EgoDTM: Towards 3D-Aware Egocentric Video-Language Pretrainingcited by 5
- 2023Mitigating Perspective Distortion-induced Shape Ambiguity in Image Cropscited by 4
- 2024Scale-Invariant Monocular Depth Estimation via SSI Depthcited by 4
- 2024TanDepth: Leveraging Global DEMs for Metric Monocular Depth Estimation in UAVscited by 4
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Taskcited by 4
- 2023Meta-Optimization for Higher Model Generalizability in Single-Image Depth Predictioncited by 3
- 2023Improving Equivariance in State-of-the-Art Supervised Depth and Normal Predictorscited by 3
50 most cited of 94 All 94 (JSON)
- 2026Harnessing SPAD Noise: Test-Time Gated Attention for Indoor Depth Estimation11 Oct 2026
- 2026GeoBridge: Evolving Transferable Decoder Topologies for Geometric Vision11 Oct 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation16 Jul 2026
- 2026ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device9 Jul 2026
- 2026Leveraging Metric Depth for Relative Depth Prediction9 Jun 2026
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement22 May 2026
- 2026DegBins: Degradation-Driven Binning for Depth Super-Resolution10 May 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026Monocular Depth Estimation From the Perspective of Feature Restoration: A Diffusion Enhanced Depth Restoration Approach9 Apr 2026
38 more
- 2026LiftFormer: Lifting and Frame Theory Based Monocular Depth Estimation Using Depth and Edge Oriented Subspace Representation8 Apr 2026
- 2026Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction3 Apr 2026
- 2026The First Assessment of PhiSat-2 Imagery for Monocular Building Height Estimation31 Mar 2026
- 2026Dual-Domain Representation Alignment: Bridging 2D and 3D Vision via Geometry-Aware Architecture Search20 Mar 2026
- 2026Fractal Autoregressive Depth Estimation with Continuous Token Diffusion16 Mar 2026
- 2026RAD: Retrieval-Augmented Monocular Metric Depth Estimation for Underrepresented Classes10 Feb 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2025Scale-invariant and View-relational Representation Learning for Full Surround Monocular Depth9 Dec 2025
- 2025TSE-Net: Semi-supervised Monocular Height Estimation from Single Remote Sensing Images17 Nov 2025
- 2025WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimation11 Nov 2025
- 2025EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model25 Oct 2025
- 2025FreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformers17 Oct 2025
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation15 Jul 2025
- 2025Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Grasping20 Jun 2025
- 2025TR2M: Transferring Monocular Relative Depth to Metric Depth with Language Descriptions and Dual-Level Scale-Oriented Contrast16 Jun 2025
- 2025VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery5 May 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Image16 Apr 2025
- 2025EgoDTM: Towards 3D-Aware Egocentric Video-Language Pretraining19 Mar 2025
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimation18 Mar 2025
- 2025Is Pre-training Applicable to the Decoder for Dense Prediction?5 Mar 2025
- 2025A Survey on Ordinal Regression: Applications, Advances and Prospects2 Mar 2025
- 2025CoL3D: Collaborative Learning of Single-view Depth and Camera Intrinsics for Metric 3D Shape Recovery13 Feb 2025
- 2025Survey on Monocular Metric Depth Estimation21 Jan 2025
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan 2025
- 2025PatchRefiner V2: Fast and Lightweight Real-Domain High-Resolution Metric Depth Estimation2 Jan 2025
- 2024DepthLab: From Partial to Complete24 Dec 2024
- 2024A Simple yet Effective Test-Time Adaptation for Zero-Shot Monocular Metric Depth Estimation18 Dec 2024
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimation18 Dec 2024
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wild3 Dec 2024
- 2024AVS-Net: Audio-Visual Scale Net for Self-supervised Monocular Metric Depth Estimation2 Dec 2024
- 2024Scalable Autoregressive Monocular Depth Estimation18 Nov 2024
- 2024Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions6 Nov 2024
- 2024DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domain19 Oct 2024
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Second2 Oct 2024
- 2024KineDepth: Utilizing Robot Kinematics for Online Metric Depth Estimation29 Sep 2024
- 20243DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation25 Sep 2024
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task23 Sep 2024
50 newest of 94 All 94 (JSON)
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimatorscited by 31
- 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentationcited by 30
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimationcited by 19
- 2023EVP: Enhanced Visual Perception using Inverse Multi-Attentive Feature Refinement and Regularized Image-Text Alignmentcited by 14
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Taskcited by 4
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimationcited by 0
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan 2025
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task23 Sep 2024
- 2024EDADepth: Enhanced Data Augmentation for Monocular Depth Estimation10 Sep 2024
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimation27 Mar 2024
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matching20 Mar 2024
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model20 Dec 2023
- 2023EVP: Enhanced Visual Perception using Inverse Multi-Attentive Feature Refinement and Regularized Image-Text Alignment13 Dec 2023
- 2023FreeReg: Image-to-Point Cloud Registration Leveraging Pretrained Diffusion Models and Monocular Depth Estimators5 Oct 2023
- 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentation5 Jul 2023
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 74
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 54
- 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
- 2024EndoDAC: Efficient Adapting Foundation Model for Self-Supervised Depth Estimation from Any Endoscopic Cameracited by 43
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2024DepthLab: From Partial to Completecited by 27
- 2023Kick Back & Relax: Learning to Reconstruct the World by Watching SlowTVcited by 21
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
12 most cited of 82 All 82 (JSON)
- 2026Harnessing SPAD Noise: Test-Time Gated Attention for Indoor Depth Estimation11 Oct 2026
- 2026GeoBridge: Evolving Transferable Decoder Topologies for Geometric Vision11 Oct 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity2 Aug 2026
- 2026ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device9 Jul 2026
- 2026Leveraging Metric Depth for Relative Depth Prediction9 Jun 2026
- 2026LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement22 May 2026
- 2026DegBins: Degradation-Driven Binning for Depth Super-Resolution10 May 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026Monocular Depth Estimation From the Perspective of Feature Restoration: A Diffusion Enhanced Depth Restoration Approach9 Apr 2026
- 2026LiftFormer: Lifting and Frame Theory Based Monocular Depth Estimation Using Depth and Edge Oriented Subspace Representation8 Apr 2026
12 newest of 82 All 82 (JSON)