DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling
Not on the map. Why?
Abstract (arXiv)
We describe a technique that automatically generates plausible depth maps from videos using non-parametric depth sampling. We demonstrate our technique in cases where past methods fail (non-translating cameras and dynamic scenes). Our technique is applicable to single images as well as videos. For videos, we use local motion cues to improve the inferred depth maps, while optical flow is used to ensure temporal depth consistency. For training and evaluation, we use a Kinect-based system to collect a large dataset containing stereoscopic videos with known depths. We show that our depth estimation technique outperforms the state-of-the-art on benchmark databases. Our technique can be used to automatically convert a monoscopic video into stereo for 3D visualization, and we demonstrate this through a variety of visually pleasing results for indoor and outdoor scenes, including results from the feature film Charade.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 14; 2023: 11; 2024: 4; 2025: 3; 2026: 4.
60 papers.
Sort:
By area:
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
- 2021Single Image Depth Estimation: An Overviewcited by 35
- 2023HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modelingcited by 35
38 more
- 2021SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular imagescited by 33
- 2022Less is More: Consistent Video Depth Estimation with Masked Frames Modelingcited by 30
- 2022Sparsity Agnostic Depth Completioncited by 27
- 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
- 2021Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimationcited by 16
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2021Real-time Monocular Depth Estimation with Sparse Supervision on Mobilecited by 12
- 2021X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillationcited by 12
- 2021Contrastive Feature Loss for Image Predictioncited by 12
- 2021GCNDepth: Self-supervised Monocular Depth Estimation based on Graph Convolutional Networkcited by 12
- 2022MonoIndoor++:Towards Better Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 12
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimationcited by 11
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networkscited by 10
- 2023SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Networkcited by 10
- 2021EdgeConv with Attention Module for Monocular Depth Estimationcited by 9
- 2021Boundary-induced and scene-aggregated network for monocular depth predictioncited by 8
- 2023Joint Self-supervised Depth and Optical Flow Estimation towards Dynamic Objectscited by 8
- 2021Self-supervised Depth Estimation Leveraging Global Perception and Geometric Smoothness Using On-board Videoscited by 7
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimationcited by 7
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Priorcited by 7
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimationcited by 6
- 20223D-PL: Domain Adaptive Depth Estimation with 3D-aware Pseudo-Labelingcited by 6
- 2023NVDS+: Towards Efficient and Versatile Neural Stabilizer for Video Depth Estimationcited by 6
- 2021Unsupervised Monocular Depth Perception: Focusing on Moving Objectscited by 4
- 2022How Far Can I Go ? : A Self-Supervised Approach for Deterministic Video Depth Forecastingcited by 3
- 2021ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimationcited by 2
- 2021Dilated Fully Convolutional Neural Network for Depth Estimation from a Single Imagecited by 2
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimationcited by 2
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimationcited by 2
- 2021Self-Supervised Learning of Depth and Ego-Motion from Video by Alternative Training and Geometric Constraints from 3D to 2Dcited by 1
- 2022Self-Supervised Depth Estimation with Isometric-Self-Sample-Based Learningcited by 1
- 2022Rethinking Skip Connections in Encoder-decoder Networks for Monocular Depth Estimationcited by 1
- 2022Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Informationcited by 1
- 2021A Weakly-Supervised Depth Estimation Network Using Attention Mechanismcited by 0
- 2021Sparse Depth Completion with Semantic Mesh Deformation Optimizationcited by 0
- 2021Improving Depth Estimation using Location Informationcited by 0
50 most cited of 60 All 60 (JSON)
- 2026VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching29 May 2026
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026Computational Framework for Estimating Relative Gaussian Blur Kernels between Image Pairs26 Jan 2026
- 2026Defocus Aberration Theory Confirms Gaussian Model in Most Imaging Devices8 Jan 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025DeLightMono: Enhancing Self-Supervised Monocular Depth Estimation in Endoscopy by Decoupling Uneven Illumination25 Nov 2025
- 2025Depth-Supervised Fusion Network for Seamless-Free Image Stitching24 Oct 2025
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation10 May 2024
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Prior10 Apr 2024
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimation27 Mar 2024
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimation3 Dec 2023
38 more
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation26 Sep 2023
- 2023Joint Self-supervised Depth and Optical Flow Estimation towards Dynamic Objects7 Sep 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detection27 Jul 2023
- 2023NVDS+: Towards Efficient and Versatile Neural Stabilizer for Video Depth Estimation17 Jul 2023
- 2023PanelNet: Understanding 360 Indoor Environment via Panel Representation16 May 2023
- 2023Pose Constraints for Consistent Self-supervised Monocular Depth and Ego-motion18 Apr 2023
- 2023360^circ High-Resolution Depth Estimation via Uncertainty-aware Structural Knowledge Transfer17 Apr 2023
- 2023HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modeling5 Mar 2023
- 2023SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Network17 Jan 2023
- 2022Sparsity Agnostic Depth Completion1 Dec 2022
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networks24 Nov 2022
- 2022Improving Pixel-Level Contrastive Learning by Leveraging Exogenous Depth Information18 Nov 2022
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenes7 Nov 2022
- 20223D-PL: Domain Adaptive Depth Estimation with 3D-aware Pseudo-Labeling19 Sep 2022
- 2022Rethinking Skip Connections in Encoder-decoder Networks for Monocular Depth Estimation29 Aug 2022
- 2022Minimizing the Effect of Noise and Limited Dataset Size in Image Classification Using Depth Estimation as an Auxiliary Task with Deep Multitask Learning22 Aug 2022
- 2022Less is More: Consistent Video Depth Estimation with Masked Frames Modeling31 Jul 2022
- 2022MonoIndoor++:Towards Better Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments18 Jul 2022
- 2022How Far Can I Go ? : A Self-Supervised Approach for Deterministic Video Depth Forecasting1 Jul 2022
- 2022Self-Supervised Depth Estimation with Isometric-Self-Sample-Based Learning20 May 2022
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimation5 Apr 2022
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior5 Apr 2022
- 2022Joint Learning of Frequency and Spatial Domains for Dense Predictions18 Feb 2022
- 2021Improving Depth Estimation using Location Information27 Dec 2021
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation24 Dec 2021
- 2021GCNDepth: Self-supervised Monocular Depth Estimation based on Graph Convolutional Network13 Dec 2021
- 2021Sparse Depth Completion with Semantic Mesh Deformation Optimization10 Dec 2021
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimation30 Nov 2021
- 2021Contrastive Feature Loss for Image Prediction12 Nov 2021
- 2021X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillation24 Oct 2021
- 2021Unsupervised Monocular Depth Perception: Focusing on Moving Objects30 Aug 2021
- 2021Self-Supervised Learning of Depth and Ego-Motion from Video by Alternative Training and Geometric Constraints from 3D to 2D4 Aug 2021
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments26 Jul 2021
- 2021A Weakly-Supervised Depth Estimation Network Using Attention Mechanism10 Jul 2021
- 2021EdgeConv with Attention Module for Monocular Depth Estimation16 Jun 2021
- 2021Self-supervised Depth Estimation Leveraging Global Perception and Geometric Smoothness Using On-board Videos7 Jun 2021
- 2021Real-time Monocular Depth Estimation with Sparse Supervision on Mobile25 May 2021
50 newest of 60 All 60 (JSON)
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
- 2021Single Image Depth Estimation: An Overviewcited by 35
- 2023HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modelingcited by 35
- 2021SOSD-Net: Joint Semantic Object Segmentation and Depth Estimation from Monocular imagescited by 33
12 most cited of 58 All 58 (JSON)
- 2026DAGE: Dual-Stream Architecture for Efficient and Fine-Grained Geometry Estimation4 Mar 2026
- 2026Computational Framework for Estimating Relative Gaussian Blur Kernels between Image Pairs26 Jan 2026
- 2026Defocus Aberration Theory Confirms Gaussian Model in Most Imaging Devices8 Jan 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025DeLightMono: Enhancing Self-Supervised Monocular Depth Estimation in Endoscopy by Decoupling Uneven Illumination25 Nov 2025
- 2025Depth-Supervised Fusion Network for Seamless-Free Image Stitching24 Oct 2025
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation10 May 2024
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Prior10 Apr 2024
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimation3 Dec 2023
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation26 Sep 2023
- 2023Joint Self-supervised Depth and Optical Flow Estimation towards Dynamic Objects7 Sep 2023
12 newest of 58 All 58 (JSON)