Deep Depth from Focus with Differential Focus Volume
Not on the map. Why?
Abstract (arXiv)
Depth-from-focus (DFF) is a technique that infers depth using the focus change of a camera. In this work, we propose a convolutional neural network (CNN) to find the best-focused pixels in a focal stack and infer depth from the focus estimation. The key innovation of the network is the novel deep differential focus volume (DFV). By computing the first-order derivative with the stacked features over different focal distances, DFV is able to capture both the focus and context information for focus analysis. Besides, we also introduce a probability regression mechanism for focus estimation to handle sparsely sampled focal stacks and provide uncertainty estimation to the final prediction. Comprehensive experiments demonstrate that the proposed model achieves state-of-the-art performance on multiple datasets with good generalizability and fast speed.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 25 of its 54 references that are in the map. First posted on arXiv 3 Dec 2021.
Builds on
25 of 54 references.
References · 25
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
13 more
- 2018Pyramid Stereo Matching Networkcited by 489
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
- 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 136
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2017Accurate Optical Flow via Direct Cost Volume Processingcited by 66
- 2020Focus on defocus: bridging the synthetic to real domain gap for depth estimationcited by 37
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2017Deep Depth From Focuscited by 28
- 2018The Visual Centrifuge: Model-Free Layered Video Representationscited by 23
- 2021Robustness via Cross-Domain Ensemblescited by 23
- 2021Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervisioncited by 23
- 2014Variational Depth from Focus Reconstructioncited by 15
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 6; 2025: 5; 2026: 4.
20 papers.
Sort:
- 2023Fully Self-Supervised Depth Estimation from Defocus Cluecited by 17
- 2023Aberration-Aware Depth-from-Focuscited by 12
- 2024Sharp-NeRF: Grid-based Fast Deblurring Neural Radiance Fields Using Sharpness Priorcited by 12
- 2024HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priorscited by 11
- 2022Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariancecited by 7
- 2023Camera-Independent Single Image Depth Estimation from Defocus Blurcited by 5
- 2025Blurry-Edges: Photon-Limited Depth Estimation from Defocused Boundariescited by 4
- 2024Depth Estimation Based on 3D Gaussian Splatting Siamese Defocuscited by 3
- 2024Self-Supervised Spatially Variant PSF Estimation for Aberration-Aware Depth-from-Defocuscited by 2
- 2023FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stackcited by 1
- 2024Learning Monocular Depth from Focus with Event Focal Stackcited by 1
- 2024Dense Depth from Event Focal Stackcited by 1
8 more
- 2025One-Step Event-Driven High-Speed Autofocuscited by 1
- 2025DualFocus: Depth from Focus with Spatio-Focal Dual Variational Constraintscited by 1
- 2025Robust Shape from Focus via Multiscale Directional Dilated Laplacian and Recurrent Networkcited by 1
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Renderingcited by 1
- 2026Depth from Defocus via Direct Optimizationcited by 0
- 2026Zero-Shot Depth from Defocuscited by 0
- 2026Towards Minimal Focal Stack in Shape from Focuscited by 0
- 2026Enhancing Hazy Wildlife Imagery: AnimalHaze3k and IncepDehazeGancited by 0
- 2026Enhancing Hazy Wildlife Imagery: AnimalHaze3k and IncepDehazeGan17 Apr 2026
- 2026Towards Minimal Focal Stack in Shape from Focus2 Apr 2026
- 2026Zero-Shot Depth from Defocus27 Mar 2026
- 2026Depth from Defocus via Direct Optimization18 Feb 2026
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025Robust Shape from Focus via Multiscale Directional Dilated Laplacian and Recurrent Network11 Dec 2025
- 2025DualFocus: Depth from Focus with Spatio-Focal Dual Variational Constraints26 Sep 2025
- 2025Blurry-Edges: Photon-Limited Depth Estimation from Defocused Boundaries30 Mar 2025
- 2025One-Step Event-Driven High-Speed Autofocus3 Mar 2025
- 2024Dense Depth from Event Focal Stack11 Dec 2024
- 2024Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus18 Sep 2024
- 2024HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priors26 Jul 2024
8 more
- 2024Learning Monocular Depth from Focus with Event Focal Stack11 May 2024
- 2024Self-Supervised Spatially Variant PSF Estimation for Aberration-Aware Depth-from-Defocus28 Feb 2024
- 2024Sharp-NeRF: Grid-based Fast Deblurring Neural Radiance Fields Using Sharpness Prior1 Jan 2024
- 2023Camera-Independent Single Image Depth Estimation from Defocus Blur21 Nov 2023
- 2023FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stack17 Oct 2023
- 2023Fully Self-Supervised Depth Estimation from Defocus Clue19 Mar 2023
- 2023Aberration-Aware Depth-from-Focus8 Mar 2023
- 2022Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance26 Feb 2022
- 2023Fully Self-Supervised Depth Estimation from Defocus Cluecited by 17
- 2023Aberration-Aware Depth-from-Focuscited by 12
- 2024Sharp-NeRF: Grid-based Fast Deblurring Neural Radiance Fields Using Sharpness Priorcited by 12
- 2024HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priorscited by 11
- 2022Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariancecited by 7
- 2023Camera-Independent Single Image Depth Estimation from Defocus Blurcited by 5
- 2025Blurry-Edges: Photon-Limited Depth Estimation from Defocused Boundariescited by 4
- 2024Depth Estimation Based on 3D Gaussian Splatting Siamese Defocuscited by 3
- 2024Self-Supervised Spatially Variant PSF Estimation for Aberration-Aware Depth-from-Defocuscited by 2
- 2023FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stackcited by 1
- 2024Learning Monocular Depth from Focus with Event Focal Stackcited by 1
- 2024Dense Depth from Event Focal Stackcited by 1
12 most cited of 20 All 20 (JSON)
- 2026Enhancing Hazy Wildlife Imagery: AnimalHaze3k and IncepDehazeGan17 Apr 2026
- 2026Towards Minimal Focal Stack in Shape from Focus2 Apr 2026
- 2026Zero-Shot Depth from Defocus27 Mar 2026
- 2026Depth from Defocus via Direct Optimization18 Feb 2026
- 2025Boosting Monocular Metric Depth Estimation via Bokeh Rendering13 Dec 2025
- 2025Robust Shape from Focus via Multiscale Directional Dilated Laplacian and Recurrent Network11 Dec 2025
- 2025DualFocus: Depth from Focus with Spatio-Focal Dual Variational Constraints26 Sep 2025
- 2025Blurry-Edges: Photon-Limited Depth Estimation from Defocused Boundaries30 Mar 2025
- 2025One-Step Event-Driven High-Speed Autofocus3 Mar 2025
- 2024Dense Depth from Event Focal Stack11 Dec 2024
- 2024Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus18 Sep 2024
- 2024HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priors26 Jul 2024
12 newest of 20 All 20 (JSON)