DepthFocus: Controllable Depth Estimation for See-Through Scenes
Not on the map. Why?
Abstract (arXiv)
Depth in the real world is rarely singular. Transmissive materials create layered ambiguities that confound conventional perception systems. Existing models remain passive; conventional approaches typically estimate static depth maps anchored to the nearest surface, and even recent multi-head extensions suffer from a representational bottleneck due to fixed feature representations. This stands in contrast to human vision, which actively shifts focus to perceive a desired depth. We introduce DepthFocus, a steerable Vision Transformer that redefines stereo depth estimation as condition-aware control. Instead of extracting fixed features, our model dynamically modulates its computation based on a physical reference depth, integrating dual conditional mechanisms to selectively perceive geometry aligned with the desired focus. Leveraging a newly curated large-scale synthetic dataset, DepthFocus achieves state-of-the-art results across all evaluated benchmarks, including both standard single-layer and complex multi-layered scenarios. While maintaining high precision in opaque regions, our approach effectively resolves depth ambiguities in transparent and reflective scenes by selectively reconstructing geometry at a target distance. This capability enables robust, intent-driven perception that significantly outperforms existing multi-layer methods, marking a substantial step toward active 3D perception. noindent Project page: hrefhttps://junhong-3dv.github.io/depthfocus-project/this https URL.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 63 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
49 of 63 references.
References · 49
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2017Deep Image Priorcited by 1,097
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2018Pyramid Stereo Matching Networkcited by 486
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
37 more
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2015Where To Look: Focus Regions for Visual Question Answeringcited by 64
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2025DepthLM: Metric Depth From Vision Language Modelscited by 29
- 2020Learning to Autofocuscited by 26
- 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 23
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2024LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flowcited by 11
- 2024ASGrasp: Generalizable Transparent Object Reconstruction and 6-DoF Grasp Detection from RGB-D Active Stereo Cameracited by 9
- 2025Seeing and Seeing Through the Glass: Real and Synthetic Data for Multi-Layer Depth Estimationcited by 8
- 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
- 2025Diffusion Image Priorcited by 3
- 2025Multi-Label Stereo Matching for Transparent Scene Depth Estimationcited by 3
- 2025Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguitycited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matchingcited by 2
- 2026Faithfulness to Refusal: A Causal Audit of Neuron Selectorscited by 2
- 2026NBS: No Bias Stereocited by 0
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026Faithfulness to Refusal: A Causal Audit of Neuron Selectors6 Jul 2026
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching25 Mar 2026