mlsanityData to 7 Oct 2026

DepthFocus: Controllable Depth Estimation for See-Through Scenes

arXiv 2511.16993 ↗First posted 21 Nov 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Depth in the real world is rarely singular. Transmissive materials create layered ambiguities that confound conventional perception systems. Existing models remain passive; conventional approaches typically estimate static depth maps anchored to the nearest surface, and even recent multi-head extensions suffer from a representational bottleneck due to fixed feature representations. This stands in contrast to human vision, which actively shifts focus to perceive a desired depth. We introduce DepthFocus, a steerable Vision Transformer that redefines stereo depth estimation as condition-aware control. Instead of extracting fixed features, our model dynamically modulates its computation based on a physical reference depth, integrating dual conditional mechanisms to selectively perceive geometry aligned with the desired focus. Leveraging a newly curated large-scale synthetic dataset, DepthFocus achieves state-of-the-art results across all evaluated benchmarks, including both standard single-layer and complex multi-layered scenarios. While maintaining high precision in opaque regions, our approach effectively resolves depth ambiguities in transparent and reflective scenes by selectively reconstructing geometry at a target distance. This capability enables robust, intent-driven perception that significantly outperforms existing multi-layer methods, marking a substantial step toward active 3D perception. noindent Project page: hrefhttps://junhong-3dv.github.io/depthfocus-project/this https URL.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 63 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

49 of 63 references.

References · 49

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2024Depth Anything V2cited by 1,385
  7. 2017Deep Image Priorcited by 1,097
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  9. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  10. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  11. 2018Pyramid Stereo Matching Networkcited by 486
  12. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
37 more
  1. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  2. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  3. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  4. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  5. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
  6. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  7. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  8. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  9. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
  10. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  11. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  12. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  13. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  14. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  15. 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
  16. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  17. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  18. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
  19. 2015Where To Look: Focus Regions for Visual Question Answeringcited by 64
  20. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  21. 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
  22. 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
  23. 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
  24. 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
  25. 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
  26. 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
  27. 2025DepthLM: Metric Depth From Vision Language Modelscited by 29
  28. 2020Learning to Autofocuscited by 26
  29. 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 23
  30. 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
  31. 2024LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flowcited by 11
  32. 2024ASGrasp: Generalizable Transparent Object Reconstruction and 6-DoF Grasp Detection from RGB-D Active Stereo Cameracited by 9
  33. 2025Seeing and Seeing Through the Glass: Real and Synthetic Data for Multi-Layer Depth Estimationcited by 8
  34. 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
  35. 2025Diffusion Image Priorcited by 3
  36. 2025Multi-Label Stereo Matching for Transparent Scene Depth Estimationcited by 3
  37. 2025Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguitycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.