mlsanityData to 7 Oct 2026

Matching-Free Depth Recovery from Structured Light

arXiv 2501.07113 ↗First posted 13 Jan 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a novel approach for depth estimation using images obtained from monocular structured light systems. In contrast to many existing methods that depend on image matching, our technique employs a density voxel grid to represent scene geometry. This grid is trained through self-supervised differentiable volume rendering. Our method leverages color fields derived from the projected patterns in structured light systems during the rendering process, facilitating the isolated optimization of the geometry field. This innovative approach leads to faster convergence and high-quality results. Additionally, we integrate normalized device coordinates (NDC), a distortion loss, and a distinctive surface-based color loss to enhance geometric fidelity. Experimental results demonstrate that our method outperforms current matching-based techniques in terms of geometric performance in few-shot scenarios, achieving an approximately 30% reduction in average estimated depth errors for both synthetic scenes and real-world captured scenes. Moreover, our approach allows for rapid training, being approximately three times faster than previous matching-free methods that utilize implicit representations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 60 references that are in the map. First posted on arXiv 13 Jan 2025.

Builds on

24 of 60 references.

References · 24

  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  4. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  5. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  6. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  7. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  8. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  9. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  10. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  11. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  12. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
12 more
  1. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  2. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
  3. 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
  4. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  5. 2017Intel RealSense Stereoscopic Depth Camerascited by 82
  6. 2018ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systemscited by 35
  7. 2021Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observationscited by 30
  8. 2022Single-Photon Structured Lightcited by 8
  9. 2020High-speed and high-efficiency three-dimensional shape measurement based on Gray-coded lightcited by 6
  10. 2023Reliable Image Dehazing by NeRFcited by 4
  11. 2024Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systemscited by 4
  12. 2023TIDE: Temporally Incremental Disparity Estimation via Pattern Flow in Structured Light Systemcited by 2

Built on by

Not cited yet.