mlsanityData to 14 Oct 2026

Reliable iToF Depth Sensing via Sensor-Intrinsic Uncertainty Modeling and State-Space Restoration

arXiv 2609.05507 ↗First posted 29 Aug 2026physics.optics cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Indirect time-of-flight (iToF) cameras provide compact and cost-effective dense depth measurements, but their ranging accuracy is often degraded by sensor-intrinsic uncertainty under practical imaging conditions. Spatially uniform or range-only Gaussian perturbations cannot accurately reproduce the range-dependent and signal-dependent noise characteristics of real iToF measurements, leading to a synthetic-to-real gap for learning-based restoration. To address this problem, we propose a joint depth-uncertainty modeling and restoration framework for reliable iToF sensing. A sensor-intrinsic depth-uncertainty model is first developed from calibrated tap responses, returned-signal levels, and sensor noise statistics through a depth-oriented weighted least-squares formulation. The resulting pixel-wise uncertainty is used for heteroscedastic depth synthesis and uncertainty-aware restoration supervision. Based on this heteroscedastic data synthesis, we further develop a U-shaped restoration network with Depth Visual State Space (DVSS) blocks, which combine long-range state-space modeling with convolutional spatial-channel refinement for structure-preserving depth recovery. Experiments on synthetic data and measurements captured by an in-house iToF prototype validate the proposed uncertainty model under varying range and returned-signal conditions. Controlled comparisons with fixed and range-aware Gaussian noise, together with evaluations on U-Net, Restormer, and DVSS, further demonstrate that the proposed synthesis consistently benefits different restoration backbones. The complete framework achieves 40.85~dB PSNR and 2.54 mm MAE on the synthetic test set, and 35.42 dB PSNR and 4.87 mm MAE on real iToF measurements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

13 of 37 references.

References · 13

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  4. 2024Is Mamba Effective for Time Series Forecasting?cited by 114
  5. 2022GhostNetV2: Enhance Cheap Operation with Long-Range Attentioncited by 44
  6. 2018Tackling 3D ToF Artifacts Through Learning and the FLAT Datasetcited by 21
  7. 2019Deep End-to-End Alignment and Refinement for Time-of-Flight RGB-D Modulecited by 14
  8. 2021All the attention you need: Global-local, spatial-channel attention for image retrievalcited by 12
  9. 2021iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imagingcited by 11
  10. 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methodscited by 8
  11. 2021RADU: Ray-Aligned Depth Update Convolutions for ToF Data Denoisingcited by 5
  12. 2025Consistent Time-of-Flight Depth Denoising via Graph-Informed Geometric Attentioncited by 1
1 more
  1. 2025A Calibration Method for Indirect Time-of-Flight Cameras to Eliminate Internal Scattering Interferencecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Perfecting Depth: Uncertainty-Aware Enhancement of Metric Depth
  2. 2025Towards Robust Time-of-Flight Depth Denoising with Confidence-Aware Diffusion Model
  3. 2026Robust Depth Super-Resolution via Adaptive Diffusion Sampling
  4. 2025VistaDepth: Improving far-range Depth Estimation with Spectral Modulation and Adaptive Reweighting
  5. 2023360^circ High-Resolution Depth Estimation via Uncertainty-aware Structural Knowledge Transfer
  6. 2024Self-Distilled Depth Refinement with Noisy Poisson Fusion
  7. 2025Always Clear Depth: Robust Monocular Depth Estimation under Adverse Weather
  8. 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillation