mlsanityData to 14 Oct 2026

Centimeter-Wave Free-Space Time-of-Flight Imaging

arXiv 2105.11606 ↗First posted 25 May 2021cs.CV physics.opticscited by 0

Not on the map. Why?

Abstract (arXiv)

Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 103 references that are in the map. First posted on arXiv 25 May 2021.

Builds on

23 of 103 references.

References · 23

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  5. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  6. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
  7. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
  8. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  9. 2019Fast-SCNN: Fast Semantic Segmentation Networkcited by 125
  10. 2017ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scanscited by 103
  11. 2018Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Predictioncited by 52
  12. 2019Learning Single Camera Depth Estimation using Dual-Pixelscited by 49
11 more
  1. 2019Asynchronous Single-Photon 3D Imagingcited by 25
  2. 2019Photon-Flooded Single-Photon 3D Camerascited by 23
  3. 2018Tackling 3D ToF Artifacts Through Learning and the FLAT Datasetcited by 21
  4. 2018On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approachcited by 18
  5. 2019Self-Supervised Deep Depth Denoisingcited by 15
  6. 2019Deep End-to-End Alignment and Refinement for Time-of-Flight RGB-D Modulecited by 14
  7. 2014SRA: Fast Removal of General Multipath for ToF Sensorscited by 10
  8. 2014Resolving Multi-path Interference in Time-of-Flight Imaging via Modulation Frequency Diversity and Sparse Regularizationcited by 6
  9. 2018Efficient Hierarchical Graph-Based Segmentation of RGBD Videoscited by 3
  10. 2016Efficient Multi-Frequency Phase Unwrapping using Kernel Density Estimationcited by 2
  11. 2017Snapshot Difference Imaging using Time-of-Flight Sensorscited by 2

Built on by

Not cited yet.