mlsanityData to 7 Oct 2026

Towards 3D Vision with Low-Cost Single-Photon Cameras

arXiv 2403.17801 ↗First posted 26 Mar 2024cs.CV eess.IVcited by 15

Not on the map. Why?

Abstract (arXiv)

We present a method for reconstructing 3D shape of arbitrary Lambertian objects based on measurements by miniature, energy-efficient, low-cost single-photon cameras. These cameras, operating as time resolved image sensors, illuminate the scene with a very fast pulse of diffuse light and record the shape of that pulse as it returns back from the scene at a high temporal resolution. We propose to model this image formation process, account for its non-idealities, and adapt neural rendering to reconstruct 3D geometry from a set of spatially distributed sensors with known poses. We show that our approach can successfully recover complex 3D shapes from simulated data. We further demonstrate 3D object reconstruction from real-world captures, utilizing measurements from a commodity proximity sensor. Our work draws a connection between image-based modeling and active range scanning and is a step towards 3D vision with single-photon cameras.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 24 of its 63 references that are in the map. First posted on arXiv 26 Mar 2024.

Builds on

24 of 63 references.

References · 24

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  3. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  4. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  5. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  6. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  7. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  8. 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
  9. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  10. 2022PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereocited by 69
  11. 2023Neural LiDAR Fields for Novel View Synthesiscited by 65
  12. 2020Non-line-of-sight Imagingcited by 41
12 more
  1. 2023Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensorcited by 30
  2. 2022DELTAR: Depth Estimation from a Light-weight ToF Sensor and RGB Imagecited by 26
  3. 2019Photon-Flooded Single-Photon 3D Camerascited by 23
  4. 2023MVPSNet: Fast Generalizable Multi-view Photometric Stereocited by 18
  5. 2023Transient Neural Radiance Fields for Lidar View Synthesis and 3D Reconstructioncited by 18
  6. 2021Multi-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectancecited by 17
  7. 2022Multi-View Photometric Stereo Revisitedcited by 17
  8. 2022Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imagingcited by 15
  9. 2017A Computational Model of a Single-Photon Avalanche Diode Sensor for Transient Imagingcited by 13
  10. 2023NLOS-NeuS: Non-line-of-sight Neural Implicit Surfacecited by 13
  11. 20223D Scene Inference from Transient Histogramscited by 6
  12. 2023Unlocking the Performance of Proximity Sensors by Utilizing Transient Histogramscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 6; 2026: 3.

15 papers.

Sort:

  1. 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGBcited by 10
  2. 2024Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDARcited by 8
  3. 2024Flying with Photons: Rendering Novel Views of Propagating Lightcited by 7
  4. 2024Transientangelo: Few-Viewpoint Surface Reconstruction Using Single-Photon Lidarcited by 6
  5. 2024ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planningcited by 4
  6. 2024Using a Distance Sensor to Detect Deviations in a Planar Surfacecited by 3
  7. 2025Recovering Parametric Scenes from Very Few Time-of-Flight Pixelscited by 3
  8. 2025Neural Inverse Rendering from Propagating Lightcited by 1
  9. 2025Shoot-Bounce-3D: Single-Shot Occlusion-Aware 3D from Lidar by Decomposing Two-Bounce Lightcited by 1
  10. 2025Task-Driven Implicit Representations for Automated Design of LiDAR Systemscited by 0
  11. 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perceptioncited by 0
  12. 2025Hardware-aware Coding Function Design for Compressive Single-Photon 3D Camerascited by 0
3 more
  1. 2026Spatial Calibration of Diffuse LiDARscited by 0
  2. 2026DENALI: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARscited by 0
  3. 2026Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Renderingcited by 0