mlsanityData to 14 Oct 2026

Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDAR

arXiv 2410.03555 ↗First posted 4 Oct 2024cs.RO cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Robust autonomous navigation in environments with limited visibility remains a critical challenge in robotics. We present a novel approach that leverages Non-Line-of-Sight (NLOS) sensing using single-photon LiDAR to improve visibility and enhance autonomous navigation. Our method enables mobile robots to "see around corners" by utilizing multi-bounce light information, effectively expanding their perceptual range without additional infrastructure. We propose a three-module pipeline: (1) Sensing, which captures multi-bounce histograms using SPAD-based LiDAR; (2) Perception, which estimates occupancy maps of hidden regions from these histograms using a convolutional neural network; and (3) Control, which allows a robot to follow safe paths based on the estimated occupancy. We evaluate our approach through simulations and real-world experiments on a mobile robot navigating an L-shaped corridor with hidden obstacles. Our work represents the first experimental demonstration of NLOS imaging for autonomous navigation, paving the way for safer and more efficient robotic systems operating in complex environments. We also contribute a novel dynamics-integrated transient rendering framework for simulating NLOS scenarios, facilitating future research in this domain.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 13 of its 51 references that are in the map. First posted on arXiv 4 Oct 2024.

Builds on

13 of 51 references.

References · 13

  1. 2018Virtual Wave Optics for Non-Line-of-Sight Imagingcited by 54
  2. 2020Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimationcited by 34
  3. 2020Multi-Layered Safety for Legged Robots via Control Barrier Functions and Model Predictive Controlcited by 25
  4. 2024Towards 3D Vision with Low-Cost Single-Photon Camerascited by 15
  5. 2019Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Pathcited by 12
  6. 2023PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidarcited by 9
  7. 2018Long-range depth imaging using a single-photon detector array and non-local data fusioncited by 5
  8. 2023Role of Transients in Two-Bounce Non-Line-of-Sight Imagingcited by 5
  9. 2022Detection and Mapping of Specular Surfaces Using Multibounce Lidar Returnscited by 4
  10. 2021NMPC trajectory planner for urban autonomous drivingcited by 3
  11. 2022A software toolkit and hardware platform for investigating and comparing robot autonomy algorithms in simulation and realitycited by 3
  12. 2024Using a Distance Sensor to Detect Deviations in a Planar Surfacecited by 3
1 more
  1. 2023Enhanced Robot Motion Block of A-star Algorithm for Robotic Path Planningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.