Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDAR
Not on the map. Why?
Abstract (arXiv)
Robust autonomous navigation in environments with limited visibility remains a critical challenge in robotics. We present a novel approach that leverages Non-Line-of-Sight (NLOS) sensing using single-photon LiDAR to improve visibility and enhance autonomous navigation. Our method enables mobile robots to "see around corners" by utilizing multi-bounce light information, effectively expanding their perceptual range without additional infrastructure. We propose a three-module pipeline: (1) Sensing, which captures multi-bounce histograms using SPAD-based LiDAR; (2) Perception, which estimates occupancy maps of hidden regions from these histograms using a convolutional neural network; and (3) Control, which allows a robot to follow safe paths based on the estimated occupancy. We evaluate our approach through simulations and real-world experiments on a mobile robot navigating an L-shaped corridor with hidden obstacles. Our work represents the first experimental demonstration of NLOS imaging for autonomous navigation, paving the way for safer and more efficient robotic systems operating in complex environments. We also contribute a novel dynamics-integrated transient rendering framework for simulating NLOS scenarios, facilitating future research in this domain.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 13 of its 51 references that are in the map. First posted on arXiv 4 Oct 2024.
Builds on
13 of 51 references.
References · 13
- 2018Virtual Wave Optics for Non-Line-of-Sight Imagingcited by 54
- 2020Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimationcited by 34
- 2020Multi-Layered Safety for Legged Robots via Control Barrier Functions and Model Predictive Controlcited by 25
- 2024Towards 3D Vision with Low-Cost Single-Photon Camerascited by 15
- 2019Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Pathcited by 12
- 2023PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidarcited by 9
- 2018Long-range depth imaging using a single-photon detector array and non-local data fusioncited by 5
- 2023Role of Transients in Two-Bounce Non-Line-of-Sight Imagingcited by 5
- 2022Detection and Mapping of Specular Surfaces Using Multibounce Lidar Returnscited by 4
- 2021NMPC trajectory planner for urban autonomous drivingcited by 3
- 2022A software toolkit and hardware platform for investigating and comparing robot autonomy algorithms in simulation and realitycited by 3
- 2024Using a Distance Sensor to Detect Deviations in a Planar Surfacecited by 3
1 more
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025Recovering Parametric Scenes from Very Few Time-of-Flight Pixelscited by 3
- 2025TransiT: Transient Transformer for Non-line-of-sight Videographycited by 0
- 2025Toward Robust Single-Photon Perception for Robots: A Condition-Aware Active Learning Approachcited by 0
- 2025Task-Driven Implicit Representations for Automated Design of LiDAR Systemscited by 0
- 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perceptioncited by 0
- 2026Spatial Calibration of Diffuse LiDARscited by 0
- 2026DENALI: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARscited by 0
- 2026SP-TransientBench: A Real-Captured Single Photon Perception Benchmarkcited by 0
- 2026SP-TransientBench: A Real-Captured Single Photon Perception Benchmark16 Jun 2026
- 2026DENALI: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARs17 Apr 2026
- 2026Spatial Calibration of Diffuse LiDARs6 Mar 2026
- 2025SuperEx: Enhancing Indoor Mapping and Exploration using Non-Line-of-Sight Perception12 Oct 2025
- 2025Recovering Parametric Scenes from Very Few Time-of-Flight Pixels19 Sep 2025
- 2025Task-Driven Implicit Representations for Automated Design of LiDAR Systems28 May 2025
- 2025Toward Robust Single-Photon Perception for Robots: A Condition-Aware Active Learning Approach7 May 2025
- 2025TransiT: Transient Transformer for Non-line-of-sight Videography14 Mar 2025