Fast Back-Projection for Non-Line of Sight Reconstruction
Not on the map. Why?
Abstract (arXiv)
Recent works have demonstrated non-line of sight (NLOS) reconstruction by using the time-resolved signal frommultiply scattered light. These works combine ultrafast imaging systems with computation, which back-projects the recorded space-time signal to build a probabilistic map of the hidden geometry. Unfortunately, this computation is slow, becoming a bottleneck as the imaging technology improves. In this work, we propose a new back-projection technique for NLOS reconstruction, which is up to a thousand times faster than previous work, with almost no quality loss. We base on the observation that the hidden geometry probability map can be built as the intersection of the three-bounce space-time manifolds defined by the light illuminating the hidden geometry and the visible point receiving the scattered light from such hidden geometry. This allows us to pose the reconstruction of the hidden geometry as the voxelization of these space-time manifolds, which has lower theoretic complexity and is easily implementable in the GPU. We demonstrate the efficiency and quality of our technique compared against previous methods in both captured and synthetic data
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 7; 2024: 2; 2025: 3; 2026: 3.
24 papers.
Sort:
- 2021Non-line-of-Sight Imaging via Neural Transient Fieldscited by 41
- 2023Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonarcited by 16
- 2022Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imagingcited by 15
- 2023NLOS-NeuS: Non-line-of-sight Neural Implicit Surfacecited by 13
- 2021Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenescited by 10
- 2022Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularizationcited by 8
- 2021Virtual Light Transport Matrices for Non-Line-Of-Sight Imagingcited by 6
- 2023Role of Transients in Two-Bounce Non-Line-of-Sight Imagingcited by 5
- 2023Self-Calibrating, Fully Differentiable NLOS Inverse Renderingcited by 3
- 2024Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imagingcited by 3
- 2022Occlusion Fields: An Implicit Representation for Non-Line-of-Sight Surface Reconstructioncited by 2
- 2022Non-Line-of-Sight Tracking and Mapping with an Active Corner Cameracited by 2
12 more
- 2023Curvature regularization for Non-line-of-sight Imaging from Under-sampled Datacited by 2
- 2024Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priorscited by 2
- 2021Towards Non-Line-of-Sight Photographycited by 1
- 2023Domain Reduction Strategy for Non Line of Sight Imagingcited by 1
- 2025MARMOT: Masked Autoencoder for Modeling Transient Imagingcited by 1
- 2021Fast Non-line-of-sight Imaging with Two-step Deep Remappingcited by 0
- 2023Non-line-of-sight imaging in the presence of scattering media using phasor fieldscited by 0
- 2025TransiT: Transient Transformer for Non-line-of-sight Videographycited by 0
- 2025Geometric Constrained Non-Line-of-Sight Imagingcited by 0
- 2026A Renderer-Enabled Framework for Computing Parameter Estimation Lower Bounds in Plenoptic Imaging Systemscited by 0
- 2026Memory-efficient GPU pipelines for real-time non-line-of-sight reconstructioncited by 0
- 2026Cascaded Non-Line-of-Sight Imagingcited by 0
- 2026Cascaded Non-Line-of-Sight Imaging3 Sep 2026
- 2026Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction28 Aug 2026
- 2026A Renderer-Enabled Framework for Computing Parameter Estimation Lower Bounds in Plenoptic Imaging Systems30 Jan 2026
- 2025MARMOT: Masked Autoencoder for Modeling Transient Imaging10 Jun 2025
- 2025Geometric Constrained Non-Line-of-Sight Imaging23 Mar 2025
- 2025TransiT: Transient Transformer for Non-line-of-sight Videography14 Mar 2025
- 2024Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors21 Sep 2024
- 2024Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging26 Jul 2024
- 2023Self-Calibrating, Fully Differentiable NLOS Inverse Rendering21 Sep 2023
- 2023Non-line-of-sight imaging in the presence of scattering media using phasor fields25 Aug 2023
- 2023Domain Reduction Strategy for Non Line of Sight Imaging20 Aug 2023
- 2023Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonar16 Jun 2023
12 more
- 2023Role of Transients in Two-Bounce Non-Line-of-Sight Imaging3 Apr 2023
- 2023NLOS-NeuS: Non-line-of-sight Neural Implicit Surface22 Mar 2023
- 2023Curvature regularization for Non-line-of-sight Imaging from Under-sampled Data1 Jan 2023
- 2022Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularization21 Nov 2022
- 2022Non-Line-of-Sight Tracking and Mapping with an Active Corner Camera2 Aug 2022
- 2022Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imaging3 May 2022
- 2022Occlusion Fields: An Implicit Representation for Non-Line-of-Sight Surface Reconstruction16 Mar 2022
- 2021Towards Non-Line-of-Sight Photography16 Sep 2021
- 2021Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes28 Apr 2021
- 2021Virtual Light Transport Matrices for Non-Line-Of-Sight Imaging23 Mar 2021
- 2021Fast Non-line-of-sight Imaging with Two-step Deep Remapping26 Jan 2021
- 2021Non-line-of-Sight Imaging via Neural Transient Fields2 Jan 2021
- 2021Non-line-of-Sight Imaging via Neural Transient Fieldscited by 41
- 2023Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonarcited by 16
- 2022Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imagingcited by 15
- 2023NLOS-NeuS: Non-line-of-sight Neural Implicit Surfacecited by 13
- 2021Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenescited by 10
- 2022Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularizationcited by 8
- 2021Virtual Light Transport Matrices for Non-Line-Of-Sight Imagingcited by 6
- 2023Role of Transients in Two-Bounce Non-Line-of-Sight Imagingcited by 5
- 2023Self-Calibrating, Fully Differentiable NLOS Inverse Renderingcited by 3
- 2024Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imagingcited by 3
- 2022Occlusion Fields: An Implicit Representation for Non-Line-of-Sight Surface Reconstructioncited by 2
- 2022Non-Line-of-Sight Tracking and Mapping with an Active Corner Cameracited by 2
12 most cited of 24 All 24 (JSON)
- 2026Cascaded Non-Line-of-Sight Imaging3 Sep 2026
- 2026Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction28 Aug 2026
- 2026A Renderer-Enabled Framework for Computing Parameter Estimation Lower Bounds in Plenoptic Imaging Systems30 Jan 2026
- 2025MARMOT: Masked Autoencoder for Modeling Transient Imaging10 Jun 2025
- 2025Geometric Constrained Non-Line-of-Sight Imaging23 Mar 2025
- 2025TransiT: Transient Transformer for Non-line-of-sight Videography14 Mar 2025
- 2024Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors21 Sep 2024
- 2024Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging26 Jul 2024
- 2023Self-Calibrating, Fully Differentiable NLOS Inverse Rendering21 Sep 2023
- 2023Non-line-of-sight imaging in the presence of scattering media using phasor fields25 Aug 2023
- 2023Domain Reduction Strategy for Non Line of Sight Imaging20 Aug 2023
- 2023Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonar16 Jun 2023
12 newest of 24 All 24 (JSON)