Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction
Not on the map. Why?
Abstract (arXiv)
Non-line-of-sight (NLOS) imaging reconstructs scenes hidden around a corner from indirect light recorded by a single-photon avalanche diode (SPAD). A single reconstruction is a large inverse problem: billions of photon timestamps must be binned, moved through memory, transformed and inverted. As SPAD arrays raise acquisition throughput, reconstruction becomes the limiting stage. We rebuild the GPU execution of two established wave-based algorithms, f-k migration and phasor-fields, for both streaming and offline processing. On the phasor-fields side we assemble the ring-and-radius kernels of previous work once and offline, using the analytic Fourier transform of a ring, so the propagation kernel never exists in dense form at runtime, reducing the memory and bandwidth. We reorganize the pipeline of both algorithms with fused kernels, warp-level photon binning, batched transforms, CUDA graph replay, and FP16 storage applied only where it reduces the actual bottleneck. Our implementations are up to 42x faster than the reference streaming pipeline and up to 14x faster than the fastest published GPU baseline, all while using a fraction of the memory (down to 2.5%), enabling vastly larger and finer reconstructions on the same hardware, or comparable ones within a much lower memory budget. We report an ablation of each implementation choice and propose three denoising strategies enabled by the resulting frame budget for next-generation NLOS video processing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 33 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
9 of 33 references.
References · 9
- 2018Virtual Wave Optics for Non-Line-of-Sight Imagingcited by 54
- 2020Non-line-of-sight Imagingcited by 41
- 2017Fast Back-Projection for Non-Line of Sight Reconstructioncited by 24
- 2020Real-time Non-line-of-Sight imaging of dynamic scenescited by 20
- 2022Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imagingcited by 15
- 2023CPU-GPU Heterogeneous Code Acceleration of a Finite Volume Computational Fluid Dynamics Solvercited by 2
- 2026A comprehensive study of time-of-flight non-line-of-sight imagingcited by 1
- 20263DPipe: A Pipelined GPU Framework for Scalable Generalized Spatial Join over Polyhedral Objectscited by 1
- 2026SET: Stream-Event-Triggered Scheduling for Efficient CUDA Graph Pipelinescited by 1
Built on by
Not cited yet.