Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering
Not on the map. Why?
Abstract (arXiv)
Imaging objects hidden outside the direct line of sight expands the effective field of view and is critical for applications such as autonomous driving and robotic perception. Despite impressive progress in time-of-flight (ToF)-based non-line-of-sight (NLOS) imaging, real-world deployment remains challenging because practical measurements are often collected over spatially limited, arbitrarily shaped relay regions-conditions that violate the planar-wall and dense-sampling assumptions made by most existing methods. To address these limitations, we propose a LOS-guided NLOS imaging pipeline that imposes no geometric assumptions on the relay surface and naturally supports both confocal and non-confocal configurations. Our method represents the hidden scene using 3D Gaussian primitives and couples them with an efficient, differentiable transient rendering model, enabling end-to-end optimization directly from measured transients. We validate our approach on real-world measurements from both a public dataset and a custom-built capture system. Across settings, our method achieves state-of-the-art reconstruction fidelity under spatially limited, sparsely sampled conditions, and significantly outperforms existing methods on complex, arbitrary relay surface geometries.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 61 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
25 of 61 references.
References · 25
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2018Virtual Wave Optics for Non-Line-of-Sight Imagingcited by 54
- 2021Non-line-of-Sight Imaging via Neural Transient Fieldscited by 41
- 2019Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radarcited by 40
- 2023Transient Neural Radiance Fields for Lidar View Synthesis and 3D Reconstructioncited by 18
- 2018Non-Line-of-Sight Reconstruction using Efficient Transient Renderingcited by 17
- 2024Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusioncited by 17
13 more
- 2024Towards 3D Vision with Low-Cost Single-Photon Camerascited by 15
- 2025RadarSplat: Radar Gaussian Splatting for High-Fidelity Data Synthesis and 3D Reconstruction of Autonomous Driving Scenescited by 15
- 2023NLOS-NeuS: Non-line-of-sight Neural Implicit Surfacecited by 13
- 2019Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Pathcited by 12
- 2022Non-line-of-sight imaging with arbitrary illumination and detection patterncited by 10
- 2024Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGBcited by 10
- 2022Differentiable Transient Renderingcited by 8
- 2022Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularizationcited by 8
- 2025SonarSplat: Novel View Synthesis of Imaging Sonar via Gaussian Splattingcited by 5
- 2023Omni-Line-of-Sight Imaging for Holistic Shape Reconstructioncited by 3
- 2023Self-Calibrating, Fully Differentiable NLOS Inverse Renderingcited by 3
- 2025Recovering Parametric Scenes from Very Few Time-of-Flight Pixelscited by 3
- 2023Domain Reduction Strategy for Non Line of Sight Imagingcited by 1
Built on by
Not cited yet.