Efficient Implicit Neural Reconstruction Using LiDAR
Not on the map. Why?
Abstract (arXiv)
Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have difficulty handling poor light conditions and large-scale scenes. Methods taking global point cloud as input require accurate registration and ground truth coordinate labels, which limits their application scenarios. In this paper, we propose a new method that uses sparse LiDAR point clouds and rough odometry to reconstruct fine-grained implicit occupancy field efficiently within a few minutes. We introduce a new loss function that supervises directly in 3D space without 2D rendering, avoiding information loss. We also manage to refine poses of input frames in an end-to-end manner, creating consistent geometry without global point cloud registration. As far as we know, our method is the first to reconstruct implicit scene representation from LiDAR-only input. Experiments on synthetic and real-world datasets, including indoor and outdoor scenes, prove that our method is effective, efficient, and accurate, obtaining comparable results with existing methods using dense input.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 37 of its 47 references that are in the map. First posted on arXiv 28 Feb 2023.
Builds on
37 of 47 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
25 more
- 2020Convolutional Occupancy Networkscited by 760
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2021Urban Radiance Fieldscited by 263
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2016Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planningcited by 148
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
- 2018Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Networkcited by 109
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2019Controlling Neural Level Setscited by 76
- 2020FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filtercited by 70
- 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 20243D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representationcited by 8
- 2024Transientangelo: Few-Viewpoint Surface Reconstruction Using Single-Photon Lidarcited by 6
- 2023Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraintscited by 1
- 2023LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenescited by 0
- 2024Transientangelo: Few-Viewpoint Surface Reconstruction Using Single-Photon Lidar22 Aug 2024
- 20243D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation6 May 2024
- 2023LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes4 Nov 2023
- 2023Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints18 Sep 2023