3D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation
Not on the map. Why?
Abstract (arXiv)
Building accurate maps is a key building block to enable reliable localization, planning, and navigation of autonomous vehicles. We propose a novel approach for building accurate maps of dynamic environments utilizing a sequence of LiDAR scans. To this end, we propose encoding the 4D scene into a novel spatio-temporal implicit neural map representation by fitting a time-dependent truncated signed distance function to each point. Using our representation, we extract the static map by filtering the dynamic parts. Our neural representation is based on sparse feature grids, a globally shared decoder, and time-dependent basis functions, which we jointly optimize in an unsupervised fashion. To learn this representation from a sequence of LiDAR scans, we design a simple yet efficient loss function to supervise the map optimization in a piecewise way. We evaluate our approach on various scenes containing moving objects in terms of the reconstruction quality of static maps and the segmentation of dynamic point clouds. The experimental results demonstrate that our method is capable of removing the dynamic part of the input point clouds while reconstructing accurate and complete 3D maps, outperforming several state-of-the-art methods. Codes are available at: https://github.com/PRBonn/4dNDF
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 47 of its 74 references that are in the map. First posted on arXiv 6 May 2024.
Builds on
47 of 74 references.
References · 47
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
35 more
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2021Urban Radiance Fieldscited by 263
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
- 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 85
- 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2023Neural LiDAR Fields for Novel View Synthesiscited by 65
- 2021Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Datacited by 64
- 2020The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truthcited by 61
- 2022Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Cameracited by 57
- 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
- 2017Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objectscited by 47
- 2022Dynamic 3D Scene Analysis by Point Cloud Accumulationcited by 47
- 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
- 2018IMLS-SLAM: scan-to-model matching based on 3D datacited by 40
- 2021CT-ICP: Real-time Elastic LiDAR Odometry with Loop Closurecited by 38
- 2022Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutionscited by 35
- 2021ERASOR: Egocentric Ratio of Pseudo Occupancy-based Dynamic Object Removal for Static 3D Point Cloud Map Buildingcited by 29
- 2022Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentationcited by 27
- 2019Robust Dense Mapping for Large-Scale Dynamic Environmentscited by 21
- 2023Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesiscited by 20
- 2023Building Volumetric Beliefs for Dynamic Environments Exploiting Map-Based Moving Object Segmentationcited by 15
- 2023BLiRF: Bandlimited Radiance Fields for Dynamic Scene Modelingcited by 9
- 2023A Dynamic Points Removal Benchmark in Point Cloud Mapscited by 8
- 2023Efficient Implicit Neural Reconstruction Using LiDARcited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025RENO: Real-Time Neural Compression for 3D LiDAR Point Cloudscited by 12
- 2025HiMo: High-Speed Objects Motion Compensation in Point Cloudscited by 11
- 2025PINGS: Gaussian Splatting Meets Distance Fields within a Point-Based Implicit Neural Mapcited by 9
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serializationcited by 3
- 2025Temporal Overlapping Prediction: A Self-supervised Pre-training Method for LiDAR Moving Object Segmentationcited by 0
- 2026LAPS: Improving Incremental LiDAR Mapping using Active Pooling and Sampling for Neural Distance Fieldscited by 0
- 2026DynaTok: Token-Based 4D Reconstruction from Partial Point Cloudscited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026DynaTok: Token-Based 4D Reconstruction from Partial Point Clouds10 Jun 2026
- 2026LAPS: Improving Incremental LiDAR Mapping using Active Pooling and Sampling for Neural Distance Fields15 May 2026
- 2025RENO: Real-Time Neural Compression for 3D LiDAR Point Clouds16 Mar 2025
- 2025Temporal Overlapping Prediction: A Self-supervised Pre-training Method for LiDAR Moving Object Segmentation10 Mar 2025
- 2025HiMo: High-Speed Objects Motion Compensation in Point Clouds2 Mar 2025
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serialization18 Feb 2025
- 2025PINGS: Gaussian Splatting Meets Distance Fields within a Point-Based Implicit Neural Map9 Feb 2025