mlsanityData to 7 Oct 2026

3D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation

arXiv 2405.03388 ↗First posted 6 May 2024cs.CV cs.ROcited by 8

Not on the map. Why?

Abstract (arXiv)

Building accurate maps is a key building block to enable reliable localization, planning, and navigation of autonomous vehicles. We propose a novel approach for building accurate maps of dynamic environments utilizing a sequence of LiDAR scans. To this end, we propose encoding the 4D scene into a novel spatio-temporal implicit neural map representation by fitting a time-dependent truncated signed distance function to each point. Using our representation, we extract the static map by filtering the dynamic parts. Our neural representation is based on sparse feature grids, a globally shared decoder, and time-dependent basis functions, which we jointly optimize in an unsupervised fashion. To learn this representation from a sequence of LiDAR scans, we design a simple yet efficient loss function to supervise the map optimization in a piecewise way. We evaluate our approach on various scenes containing moving objects in terms of the reconstruction quality of static maps and the segmentation of dynamic point clouds. The experimental results demonstrate that our method is capable of removing the dynamic part of the input point clouds while reconstructing accurate and complete 3D maps, outperforming several state-of-the-art methods. Codes are available at: https://github.com/PRBonn/4dNDF

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 47 of its 74 references that are in the map. First posted on arXiv 6 May 2024.

Builds on

47 of 74 references.

References · 47

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  6. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  7. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  8. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  9. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  10. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
35 more
  1. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  2. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  3. 2021Urban Radiance Fieldscited by 263
  4. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  5. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  6. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  7. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
  8. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
  9. 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
  10. 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
  11. 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
  12. 2023Neural Kernel Surface Reconstructioncited by 102
  13. 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
  14. 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 85
  15. 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
  16. 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
  17. 2023Neural LiDAR Fields for Novel View Synthesiscited by 65
  18. 2021Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Datacited by 64
  19. 2020The Newer College Dataset: Handheld LiDAR, Inertial and Vision with Ground Truthcited by 61
  20. 2022Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Cameracited by 57
  21. 2022Fast-SNARF: A Fast Deformer for Articulated Neural Fieldscited by 55
  22. 2017Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objectscited by 47
  23. 2022Dynamic 3D Scene Analysis by Point Cloud Accumulationcited by 47
  24. 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
  25. 2018IMLS-SLAM: scan-to-model matching based on 3D datacited by 40
  26. 2021CT-ICP: Real-time Elastic LiDAR Odometry with Loop Closurecited by 38
  27. 2022Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutionscited by 35
  28. 2021ERASOR: Egocentric Ratio of Pseudo Occupancy-based Dynamic Object Removal for Static 3D Point Cloud Map Buildingcited by 29
  29. 2022Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentationcited by 27
  30. 2019Robust Dense Mapping for Large-Scale Dynamic Environmentscited by 21
  31. 2023Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesiscited by 20
  32. 2023Building Volumetric Beliefs for Dynamic Environments Exploiting Map-Based Moving Object Segmentationcited by 15
  33. 2023BLiRF: Bandlimited Radiance Fields for Dynamic Scene Modelingcited by 9
  34. 2023A Dynamic Points Removal Benchmark in Point Cloud Mapscited by 8
  35. 2023Efficient Implicit Neural Reconstruction Using LiDARcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.