mlsanityData to 14 Oct 2026

Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction

arXiv 2412.00242 ↗First posted 29 Nov 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Neural implicit fields have recently emerged as a powerful representation method for multi-view surface reconstruction due to their simplicity and state-of-the-art performance. However, reconstructing thin structures of indoor scenes while ensuring real-time performance remains a challenge for dense visual SLAM systems. Previous methods do not consider varying quality of input RGB-D data and employ fixed-frequency mapping process to reconstruct the scene, which could result in the loss of valuable information in some frames. In this paper, we propose Uni-SLAM, a decoupled 3D spatial representation based on hash grids for indoor reconstruction. We introduce a novel defined predictive uncertainty to reweight the loss function, along with strategic local-to-global bundle adjustment. Experiments on synthetic and real-world datasets demonstrate that our system achieves state-of-the-art tracking and mapping accuracy while maintaining real-time performance. It significantly improves over current methods with a 25% reduction in depth L1 error and a 66.86% completion rate within 1 cm on the Replica dataset, reflecting a more accurate reconstruction of thin structures. Project page: https://shaoxiang777.github.io/project/uni-slam/

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 57 of its 75 references that are in the map. First posted on arXiv 29 Nov 2024.

Builds on

57 of 75 references.

References · 57

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  7. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  8. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  9. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  10. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  11. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  12. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
38 more
  1. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  2. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  3. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  4. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  5. 2023Gaussian Splatting SLAMcited by 415
  6. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  7. 2021Neural RGB-D Surface Reconstructioncited by 313
  8. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  9. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  10. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  11. 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
  12. 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
  13. 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
  14. 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
  15. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  16. 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
  17. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 133
  18. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
  19. 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
  20. 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
  21. 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
  22. 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 82
  23. 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
  24. 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 73
  25. 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
  26. 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 63
  27. 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 60
  28. 2022Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fieldscited by 54
  29. 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
  30. 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 28
  31. 2022Gradient-based Uncertainty for Monocular Depth Estimationcited by 26
  32. 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 26
  33. 2024ValUES: A Framework for Systematic Validation of Uncertainty Estimation in Semantic Segmentationcited by 25
  34. 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
  35. 2023UncLe-SLAM: Uncertainty Learning for Dense Neural SLAMcited by 19
  36. 2023DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstructioncited by 17
  37. 2023NGEL-SLAM: Neural Implicit Representation-based Global Consistent Low-Latency SLAM Systemcited by 17
  38. 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.