mlsanityData to 7 Oct 2026

Dense RGB SLAM with Neural Implicit Maps

arXiv 2301.08930 ↗First posted 21 Jan 2023cs.CV cs.LG cs.ROcited by 42

Not on the map. Why?

Abstract (arXiv)

There is an emerging trend of using neural implicit functions for map representation in Simultaneous Localization and Mapping (SLAM). Some pioneer works have achieved encouraging results on RGB-D SLAM. In this paper, we present a dense RGB SLAM method with neural implicit map representation. To reach this challenging goal without depth input, we introduce a hierarchical feature volume to facilitate the implicit map decoder. This design effectively fuses shape cues across different scales to facilitate map reconstruction. Our method simultaneously solves the camera motion and the neural implicit map by matching the rendered and input video frames. To facilitate optimization, we further propose a photometric warping loss in the spirit of multi-view stereo to better constrain the camera pose and scene geometry. We evaluate our method on commonly used benchmarks and compare it with modern RGB and RGB-D SLAM systems. Our method achieves favorable results than previous methods and even surpasses some recent RGB-D SLAM methods.The code is at poptree.github.io/DIM-SLAM/.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 44 of its 65 references that are in the map. First posted on arXiv 21 Jan 2023.

Builds on

44 of 65 references.

References · 44

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  8. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  9. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  12. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
32 more
  1. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  2. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  3. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  4. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  5. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  6. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  7. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  8. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  9. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  10. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  11. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  12. 2016Direct Sparse Odometrycited by 479
  13. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  14. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  15. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
  16. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  17. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  18. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  19. 2021Self-Calibrating Neural Radiance Fieldscited by 204
  20. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
  21. 2022Deep Patch Visual Odometrycited by 186
  22. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  23. 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
  24. 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
  25. 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
  26. 2020TartanVO: A Generalizable Learning-based VOcited by 107
  27. 2018DeepTAM: Deep Tracking and Mappingcited by 87
  28. 2019DeepSFM: Structure From Motion Via Deep Bundle Adjustmentcited by 70
  29. 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
  30. 2020NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstructioncited by 61
  31. 2022VMRF: View Matching Neural Radiance Fieldscited by 17
  32. 2022A Real World Dataset for Multi-view 3D Reconstructioncited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 16; 2025: 10; 2026: 3.

42 papers.

Sort:

By area:

  1. 2023Gaussian Splatting SLAMcited by 410
  2. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  3. 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
  4. 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
  5. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  6. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
  7. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
  8. 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
  9. 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
  10. 2024Deep Patch Visual SLAMcited by 68
  11. 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
  12. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
30 more
  1. 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
  2. 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
  3. 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
  4. 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
  5. 2024DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstructioncited by 20
  6. 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
  7. 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 16
  8. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
  9. 2025Neural Radiance Fields for the Real World: A Surveycited by 12
  10. 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
  11. 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fieldscited by 10
  12. 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videoscited by 10
  13. 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
  14. 2025SLAM-Former: Putting SLAM into One Transformercited by 7
  15. 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAMcited by 6
  16. 2023Dynamic Appearance Particle Neural Radiance Fieldcited by 6
  17. 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mappingcited by 6
  18. 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAMcited by 6
  19. 2023Continuous Pose for Monocular Cameras in Neural Implicit Representationcited by 4
  20. 2024Monocular Gaussian SLAM with Language Extended Loop Closurecited by 4
  21. 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representationscited by 3
  22. 2024NeB-SLAM: Neural Blocks-based Salable RGB-D SLAM for Unknown Scenescited by 2
  23. 2024LCP-Fusion: A Neural Implicit SLAM with Enhanced Local Constraints and Computable Priorcited by 1
  24. 2023CN-DHF: Compact Neural Double Height-Field Representations of 3D Shapescited by 0
  25. 2023Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAMcited by 0
  26. 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAMcited by 0
  27. 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Renderingcited by 0
  28. 2026EndoSERV: A Vision-based Endoluminal Robot Navigation Systemcited by 0
  29. 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimizationcited by 0
  30. 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0