Dense RGB SLAM with Neural Implicit Maps
Not on the map. Why?
Abstract (arXiv)
There is an emerging trend of using neural implicit functions for map representation in Simultaneous Localization and Mapping (SLAM). Some pioneer works have achieved encouraging results on RGB-D SLAM. In this paper, we present a dense RGB SLAM method with neural implicit map representation. To reach this challenging goal without depth input, we introduce a hierarchical feature volume to facilitate the implicit map decoder. This design effectively fuses shape cues across different scales to facilitate map reconstruction. Our method simultaneously solves the camera motion and the neural implicit map by matching the rendered and input video frames. To facilitate optimization, we further propose a photometric warping loss in the spirit of multi-view stereo to better constrain the camera pose and scene geometry. We evaluate our method on commonly used benchmarks and compare it with modern RGB and RGB-D SLAM systems. Our method achieves favorable results than previous methods and even surpasses some recent RGB-D SLAM methods.The code is at poptree.github.io/DIM-SLAM/.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 44 of its 65 references that are in the map. First posted on arXiv 21 Jan 2023.
Builds on
44 of 65 references.
References · 44
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
32 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
- 2022Deep Patch Visual Odometrycited by 186
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2020TartanVO: A Generalizable Learning-based VOcited by 107
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2019DeepSFM: Structure From Motion Via Deep Bundle Adjustmentcited by 70
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2020NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstructioncited by 61
- 2022VMRF: View Matching Neural Radiance Fieldscited by 17
- 2022A Real World Dataset for Multi-view 3D Reconstructioncited by 9
Built on by
Citing papers per year: 2023: 13; 2024: 16; 2025: 10; 2026: 3.
42 papers.
Sort:
By area:
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Deep Patch Visual SLAMcited by 68
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
30 more
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
- 2024DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstructioncited by 20
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 16
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
- 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fieldscited by 10
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videoscited by 10
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
- 2025SLAM-Former: Putting SLAM into One Transformercited by 7
- 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAMcited by 6
- 2023Dynamic Appearance Particle Neural Radiance Fieldcited by 6
- 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mappingcited by 6
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAMcited by 6
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representationcited by 4
- 2024Monocular Gaussian SLAM with Language Extended Loop Closurecited by 4
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representationscited by 3
- 2024NeB-SLAM: Neural Blocks-based Salable RGB-D SLAM for Unknown Scenescited by 2
- 2024LCP-Fusion: A Neural Implicit SLAM with Enhanced Local Constraints and Computable Priorcited by 1
- 2023CN-DHF: Compact Neural Double Height-Field Representations of 3D Shapescited by 0
- 2023Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAMcited by 0
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAMcited by 0
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Renderingcited by 0
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation Systemcited by 0
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimizationcited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Rendering21 Nov 2025
- 2025SLAM-Former: Putting SLAM into One Transformer21 Sep 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videos29 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations13 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping31 Jan 2025
30 more
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
- 2024LCP-Fusion: A Neural Implicit SLAM with Enhanced Local Constraints and Computable Prior6 Nov 2024
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding17 Oct 2024
- 2024DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstruction3 Sep 2024
- 2024Deep Patch Visual SLAM3 Aug 2024
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians26 May 2024
- 2024NeB-SLAM: Neural Blocks-based Salable RGB-D SLAM for Unknown Scenes24 May 2024
- 2024Monocular Gaussian SLAM with Language Extended Loop Closure22 May 2024
- 2024Neural Radiance Field in Autonomous Driving: A Survey22 Apr 2024
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAM28 Mar 2024
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM28 Mar 2024
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting22 Mar 2024
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps19 Mar 2024
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey20 Feb 2024
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closures14 Feb 2024
- 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mapping6 Jan 2024
- 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fields20 Dec 2023
- 2023Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM20 Dec 2023
- 2023Gaussian Splatting SLAM11 Dec 2023
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting6 Dec 2023
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM4 Dec 2023
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representation28 Nov 2023
- 2023Dynamic Appearance Particle Neural Radiance Field11 Oct 2023
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields7 Oct 2023
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction5 Sep 2023
- 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAM1 Jun 2023
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAM9 Apr 2023
- 2023CN-DHF: Compact Neural Double Height-Field Representations of 3D Shapes29 Mar 2023
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM7 Feb 2023
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Deep Patch Visual SLAMcited by 68
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
12 most cited of 41 All 41 (JSON)
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Rendering21 Nov 2025
- 2025SLAM-Former: Putting SLAM into One Transformer21 Sep 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videos29 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations13 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping31 Jan 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
12 newest of 41 All 41 (JSON)