NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM
Not on the map. Why?
Abstract (arXiv)
Neural implicit representations have recently become popular in simultaneous localization and mapping (SLAM), especially in dense visual SLAM. However, previous works in this direction either rely on RGB-D sensors, or require a separate monocular SLAM approach for camera tracking and do not produce high-fidelity dense 3D scene reconstruction. In this paper, we present NICER-SLAM, a dense RGB SLAM system that simultaneously optimizes for camera poses and a hierarchical neural implicit map representation, which also allows for high-quality novel view synthesis. To facilitate the optimization process for mapping, we integrate additional supervision signals including easy-to-obtain monocular geometric cues and optical flow, and also introduce a simple warping loss to further enforce geometry consistency. Moreover, to further boost performance in complicated indoor scenes, we also propose a local adaptive transformation from signed distance functions (SDFs) to density in the volume rendering equation. On both synthetic and real-world datasets we demonstrate strong performance in dense mapping, tracking, and novel view synthesis, even competitive with recent RGB-D SLAM systems.
Key facts. Cited by 162 papers in the map (data through 7 Oct 2026). Builds on 57 of its 79 references that are in the map. First posted on arXiv 7 Feb 2023.
Builds on
57 of 79 references.
References · 57
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
38 more
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2020Convolutional Occupancy Networkscited by 760
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2021Shape As Points: A Differentiable Poisson Solvercited by 186
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2022GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimationcited by 86
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
- 2020NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstructioncited by 61
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2023: 31; 2024: 54; 2025: 53; 2026: 24.
162 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
38 more
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 48
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 47
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2024EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splattingcited by 33
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2023Neural Implicit Dense Semantic SLAMcited by 26
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 24
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAMcited by 22
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmapscited by 21
- 2024DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstructioncited by 20
- 2023UncLe-SLAM: Uncertainty Learning for Dense Neural SLAMcited by 19
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understandingcited by 19
- 2025AE-NeRF: Augmenting Event-Based Neural Radiance Fields for Non-ideal Conditions and Larger Scenecited by 19
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstructioncited by 18
- 2024P2P-Bridge: Diffusion Bridges for 3D Point Cloud Denoisingcited by 18
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 17
- 2023DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fieldscited by 16
- 2024NeRFs in Robotics: A Surveycited by 16
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 16
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splattingcited by 15
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Priorcited by 14
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splatscited by 14
- 2024HPC: Hierarchical Progressive Coding Framework for Volumetric Videocited by 13
- 2025StreamGS: Online Generalizable Gaussian Splatting Reconstruction for Unposed Image Streamscited by 13
50 most cited of 162 All 162 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos29 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026Why does Deep Learning Improve Visual SLAM?7 Jul 2026
- 2026PixVOD: Pixel-Distributed Direct Visual Odometry and Depth Estimation2 Jun 2026
- 2026Depth2Pose: A Pose-Based Benchmark for Monocular Depth Estimation without Ground-Truth Depth19 May 2026
- 2026Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping17 May 2026
- 2026WildPose: A Unified Framework for Robust Pose Estimation in the Wild12 May 2026
38 more
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
- 2026VGGT-SLAM++8 Apr 2026
- 2026GS3LAM: Gaussian Semantic Splatting SLAM29 Mar 2026
- 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigation22 Mar 2026
- 2026DROID-SLAM in the Wild19 Mar 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2026OnlineX: Unified Online 3D Reconstruction and Understanding with Active-to-Stable State Evolution2 Mar 2026
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images27 Feb 2026
- 2026FLIGHT: Fibonacci Lattice-based Inference for Geometric Heading in real-Time26 Feb 2026
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry13 Feb 2026
- 2026S-MUSt3R: Sliding Multi-view 3D Reconstruction4 Feb 2026
- 2026EUGens: Efficient, Unified, and General Dense Layers30 Jan 2026
- 2025G3Splat: Geometrically Consistent Generalizable Gaussian Splatting19 Dec 2025
- 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training5 Dec 2025
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025EGG-Fusion: Efficient 3D Reconstruction with Geometry-aware Gaussian Surfel on the Fly1 Dec 2025
- 2025Robust 3DGS-based SLAM via Adaptive Kernel Smoothing28 Nov 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025Depth Anything 3: Recovering the Visual Space from Any Views13 Nov 2025
- 2025AtlasGS: Atlanta-world Guided Surface Reconstruction with Implicit Structured Gaussians29 Oct 2025
- 2025SPORTS: Simultaneous Panoptic Odometry, Rendering, Tracking and Segmentation for Urban Scenes Understanding14 Oct 2025
- 2025GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State28 Sep 2025
- 2025SLAM-Former: Putting SLAM into One Transformer21 Sep 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping17 Sep 2025
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association1 Sep 2025
- 2025Embodied Spatial Intelligence: from Implicit Scene Modeling to Spatial Reasoning30 Aug 2025
- 2025Online 3D Gaussian Splatting Modeling with Novel View Selection19 Aug 2025
- 2025IntelliCap: Intelligent Guidance for Consistent View Sampling18 Aug 2025
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformer14 Aug 2025
- 2025Pseudo Depth Meets Gaussian: A Feed-forward RGB SLAM Baseline6 Aug 2025
- 2025Enhanced Velocity Field Modeling for Gaussian Video Reconstruction31 Jul 2025
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videos29 Jul 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025LONG3R: Long Sequence Streaming 3D Reconstruction24 Jul 2025
- 2025LongSplat: Online Generalizable 3D Gaussian Splatting from Long Sequence Images22 Jul 2025
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps4 Jul 2025
- 2025TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraints29 Jun 2025
50 newest of 162 All 162 (JSON)
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusioncited by 2
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusion23 Dec 2023
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
12 most cited of 159 All 159 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos29 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026Why does Deep Learning Improve Visual SLAM?7 Jul 2026
- 2026PixVOD: Pixel-Distributed Direct Visual Odometry and Depth Estimation2 Jun 2026
- 2026Depth2Pose: A Pose-Based Benchmark for Monocular Depth Estimation without Ground-Truth Depth19 May 2026
- 2026Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping17 May 2026
- 2026WildPose: A Unified Framework for Robust Pose Estimation in the Wild12 May 2026
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
12 newest of 159 All 159 (JSON)