NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields
Not on the map. Why?
Abstract (arXiv)
We propose a novel geometric and photometric 3D mapping pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by providing accurate pose estimates and depth-maps with associated uncertainty. With our proposed uncertainty-based depth loss, we achieve not only good photometric accuracy, but also great geometric accuracy. In fact, our proposed pipeline achieves better geometric and photometric accuracy than competing approaches (up to 179% better PSNR and 86% better L1 depth), while working in real-time and using only monocular images.
Key facts. Cited by 188 papers in the map (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 24 Oct 2022.
Builds on
31 of 43 references.
References · 31
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
19 more
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fieldscited by 86
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2022Mip-NeRF RGB-D: Depth Assisted Fast Neural Radiance Fieldscited by 11
Built on by
Citing papers per year: 2022: 6; 2023: 48; 2024: 83; 2025: 38; 2026: 13.
188 papers.
Sort:
By area:
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2023Robust Dynamic Radiance Fieldscited by 193
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
38 more
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
- 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 81
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Deep Patch Visual SLAMcited by 68
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2024Textured Gaussians for Enhanced 3D Scene Appearance Modelingcited by 40
- 2024GenNBV: Generalizable Next-Best-View Policy for Active 3D Reconstructioncited by 39
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 38
- 2024Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splattingcited by 37
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
- 2023CP-SLAM: Collaborative Neural Point-based SLAM Systemcited by 32
- 2024The NeRFect Match: Exploring NeRF Features for Visual Localizationcited by 32
- 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulationcited by 32
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2023NeRF-Loc: Visual Localization with Conditional Neural Radiance Fieldcited by 29
- 2023Neural feels with neural fields: Visuo-tactile perception for in-hand manipulationcited by 28
- 2023Neural Implicit Dense Semantic SLAMcited by 26
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2023UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale Scenecited by 25
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 24
- 2023VL-Fields: Towards Language-Grounded Neural Implicit Spatial Representationscited by 23
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAMcited by 22
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmapscited by 21
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
50 most cited of 188 All 188 (JSON)
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026NeRF-based Spacecraft Reconstruction from Monocular Imagery Under Illumination Variability and Pose Uncertainty18 May 2026
- 2026Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping17 May 2026
- 2026First Shape, Then Meaning: Efficient Geometry and Semantics Learning for Indoor Reconstruction5 May 2026
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
- 2026RadarSplat-RIO: Indoor Radar-Inertial Odometry with Gaussian Splatting-Based Radar Bundle Adjustment15 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026Event-Aided Sharp Radiance Field Reconstruction for Fast-Flying Drones24 Feb 2026
- 2026DefenseSplat: Enhancing the Robustness of 3D Gaussian Splatting via Frequency-Aware Filtering22 Feb 2026
- 2026NeVStereo: A NeRF-Driven NVS-Stereo Architecture for High-Fidelity 3D Tasks5 Feb 2026
- 2026Under-Canopy Terrain Reconstruction in Dense Forests Using RGB Imaging and Neural 3D Reconstruction30 Jan 2026
38 more
- 2026LangGS-SLAM: Real-Time Language-Feature Gaussian Splatting SLAM28 Jan 2026
- 2025Improved 3D Gaussian Splatting of Unknown Spacecraft Structure Using Space Environment Illumination Knowledge30 Dec 2025
- 2025Dynamic Visual SLAM using a General 3D Prior7 Dec 2025
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025Taming the Light: Illumination-Invariant Semantic 3DGS-SLAM28 Nov 2025
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Rendering21 Nov 2025
- 2025iGaussian: Real-Time Camera Pose Estimation via Feed-Forward 3D Gaussian Splatting Inversion18 Nov 2025
- 2025AgriGS-SLAM: Orchard Mapping Across Seasons via Multi-View Gaussian Splatting SLAM30 Oct 2025
- 2025RoGER-SLAM: A Robust Gaussian Splatting SLAM System for Noisy and Low-light Environment Resilience26 Oct 2025
- 2025OpenFLAME: Federated Visual Positioning System to Enable Large-Scale Augmented Reality Applications4 Oct 2025
- 2025Task-Oriented Communications for 3D Scene Representation: Balancing Timeliness and Fidelity21 Sep 2025
- 2025SLAM-Former: Putting SLAM into One Transformer21 Sep 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025MemGS: Memory-Efficient Gaussian Splatting for Real-Time SLAM16 Sep 2025
- 2025Online 3D Gaussian Splatting Modeling with Novel View Selection19 Aug 2025
- 2025Omni-Scan: Creating Visually-Accurate Digital Twin Object Models Using a Bimanual Robot with Handover and Gaussian Splat Merging1 Aug 2025
- 2025LongSplat: Online Generalizable 3D Gaussian Splatting from Long Sequence Images22 Jul 2025
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps4 Jul 2025
- 2025Low-Rank Augmented Implicit Neural Representation for Unsupervised High-Dimensional Quantitative MRI Reconstruction10 Jun 2025
- 2025Intern-GS: Vision Model Guided Sparse-View 3D Gaussian Splatting27 May 2025
- 2025GS2E: Gaussian Splatting is an Effective Data Generator for Event Stream Generation21 May 2025
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfels3 May 2025
- 2025SonarSplat: Novel View Synthesis of Imaging Sonar via Gaussian Splatting31 Mar 2025
- 2025STAMICS: Splat, Track And Map with Integrated Consistency and Semantics for Dense RGB-D SLAM27 Mar 2025
- 2025UGNA-VPR: A Novel Training Paradigm for Visual Place Recognition Based on Uncertainty-Guided NeRF Augmentation27 Mar 2025
- 20254D Gaussian Splatting SLAM20 Mar 2025
- 2025BARD-GS: Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splatting20 Mar 2025
- 2025Challenges and Trends in Egocentric Vision: A Survey19 Mar 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
- 2025DynaGSLAM: Real-Time Gaussian-Splatting SLAM for Online Rendering, Tracking, Motion Predictions of Moving Objects in Dynamic Scenes15 Mar 2025
- 2025Online Language Splatting12 Mar 2025
- 2025MVGSR: Multi-View Consistency Gaussian Splatting for Robust Surface Reconstruction11 Mar 2025
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splats11 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks28 Feb 2025
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 2025VINGS-Mono: Visual-Inertial Gaussian Splatting Monocular SLAM in Large Scenes14 Jan 2025
50 newest of 188 All 188 (JSON)
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
- 2024Position Paper: Agent AI Towards a Holistic Intelligencecited by 2
- 2024Position Paper: Agent AI Towards a Holistic Intelligence28 Feb 2024
- 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan 2024
- 2023MoEC: Mixture of Experts Implicit Neural Compressioncited by 4
- 2023MoEC: Mixture of Experts Implicit Neural Compression3 Dec 2023
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2023Robust Dynamic Radiance Fieldscited by 193
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
12 most cited of 182 All 182 (JSON)
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026NeRF-based Spacecraft Reconstruction from Monocular Imagery Under Illumination Variability and Pose Uncertainty18 May 2026
- 2026Mono-Hydra++: Real-Time Monocular Scene Graph Construction with Multi-Task Learning for 3D Indoor Mapping17 May 2026
- 2026First Shape, Then Meaning: Efficient Geometry and Semantics Learning for Indoor Reconstruction5 May 2026
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
- 2026RadarSplat-RIO: Indoor Radar-Inertial Odometry with Gaussian Splatting-Based Radar Bundle Adjustment15 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026Event-Aided Sharp Radiance Field Reconstruction for Fast-Flying Drones24 Feb 2026
- 2026DefenseSplat: Enhancing the Robustness of 3D Gaussian Splatting via Frequency-Aware Filtering22 Feb 2026
- 2026NeVStereo: A NeRF-Driven NVS-Stereo Architecture for High-Fidelity 3D Tasks5 Feb 2026
- 2026Under-Canopy Terrain Reconstruction in Dense Forests Using RGB Imaging and Neural 3D Reconstruction30 Jan 2026
12 newest of 182 All 182 (JSON)