HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields
Not on the map. Why?
Abstract (arXiv)
In this letter, we present a neural field-based real-time monocular mapping framework for accurate and dense Simultaneous Localization and Mapping (SLAM). Recent neural mapping frameworks show promising results, but rely on RGB-D or pose inputs, or cannot run in real-time. To address these limitations, our approach integrates dense-SLAM with neural implicit fields. Specifically, our dense SLAM approach runs parallel tracking and global optimization, while a neural field-based map is constructed incrementally based on the latest SLAM estimates. For the efficient construction of neural fields, we employ multi-resolution grid encoding and signed distance function (SDF) representation. This allows us to keep the map always up-to-date and adapt instantly to global updates via loop closing. For global consistency, we propose an efficient Sim(3)-based pose graph bundle adjustment (PGBA) approach to run online loop closing and mitigate the pose and scale drift. To enhance depth accuracy further, we incorporate learned monocular depth priors. We propose a novel joint depth and scale adjustment (JDSA) module to solve the scale ambiguity inherent in depth priors. Extensive evaluations across synthetic and real-world datasets validate that our approach outperforms existing methods in accuracy and map completeness while preserving real-time performance.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 7 Oct 2023.
Builds on
28 of 38 references.
References · 28
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021Neural RGB-D Surface Reconstructioncited by 313
16 more
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 133
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
- 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2023BAMF-SLAM: Bundle Adjusted Multi-Fisheye Visual-Inertial SLAM Using Recurrent Field Transformscited by 11
- 2023Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Gridscited by 8
Built on by
Citing papers per year: 2023: 4; 2024: 12; 2025: 10; 2026: 5.
31 papers.
Sort:
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 66
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 50
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 25
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstructioncited by 18
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 18
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 16
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splattingcited by 15
19 more
- 2025SEGS-SLAM: Structure-enhanced 3D Gaussian Splatting SLAM with Appearance Embeddingcited by 11
- 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fieldscited by 10
- 2024MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularizationcited by 10
- 2024MotionGS : Compact Gaussian Splatting SLAM by Motion Filtercited by 7
- 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mappingcited by 6
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAMcited by 6
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstructioncited by 3
- 20253D Gaussian Splatting aided Localization for Large and Complex Indoor-Environmentscited by 2
- 2025Deblur Gaussian Splatting SLAMcited by 2
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mappingcited by 2
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddingscited by 1
- 2026PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAMcited by 1
- 2023VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesiscited by 0
- 2023Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAMcited by 0
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAMcited by 0
- 2025DPVO-QAT++: Heterogeneous QAT and CUDA Kernel Fusion for High-Performance Deep Patch Visual Odometrycited by 0
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustmentcited by 0
- 2026GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Trackingcited by 0
- 2026GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking26 Sep 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstruction29 Jan 2026
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddings14 Jan 2026
- 2026PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM10 Jan 2026
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025DPVO-QAT++: Heterogeneous QAT and CUDA Kernel Fusion for High-Performance Deep Patch Visual Odometry16 Nov 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping17 Sep 2025
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association1 Sep 2025
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environments4 Apr 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
19 more
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 20253D Gaussian Splatting aided Localization for Large and Complex Indoor-Environments19 Feb 2025
- 2025SEGS-SLAM: Structure-enhanced 3D Gaussian Splatting SLAM with Appearance Embedding9 Jan 2025
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction27 Nov 2024
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splatting26 Nov 2024
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesis30 May 2024
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians26 May 2024
- 2024MotionGS : Compact Gaussian Splatting SLAM by Motion Filter18 May 2024
- 2024MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization10 May 2024
- 2024Neural Radiance Field in Autonomous Driving: A Survey22 Apr 2024
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAM28 Mar 2024
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM28 Mar 2024
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey20 Feb 2024
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstruction6 Feb 2024
- 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mapping6 Jan 2024
- 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fields20 Dec 2023
- 2023Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM20 Dec 2023
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM4 Dec 2023
- 2023VoxNeRF: Bridging Voxel Representation and Neural Radiance Fields for Enhanced Indoor View Synthesis9 Nov 2023
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 66
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 50
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 25
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstructioncited by 18
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 18
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 16
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splattingcited by 15
12 most cited of 31 All 31 (JSON)
- 2026GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking26 Sep 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstruction29 Jan 2026
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddings14 Jan 2026
- 2026PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM10 Jan 2026
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025DPVO-QAT++: Heterogeneous QAT and CUDA Kernel Fusion for High-Performance Deep Patch Visual Odometry16 Nov 2025
- 2025ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM21 Sep 2025
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping17 Sep 2025
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association1 Sep 2025
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environments4 Apr 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
12 newest of 31 All 31 (JSON)