HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
We present HI-SLAM2, a geometry-aware Gaussian SLAM system that achieves fast and accurate monocular scene reconstruction using only RGB input. Existing Neural SLAM or 3DGS-based SLAM methods often trade off between rendering quality and geometry accuracy, our research demonstrates that both can be achieved simultaneously with RGB input alone. The key idea of our approach is to enhance the ability for geometry estimation by combining easy-to-obtain monocular priors with learning-based dense SLAM, and then using 3D Gaussian splatting as our core map representation to efficiently model the scene. Upon loop closure, our method ensures on-the-fly global consistency through efficient pose graph bundle adjustment and instant map updates by explicitly deforming the 3D Gaussian units based on anchored keyframe updates. Furthermore, we introduce a grid-based scale alignment strategy to maintain improved scale consistency in prior depths for finer depth details. Through extensive experiments on Replica, ScanNet, and ScanNet++, we demonstrate significant improvements over existing Neural SLAM methods and even surpass RGB-D-based methods in both reconstruction and rendering quality. The project page and source code will be made available at https://hi-slam2.github.io/.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 63 of its 91 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
63 of 91 references.
References · 63
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
38 more
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2023Gaussian Splatting SLAMcited by 410
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2022Deep Patch Visual Odometrycited by 186
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
- 2024Deep Patch Visual SLAMcited by 68
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 7; 2026: 17.
24 papers.
Sort:
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 13
- 2025Online Language Splattingcited by 10
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfelscited by 5
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mappingcited by 2
- 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priorscited by 2
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstructioncited by 2
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstructioncited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddingscited by 1
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 1
12 more
- 2026M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAMcited by 1
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputscited by 1
- 2026Learning Image-Adaptive Scale Fields for Metric Depth Recoverycited by 1
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processingcited by 1
- 2026Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errorscited by 1
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlowcited by 0
- 2026Smartphone-based Circular Plot Sampling for Forest Inventorycited by 0
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustmentcited by 0
- 2026MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussianscited by 0
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Trackingcited by 0
- 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstructioncited by 0
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priorscited by 0
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction24 Aug 2026
- 2026Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errors5 Aug 2026
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processing4 Aug 2026
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking2 Aug 2026
- 2026MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians30 Jul 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026Smartphone-based Circular Plot Sampling for Forest Inventory19 May 2026
- 2026Learning Image-Adaptive Scale Fields for Metric Depth Recovery8 May 2026
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM17 Mar 2026
12 more
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting19 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstruction29 Jan 2026
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddings14 Jan 2026
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstruction11 Jan 2026
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priors21 Nov 2025
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priors27 Oct 2025
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping17 Sep 2025
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association1 Sep 2025
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfels3 May 2025
- 2025Online Language Splatting12 Mar 2025
- 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 13
- 2025Online Language Splattingcited by 10
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfelscited by 5
- 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mappingcited by 2
- 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priorscited by 2
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstructioncited by 2
- 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstructioncited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
- 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddingscited by 1
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 1
12 most cited of 24 All 24 (JSON)
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction24 Aug 2026
- 2026Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errors5 Aug 2026
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processing4 Aug 2026
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking2 Aug 2026
- 2026MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians30 Jul 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026Smartphone-based Circular Plot Sampling for Forest Inventory19 May 2026
- 2026Learning Image-Adaptive Scale Fields for Metric Depth Recovery8 May 2026
- 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow17 Apr 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM17 Mar 2026
12 newest of 24 All 24 (JSON)