mlsanityData to 7 Oct 2026

HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction

arXiv 2411.17982 ↗First posted 27 Nov 2024cs.RO cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

We present HI-SLAM2, a geometry-aware Gaussian SLAM system that achieves fast and accurate monocular scene reconstruction using only RGB input. Existing Neural SLAM or 3DGS-based SLAM methods often trade off between rendering quality and geometry accuracy, our research demonstrates that both can be achieved simultaneously with RGB input alone. The key idea of our approach is to enhance the ability for geometry estimation by combining easy-to-obtain monocular priors with learning-based dense SLAM, and then using 3D Gaussian splatting as our core map representation to efficiently model the scene. Upon loop closure, our method ensures on-the-fly global consistency through efficient pose graph bundle adjustment and instant map updates by explicitly deforming the 3D Gaussian units based on anchored keyframe updates. Furthermore, we introduce a grid-based scale alignment strategy to maintain improved scale consistency in prior depths for finer depth details. Through extensive experiments on Replica, ScanNet, and ScanNet++, we demonstrate significant improvements over existing Neural SLAM methods and even surpass RGB-D-based methods in both reconstruction and rendering quality. The project page and source code will be made available at https://hi-slam2.github.io/.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 63 of its 91 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

63 of 91 references.

References · 63

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  8. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  11. 2024Depth Anything V2cited by 1,385
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
38 more
  1. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  2. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  3. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  4. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  5. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  6. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  7. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  8. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  9. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  10. 2016Direct Sparse Odometrycited by 479
  11. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  12. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
  13. 2023Gaussian Splatting SLAMcited by 410
  14. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  15. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  16. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  17. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  18. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  19. 2021Neural RGB-D Surface Reconstructioncited by 312
  20. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  21. 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
  22. 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
  23. 2022Deep Patch Visual Odometrycited by 186
  24. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  25. 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
  26. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
  27. 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
  28. 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
  29. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  30. 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
  31. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  32. 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
  33. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
  34. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
  35. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  36. 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
  37. 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
  38. 2024Deep Patch Visual SLAMcited by 68

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 17.

24 papers.

Sort:

  1. 2025ViSTA-SLAM: Visual SLAM with Symmetric Two-view Associationcited by 13
  2. 2025Online Language Splattingcited by 10
  3. 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
  4. 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfelscited by 5
  5. 2025MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mappingcited by 2
  6. 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priorscited by 2
  7. 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstructioncited by 2
  8. 2026PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstructioncited by 2
  9. 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
  10. 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
  11. 2026SCE-SLAM: Scale-Consistent Monocular SLAM via Scene Coordinate Embeddingscited by 1
  12. 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 1
12 more
  1. 2026M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAMcited by 1
  2. 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputscited by 1
  3. 2026Learning Image-Adaptive Scale Fields for Metric Depth Recoverycited by 1
  4. 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processingcited by 1
  5. 2026Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errorscited by 1
  6. 2026GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlowcited by 0
  7. 2026Smartphone-based Circular Plot Sampling for Forest Inventorycited by 0
  8. 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustmentcited by 0
  9. 2026MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussianscited by 0
  10. 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Trackingcited by 0
  11. 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstructioncited by 0
  12. 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priorscited by 0