mlsanityData to 7 Oct 2026

MUTE-SLAM: Real-Time Neural SLAM with Multiple Tri-Plane Hash Representations

arXiv 2403.17765 ↗First posted 26 Mar 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce MUTE-SLAM, a real-time neural RGB-D SLAM system employing multiple tri-plane hash-encodings for efficient scene representation. MUTE-SLAM effectively tracks camera positions and incrementally builds a scalable multi-map representation for both small and large indoor environments. As previous methods often require pre-defined scene boundaries, MUTE-SLAM dynamically allocates sub-maps for newly observed local regions, enabling constraint-free mapping without prior scene information. Unlike traditional grid-based methods, we use three orthogonal axis-aligned planes for hash-encoding scene properties, significantly reducing hash collisions and the number of trainable parameters. This hybrid approach not only ensures real-time performance but also enhances the fidelity of surface reconstruction. Furthermore, our optimization strategy concurrently optimizes all sub-maps intersecting with the current camera frustum, ensuring global consistency. Extensive testing on both real-world and synthetic datasets has shown that MUTE-SLAM delivers state-of-the-art surface reconstruction quality and competitive tracking performance across diverse indoor settings. The code is available at https://github.com/lumennYan/MUTE_SLAM.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 26 Mar 2024.

Builds on

29 of 41 references.

References · 29

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  7. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  8. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  9. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  10. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  11. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  12. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
17 more
  1. 2021Neural RGB-D Surface Reconstructioncited by 312
  2. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  3. 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
  4. 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
  5. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  6. 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
  7. 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
  8. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
  9. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  10. 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
  11. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  12. 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
  13. 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
  14. 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 62
  15. 2022GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstructioncited by 61
  16. 2023H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representationcited by 23
  17. 2023Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detailcited by 23

Built on by

Not cited yet.