DI-Fusion: Online Implicit 3D Reconstruction with Deep Priors
Not on the map. Why?
Abstract (arXiv)
Previous online 3D dense reconstruction methods struggle to achieve the balance between memory storage and surface quality, largely due to the usage of stagnant underlying geometry representation, such as TSDF (truncated signed distance functions) or surfels, without any knowledge of the scene priors. In this paper, we present DI-Fusion (Deep Implicit Fusion), based on a novel 3D representation, i.e. Probabilistic Local Implicit Voxels (PLIVoxs), for online 3D reconstruction with a commodity RGB-D camera. Our PLIVox encodes scene priors considering both the local geometry and uncertainty parameterized by a deep neural network. With such deep priors, we are able to perform online implicit 3D reconstruction achieving state-of-the-art camera trajectory estimation accuracy and mapping quality, while achieving better storage efficiency compared with previous online 3D reconstruction approaches. Our implementation is available at https://www.github.com/huangjh-pub/di-fusion.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 18; 2023: 21; 2024: 14; 2025: 6; 2026: 5.
70 papers.
Sort:
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2023Gaussian Splatting SLAMcited by 410
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
38 more
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2022SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representationscited by 44
- 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
- 2022BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusioncited by 29
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoisingcited by 29
- 2023Neural Implicit Dense Semantic SLAMcited by 26
- 2021Correspondence-Free Point Cloud Registration with SO(3)-Equivariant Implicit Shape Representationscited by 24
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
- 2023DNS SLAM: Dense Neural Semantic-Informed SLAMcited by 23
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAMcited by 22
- 2022PINs: Progressive Implicit Networks for Multi-Scale Neural Representationscited by 19
- 2023UncLe-SLAM: Uncertainty Learning for Dense Neural SLAMcited by 19
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understandingcited by 19
- 2022MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priorscited by 17
- 2022ObjectMatch: Robust Registration using Canonical Object Correspondencescited by 15
- 2021NeuralBlox: Real-Time Neural Representation Fusion for Robust Volumetric Mappingcited by 14
- 2022Multi-sensor large-scale dataset for multi-view 3D reconstructioncited by 14
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Priorcited by 14
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
- 2024NID-SLAM: Neural Implicit Representation-based RGB-D SLAM in dynamic environmentscited by 10
- 2024RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splattingcited by 10
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2022HRBF-Fusion: Accurate 3D reconstruction from RGB-D data using on-the-fly implicitscited by 8
- 2023SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Viewscited by 8
- 2022Robust Change Detection Based on Neural Descriptor Fieldscited by 7
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
- 2022Learning Online Multi-Sensor Depth Fusioncited by 6
- 2022SC-Explorer: Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planningcited by 6
- 2022An Algorithm for the SE(3)-Transformation on Neural Implicit Maps for Remapping Functionscited by 5
- 2023Uni-Fusion: Universal Continuous Mappingcited by 5
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfelscited by 5
- 2021CIRCLE: Convolutional Implicit Reconstruction and Completion for Large-scale Indoor Scenecited by 4
- 20233D Reconstruction with Generalizable Neural Fields using Scene Priorscited by 4
50 most cited of 70 All 70 (JSON)
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM18 Jun 2026
- 2026VBGS-SLAM: Variational Bayesian Gaussian Splatting Simultaneous Localization and Mapping3 Apr 2026
- 2026Compact Keyframe-Optimized Multi-Agent Gaussian Splatting SLAM1 Apr 2026
- 2026VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM10 Mar 2026
- 2026SSPFormer: Self-Supervised Pretrained Transformer for MRI Images19 Jan 2026
- 2025RGS-SLAM: Robust Gaussian Splatting SLAM with One-Shot Dense Initialization28 Dec 2025
- 2025S3LAM: Surfel Splatting SLAM for Geometrically Accurate Tracking and Mapping28 Jul 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfels3 May 2025
- 2025GI-SLAM: Gaussian-Inertial SLAM24 Mar 2025
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior13 Feb 2025
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
38 more
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splats19 Aug 2024
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understanding30 Jul 2024
- 2024SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling13 May 2024
- 2024RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting30 Apr 2024
- 2024LGSDF: Continual Global Learning of Signed Distance Fields Aided by Local Updating8 Apr 2024
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoising29 Mar 2024
- 2024MUTE-SLAM: Real-Time Neural SLAM with Multiple Tri-Plane Hash Representations26 Mar 2024
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps19 Mar 2024
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closures14 Feb 2024
- 2024NeuV-SLAM: Fast Neural Multiresolution Voxel Optimization for RGBD Dense SLAM3 Feb 2024
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency17 Jan 2024
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAM3 Jan 2024
- 2024NID-SLAM: Neural Implicit Representation-based RGB-D SLAM in dynamic environments2 Jan 2024
- 2023Gaussian Splatting SLAM11 Dec 2023
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting6 Dec 2023
- 2023DNS SLAM: Dense Neural Semantic-Informed SLAM30 Nov 2023
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representation28 Nov 2023
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting20 Nov 2023
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstruction5 Nov 2023
- 2023LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes4 Nov 2023
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priors17 Oct 2023
- 2023HIO-SDF: Hierarchical Incremental Online Signed Distance Fields14 Oct 2023
- 20233D Reconstruction with Generalizable Neural Fields using Scene Priors26 Sep 2023
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction5 Sep 2023
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstruction17 Aug 2023
- 2023SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views12 Jul 2023
- 2023UncLe-SLAM: Uncertainty Learning for Dense Neural SLAM19 Jun 2023
- 2023NICE-SLAM with Adaptive Feature Grids4 Jun 2023
- 2023Neural Kernel Surface Reconstruction31 May 2023
- 2023NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstruction29 Apr 2023
- 2023Neural Implicit Dense Semantic SLAM27 Apr 2023
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAM9 Apr 2023
- 2023Uni-Fusion: Universal Continuous Mapping22 Mar 2023
- 2023Dense RGB SLAM with Neural Implicit Maps21 Jan 2023
- 2022Evolutionary Multitasking with Solution Space Cutting for Point Cloud Registration12 Dec 2022
- 2022ObjectMatch: Robust Registration using Canonical Object Correspondences5 Dec 2022
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives11 Nov 2022
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation28 Oct 2022
50 newest of 70 All 70 (JSON)
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2023Gaussian Splatting SLAMcited by 410
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
12 most cited of 70 All 70 (JSON)
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM18 Jun 2026
- 2026VBGS-SLAM: Variational Bayesian Gaussian Splatting Simultaneous Localization and Mapping3 Apr 2026
- 2026Compact Keyframe-Optimized Multi-Agent Gaussian Splatting SLAM1 Apr 2026
- 2026VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM10 Mar 2026
- 2026SSPFormer: Self-Supervised Pretrained Transformer for MRI Images19 Jan 2026
- 2025RGS-SLAM: Robust Gaussian Splatting SLAM with One-Shot Dense Initialization28 Dec 2025
- 2025S3LAM: Surfel Splatting SLAM for Geometrically Accurate Tracking and Mapping28 Jul 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 2025GauS-SLAM: Dense RGB-D SLAM with Gaussian Surfels3 May 2025
- 2025GI-SLAM: Gaussian-Inertial SLAM24 Mar 2025
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior13 Feb 2025
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
12 newest of 70 All 70 (JSON)