EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications among endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates streamlined Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://EndoGSLAM.loping151.com
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 22 Mar 2024.
Builds on
21 of 31 references.
References · 21
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
- 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 81
- 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
9 more
- 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
- 2023Neural LerPlane Representations for Fast 4D Reconstruction of Deformable Tissuescited by 44
- 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
- 2022SAGE: SLAM with Appearance and Geometry Prior for Endoscopycited by 28
- 2022Bimodal Camera Pose Prediction for Endoscopycited by 20
- 2023Efficient Deformable Tissue Reconstruction via Orthogonal Neural Planecited by 20
- 2017SLAM based Quasi Dense Reconstruction For Minimally Invasive Surgery Scenescited by 12
- 2021Stereo Dense Scene Reconstruction and Accurate Localization for Learning-Based Navigation of Laparoscope in Minimally Invasive Surgerycited by 11
- 2022C3Fusion: Consistent Contrastive Colon Fusion, Towards Deep SLAM in Colonoscopycited by 7
Built on by
Citing papers per year: 2024: 5; 2025: 13; 2026: 15.
33 papers.
Sort:
By area:
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024HDRSplat: Gaussian Splatting for High Dynamic Range 3D Scene Reconstruction from Raw Imagescited by 15
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
- 2025The NeRF Signature: Codebook-Aided Watermarking for Neural Radiance Fieldscited by 10
- 2025EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splattingcited by 10
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopycited by 4
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lightingcited by 4
- 2025EndoWave: 4D Gaussian Splatting with Rational Wavelet for Endoscopic Reconstructioncited by 4
- 20253D Densification for Multi-Map Monocular VSLAM in Endoscopycited by 3
- 2024Realistic Surgical Simulation from Monocular Videoscited by 2
21 more
- 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusioncited by 2
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 2
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splattingcited by 2
- 2024Free-DyGS: Camera-Pose-Free Scene Reconstruction for Dynamic Surgical Videos with Gaussian Splattingcited by 1
- 2025Moving Light Adaptive Colonoscopy Reconstruction via Illumination-Attenuation-Aware 3D Gaussian Splattingcited by 1
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motionscited by 1
- 2025Feature-EndoGaussian: Feature Distilled Gaussian Splatting in Surgical Deformable Scene Reconstructioncited by 0
- 2025NeeCo: Image Synthesis of Novel Instrument States Based on Dynamic and Deformable 3D Gaussian Reconstructioncited by 0
- 2025Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstructioncited by 0
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Renderingcited by 0
- 2026Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularizationcited by 0
- 2026EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation via Diffusion Depth Completioncited by 0
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation Systemcited by 0
- 2026Investigating a Policy-Based Formulation for Endoscopic Camera Pose Recoverycited by 0
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearancecited by 0
- 20263D Consistency Optimization for Self-Supervised Monocular Video Depth Estimationcited by 0
- 2026Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigationcited by 0
- 2026Track2Map: Online Deformable SLAM with Motion-Aware Pose Optimization in Robotic Surgerycited by 0
- 2026Rendering 3D Gaussians on a Graph Processorcited by 0
- 2026Geometry-Aware Camera Localization for Bronchoscopycited by 0
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decompositioncited by 0
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decomposition9 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Rendering 3D Gaussians on a Graph Processor17 Jul 2026
- 2026Track2Map: Online Deformable SLAM with Motion-Aware Pose Optimization in Robotic Surgery9 Jul 2026
- 2026Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation22 Jun 2026
- 20263D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation14 Jun 2026
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance5 Jun 2026
- 2026Investigating a Policy-Based Formulation for Endoscopic Camera Pose Recovery20 Mar 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splatting6 Mar 2026
- 2026EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation via Diffusion Depth Completion25 Feb 2026
- 2026Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization24 Feb 2026
21 more
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting19 Feb 2026
- 2026BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusion7 Jan 2026
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025SuperQuadricOcc: Real-Time Self-Supervised Semantic Occupancy Estimation with Superquadric Volume Rendering21 Nov 2025
- 2025EndoWave: 4D Gaussian Splatting with Rational Wavelet for Endoscopic Reconstruction27 Oct 2025
- 2025Moving Light Adaptive Colonoscopy Reconstruction via Illumination-Attenuation-Aware 3D Gaussian Splatting21 Oct 2025
- 2025Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction15 Aug 2025
- 2025NeeCo: Image Synthesis of Novel Instrument States Based on Dynamic and Deformable 3D Gaussian Reconstruction11 Aug 2025
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realism30 Jun 2025
- 2025EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splatting26 Jun 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 20253D Densification for Multi-Map Monocular VSLAM in Endoscopy18 Mar 2025
- 2025Feature-EndoGaussian: Feature Distilled Gaussian Splatting in Surgical Deformable Scene Reconstruction8 Mar 2025
- 2025The NeRF Signature: Codebook-Aided Watermarking for Neural Radiance Fields26 Feb 2025
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping31 Jan 2025
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lighting17 Dec 2024
- 2024Realistic Surgical Simulation from Monocular Videos3 Dec 2024
- 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopy19 Nov 2024
- 2024Free-DyGS: Camera-Pose-Free Scene Reconstruction for Dynamic Surgical Videos with Gaussian Splatting2 Sep 2024
- 2024HDRSplat: Gaussian Splatting for High Dynamic Range 3D Scene Reconstruction from Raw Images23 Jul 2024
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024HDRSplat: Gaussian Splatting for High Dynamic Range 3D Scene Reconstruction from Raw Imagescited by 15
- 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
- 2025Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mappingcited by 11
- 2025The NeRF Signature: Codebook-Aided Watermarking for Neural Radiance Fieldscited by 10
- 2025EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splattingcited by 10
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopycited by 4
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lightingcited by 4
- 2025EndoWave: 4D Gaussian Splatting with Rational Wavelet for Endoscopic Reconstructioncited by 4
- 20253D Densification for Multi-Map Monocular VSLAM in Endoscopycited by 3
- 2024Realistic Surgical Simulation from Monocular Videoscited by 2
12 most cited of 32 All 32 (JSON)
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decomposition9 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Rendering 3D Gaussians on a Graph Processor17 Jul 2026
- 2026Track2Map: Online Deformable SLAM with Motion-Aware Pose Optimization in Robotic Surgery9 Jul 2026
- 2026Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation22 Jun 2026
- 20263D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation14 Jun 2026
- 2026C3VD-DEFCOL: A Deformable Colonoscopy Dataset with Time-Resolved 3D Ground Truth and Realistic Appearance5 Jun 2026
- 2026Investigating a Policy-Based Formulation for Endoscopic Camera Pose Recovery20 Mar 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splatting6 Mar 2026
- 2026EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation via Diffusion Depth Completion25 Feb 2026
- 2026Monocular Endoscopic Tissue 3D Reconstruction with Multi-Level Geometry Regularization24 Feb 2026
12 newest of 32 All 32 (JSON)