mlsanityData to 14 Oct 2026

ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting

arXiv 2607.12785 ↗First posted 14 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Robot-assisted minimally invasive surgery (MIS) critically depends on reliable endoscopic perception for navigation and safety. However, conventional endoscopes provide only a limited field of view, leaving large portions of the surrounding anatomy unobserved. Recent neural rendering approaches, such as Neural Radiance Fields and 3D Gaussian Splatting, enable novel view synthesis from endoscopic videos, but their reliance on sparse observations often leads to severe artifacts when extrapolating beyond the training trajectory. In this work, we propose ExtraGS, a framework for enhancing endoscopic view extrapolation through diffusion-guided 3D Gaussian Splatting. Starting from an initial reconstruction, we introduce an uncertainty-guided virtual camera sampling strategy to actively explore blind spots and maximize information gain. The rendered views from these sampled locations are refined using a diffusion model to recover plausible anatomical structures, producing pseudo-observations that guide further optimization. To prevent the generated content from degrading reliable regions, we adopt a confidence-weighted fine-tuning strategy when incorporating these pseudo-observations. Extensive experiments on multiple public endoscopic datasets demonstrate that ExtraGS significantly reduces extrapolation artifacts and achieves state-of-the-art performance in endoscopic novel view synthesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

19 of 26 references.

References · 19

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  4. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  5. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  6. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
  7. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  8. 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 69
  9. 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
  10. 2023LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Declinecited by 24
  11. 2024Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstructioncited by 19
  12. 2025C3VDv2 -- Colonoscopy 3D video dataset with enhanced realismcited by 15
7 more
  1. 2024ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Modelscited by 12
  2. 2025EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splattingcited by 10
  3. 2024UC-NeRF: Uncertainty-aware Conditional Neural Radiance Fields from Endoscopic Sparse Viewscited by 8
  4. 2025Deformable Gaussian Splatting for Efficient and High-Fidelity Reconstruction of Surgical Scenescited by 6
  5. 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priorscited by 6
  6. 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 2
  7. 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motionscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EndoGSim: Physics-Aware 4D Dynamic Endoscopic Scene Simulations via MLLM-Guided Gaussian Splatting
  2. 2026EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation via Diffusion Depth Completion
  3. 2025Feature-EndoGaussian: Feature Distilled Gaussian Splatting in Surgical Deformable Scene Reconstruction
  4. 2025SurgiSR4K: A High-Resolution Endoscopic Video Dataset for Robotic-Assisted Minimally Invasive Procedures
  5. 2026EndoWAM: A Grounded World-Action Model for Generalizable Endoscopic Navigation
  6. 2025EndoStreamDepth: Temporally Consistent Monocular Depth Estimation for Endoscopic Video Streams
  7. 2026Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting
  8. 2026Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation