mlsanityData to 7 Oct 2026

EndoVGGT: GNN-Enhanced Depth Estimation for Surgical 3D Reconstruction

arXiv 2603.24577 ↗First posted 25 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate 3D reconstruction of deformable soft tissues is essential for surgical robotic perception. However, low-texture surfaces, specular highlights, and instrument occlusions often fragment geometric continuity, posing a challenge for existing fixed-topology approaches. To address this, we propose EndoVGGT, a geometry-centric framework equipped with a Deformation-aware Graph Attention (DeGAT) module. Rather than using static spatial neighborhoods, DeGAT dynamically constructs feature-space semantic graphs to capture long-range correlations among coherent tissue regions. This enables robust propagation of structural cues across occlusions, enforcing global consistency and improving non-rigid deformation recovery. Extensive experiments on SCARED show that our method significantly improves fidelity, increasing PSNR by 24.6% and SSIM by 9.1% over prior state-of-the-art. Crucially, EndoVGGT exhibits strong zero-shot cross-dataset generalization to the unseen SCARED and EndoNeRF domains, confirming that DeGAT learns domain-agnostic geometric priors. These results highlight the efficacy of dynamic feature-space modeling for consistent surgical 3D reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

20 of 29 references.

References · 20

  1. 2017Graph Attention Networkscited by 8,854
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2021Vision Transformers for Dense Predictioncited by 1,789
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  7. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  8. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  9. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  10. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  11. 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
  12. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 122
8 more
  1. 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 101
  2. 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 68
  3. 2019Video-based surgical skill assessment using 3D convolutional neural networkscited by 57
  4. 2024Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgerycited by 52
  5. 2024EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstructioncited by 20
  6. 2024A Review of 3D Reconstruction Techniques for Deformable Tissues in Robotic Surgerycited by 7
  7. 2023Autonomous Intelligent Navigation for Flexible Endoscopy Using Monocular Depth Guidance and 3-D Shape Planningcited by 5
  8. 2025EndoLRMGS: Complete Endoscopic Scene Reconstruction combining Large Reconstruction Modelling and Gaussian Splattingcited by 1

Built on by

Not cited yet.