mlsanityData to 7 Oct 2026

SurgCalib: Gaussian Splatting-Based Hand-Eye Calibration for Robot-Assisted Minimally Invasive Surgery

arXiv 2603.08983 ↗First posted 9 Mar 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a Gaussian Splatting-based framework for hand-eye calibration of the da Vinci surgical robot. In a vision-guided robotic system, accurate estimation of the rigid transformation between the robot base and the camera frame is essential for reliable closed-loop control. For cable-driven surgical robots, this task faces unique challenges. The encoders of surgical instruments often produce inaccurate proprioceptive measurements due to cable stretch and backlash. Conventional hand-eye calibration approaches typically rely on known fiducial patterns and solve the AX = XB formulation. While effective, introducing additional markers into the operating room (OR) environment can violate sterility protocols and disrupt surgical workflows. In this study, we propose SurgCalib, an automatic, markerless framework that has the potential to be used in the OR. SurgCalib first initializes the pose of the surgical instrument using raw kinematic measurements and subsequently refines this pose through a two-phase optimization procedure under the RCM constraint within a Gaussian Splatting-based differentiable rendering pipeline. We evaluate the proposed method on the public dVRK benchmark, SurgPose. The results demonstrate average 2D tool-tip reprojection errors of 12.24 px (2.06 mm) and 11.33 px (1.9 mm), and 3D tool-tip Euclidean distance errors of 5.98 mm and 4.75 mm, for the left and right instruments, respectively.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

21 of 39 references.

References · 21

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  4. 2023SurgicalSAM: Efficient Class Promptable Surgical Instrument Segmentationcited by 103
  5. 2019Camera-to-Robot Pose Estimation from a Single Imagecited by 48
  6. 2021Single-view robot pose and joint angle estimation via render & comparecited by 33
  7. 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfercited by 23
  8. 2024Differentiable Robot Renderingcited by 20
  9. 2025SurgPose: a Dataset for Articulated Robotic Surgical Tool Pose Estimation and Trackingcited by 14
  10. 2025Self-Calibrating Gaussian Splatting for Large Field of View Reconstructioncited by 10
  11. 2023Neural Lens Modelingcited by 7
  12. 2024Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment Anythingcited by 7
9 more
  1. 2025Differentiable Rendering-based Pose Estimation for Surgical Robotic Instrumentscited by 6
  2. 2022Caveats on the first-generation da Vinci Research Kit: latent technical constraints and essential calibrationscited by 5
  3. 2025Instrument-Splatting: Controllable Photorealistic Reconstruction of Surgical Instruments Using Gaussian Splattingcited by 5
  4. 2025Video-based Surgical Tool-tip and Keypoint Tracking using Multi-frame Context-driven Deep Learning Modelscited by 4
  5. 2025ROBUST-MIPS: A Combined Skeletal Pose and Instance Segmentation Dataset for Laparoscopic Surgical Instrumentscited by 2
  6. 2025Efficient Surgical Robotic Instrument Pose Reconstruction in Real World Conditions Using Unified Feature Detectioncited by 2
  7. 2024Kalib: Easy Hand-Eye Calibration with Reference Point Trackingcited by 1
  8. 2025ToolTipNet: A Segmentation-Driven Deep Learning Baseline for Surgical Instrument Tip Detectioncited by 1
  9. 2026On-the-fly hand-eye calibration for the da Vinci surgical robotcited by 1

Built on by

Not cited yet.