mlsanityData to 14 Oct 2026

RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment

arXiv 2609.19236 ↗First posted 16 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Objective: Incomplete navigation of anatomy during ureteroscopic kidney stone surgeries can contribute to repeat interventions. While skilled surgeons have lower reintervention rates, there are no objective metrics to quantify scope-navigation performance to evaluate when a trainee becomes skilled. This work aims to recover ureteroscope trajectories from endoscopic video and derive navigation metrics to quantify differences in skill. Methods: We propose RAUL, a reference-assisted reconstruction framework for recovering ureteroscope trajectories from ureteroscope videos only in phantoms. For each phantom, we use a slow, high-quality reference exploration video to generate a reference reconstruction. We localize subsequent exploration videos against this reference. We evaluate localization accuracy against electromagnetically tracked scope pose. We compute navigation metrics from phantom exploration trajectories to compare surgical residents across experience levels. Results: The proposed reference-assisted framework achieves a mean translation root mean square error of 0.5 ± 0.1 mm across 9 phantoms. Compared to standard Structure-from-Motion (SfM), the proposed pipeline increases frame-wise localization coverage from 50.5 ± 14.9% to 86.1 ± 7.2% of all video frames. The reconstructed trajectories revealed significant differences between high- and low-experience trainees in established navigation metrics. Conclusion: RAUL enables substantially more complete recovery of ureteroscope trajectories from videos compared to standard SfM pipelines, enabling trajectory-based skill assessment without additional tracking equipment. Significance: To the best of our knowledge, this is the first use of video-only recovery of ureteroscope trajectories without external tracking sensors for skill assessment, supporting scalable automated assessment of ureteroscopy navigation skill.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 40 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

16 of 40 references.

References · 16

  1. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
  2. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  3. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
  4. 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
  5. 2021Stereo Correspondence and Reconstruction of Endoscopic Data Challengecited by 103
  6. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
  7. 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 72
  8. 2022EndoMapper dataset of complete calibrated endoscopy procedurescited by 53
  9. 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
  10. 2018Evaluating surgical skills from kinematic data using convolutional neural networkscited by 19
  11. 2018Deep Learning with Convolutional Neural Network for Objective Skill Evaluation in Robot-assisted Surgerycited by 17
  12. 2025Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Videocited by 16
4 more
  1. 20193D Reconstruction of Whole Stomach from Endoscope Video Using Structure-from-Motioncited by 10
  2. 2025From Monocular Vision to Autonomous Action: Guiding Tumor Resection via 3D Reconstructioncited by 10
  3. 2025NAVIUS: Navigated Augmented Reality Visualization for Ureteroscopic Surgerycited by 3
  4. 2025PERSEUS: Perception with Semantic Endoscopic Understanding and SLAMcited by 3

Built on by

Not cited yet.