mlsanityData to 14 Oct 2026

Monocular Marker-free Patient-to-Image Intraoperative Registration for Cochlear Implant Surgery

arXiv 2505.18381 ↗First posted 23 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel method for monocular patient-to-image intraoperative registration, specifically designed to operate without any external hardware tracking equipment or fiducial point markers. Leveraging a synthetic microscopy surgical scene dataset with a wide range of transformations, our approach directly maps preoperative CT scans to 2D intraoperative surgical frames through a lightweight neural network for real-time cochlear implant surgery guidance via a zero-shot learning approach. Unlike traditional methods, our framework seamlessly integrates with monocular surgical microscopes, making it highly practical for clinical use without additional hardware dependencies and requirements. Our method estimates camera poses, which include a rotation matrix and a translation vector, by learning from the synthetic dataset, enabling accurate and efficient intraoperative registration. The proposed framework was evaluated on nine clinical cases using a patient-specific and cross-patient validation strategy. Our results suggest that our approach achieves clinically relevant accuracy in predicting 6D camera poses for registering 3D preoperative CT scans to 2D surgical scenes with an angular error within 10 degrees in most cases, while also addressing limitations of traditional methods, such as reliance on external tracking systems or fiducial markers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

13 of 26 references.

References · 13

  1. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  2. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 519
  3. 2015An Introduction to Convolutional Neural Networkscited by 514
  4. 2020GridMask Data Augmentationcited by 123
  5. 2024Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2cited by 11
  6. 2023SAMSNeRF: Segment Anything Model (SAM) Guides Dynamic Surgical Scene Reconstruction by Neural Radiance Field (NeRF)cited by 8
  7. 2024Monocular Microscope to CT Registration using Pose Estimation of the Incus for Augmented Reality Cochlear Implant Surgerycited by 7
  8. 2024Surgical Depth Anything: Depth Estimation for Surgical Scenes using Foundation Modelscited by 5
  9. 2024Self-supervised Mamba-based Mastoidectomy Shape Prediction for Cochlear Implant Surgerycited by 4
  10. 2024Post-mastoidectomy Surface Multi-View Synthesis from a Single Microscopy Imagecited by 4
  11. 2023Learning Expected Appearances for Intraoperative Registration during Neurosurgerycited by 3
  12. 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completioncited by 2
1 more
  1. 2024Cochlear Implantation of Slim Pre-curved Arrays using Automatic Pre-operative Insertion Planscited by 1

Built on by

Not cited yet.