mlsanityData to 14 Oct 2026

Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registration

arXiv 2607.23343 ↗First posted 25 Jul 2026eess.IV cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Intraoperative 2D/3D registration aligns preoperative CT volumes with intraoperative X-ray or fluoroscopic images and is essential for image-guided interventions. Recent learning-based and differentiable registration methods have shown promising accuracy, especially in patient-specific settings where abundant digitally reconstructed radiographs (DRRs) can be synthesized from the target CT. However, training a separate patient-specific model from scratch for every new patient is computationally inefficient and limits practical deployment. In this work, we propose an efficient patient-specific 2D/3D registration framework based on patient-agnostic synthetic pretraining and spherical similarity learning. The model is first pretrained on synthetic DRRs generated from multiple CT volumes to learn transferable pose-sensitive representations, and is then adapted to a new patient using only a limited number of synthetic projections from the target CT. To improve synthetic-to-real robustness without requiring anatomical labels, we introduce a segmentation-free domain randomization strategy that perturbs image intensity, projection physics, field-of-view, occlusion, and fluoroscopic artifacts. The adapted model provides an initial pose estimate, which is further refined using spherical similarity learning and differentiable Levenberg-Marquardt optimization. Experiments on multiple anatomical datasets evaluate whether patient-agnostic synthetic pretraining can improve the efficiency of patient-specific registration, with particular focus on the trade-off between adaptation cost and registration accuracy. The results demonstrate that patient-agnostic synthetic pretraining can significantly reduce patient-specific training requirements while preserving accurate intraoperative 2D/3D registration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 73 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

39 of 73 references.

References · 39

  1. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
  2. 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 140
  3. 2022SynthStrip: Skull-Stripping for Any Brain Imagecited by 127
  4. 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
  5. 2018DeepDRR -- A Catalyst for Machine Learning in Fluoroscopy-guided Procedurescited by 55
  6. 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
  7. 2022Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasetscited by 51
  8. 2023Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Promptingcited by 40
  9. 2022Fast Auto-Differentiable Digitally Reconstructed Radiographs for Solving Inverse Problems in Intraoperative Imagingcited by 38
  10. 2019Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registrationcited by 29
  11. 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 29
  12. 2023Intraoperative 2D/3D Image Registration via Differentiable X-ray Renderingcited by 24
27 more
  1. 2020Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registrationcited by 21
  2. 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
  3. 2019Multiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation (POINT2)cited by 18
  4. 2021Equivariant Filters for Efficient Tracking in 3D Imagingcited by 17
  5. 2024Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registrationcited by 17
  6. 2015Real-time 2D/3D Registration via CNN Regressioncited by 15
  7. 2023Quantifying white matter hyperintensity and brain volumes in heterogeneous clinical and low-field portable MRIcited by 15
  8. 2021End-to-end Ultrasound Frame to Volume Registrationcited by 13
  9. 2022Global Multi-modal 2D/3D Registration via Local Descriptors Learningcited by 13
  10. 2022Self-Supervised 2D/3D Registration for X-Ray to CT Image Fusioncited by 12
  11. 2023DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registrationcited by 10
  12. 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRIcited by 10
  13. 2019Patch-Based Image Similarity for Intraoperative 2D/3D Pelvis Registration During Periacetabular Osteotomycited by 9
  14. 2025Synthesizing Individualized Aging Brains in Health and Disease with Generative Models and Parallel Transportcited by 9
  15. 2023X-Ray to CT Rigid Registration Using Scene Coordinate Regressioncited by 8
  16. 2020Pose-dependent weights and Domain Randomization for fully automatic X-ray to CT Registrationcited by 7
  17. 2023MAD: Modality Agnostic Distance Measure for Image Registrationcited by 7
  18. 2021Deep Iterative 2D/3D Registrationcited by 6
  19. 2024RayEmb: Arbitrary Landmark Detection in X-Ray Images Using Ray Embedding Subspacecited by 6
  20. 2022Photo-realistic Neural Domain Randomizationcited by 5
  21. 2023PELE scores: Pelvic X-ray Landmark Detection by Pelvis Extraction and Enhancementcited by 5
  22. 2023Embedded Feature Similarity Optimization with Specific Parameter Initialization for 2D/3D Medical Image Registrationcited by 4
  23. 2024An Optimization-based Baseline for Rigid 2D/3D Registration Applied to Spine Surgical Navigation Using CMA-EScited by 4
  24. 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matchingcited by 4
  25. 2024Fully Differentiable Correlation-driven 2D/3D Registration for X-ray to CT Image Fusioncited by 3
  26. 2024Differentiable Voxel-based X-ray Rendering Improves Sparse-View 3D CBCT Reconstructioncited by 3
  27. 2025Intraoperative 2D/3D Registration via Spherical Similarity Learning and Differentiable Levenberg-Marquardt Optimizationcited by 1

Built on by

Not cited yet.