mlsanityData to 7 Oct 2026

End-to-end Ultrasound Frame to Volume Registration

arXiv 2107.06449 ↗First posted 14 Jul 2021eess.IV cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Fusing intra-operative 2D transrectal ultrasound (TRUS) image with pre-operative 3D magnetic resonance (MR) volume to guide prostate biopsy can significantly increase the yield. However, such a multimodal 2D/3D registration problem is a very challenging task. In this paper, we propose an end-to-end frame-to-volume registration network (FVR-Net), which can efficiently bridge the previous research gaps by aligning a 2D TRUS frame with a 3D TRUS volume without requiring hardware tracking. The proposed FVR-Net utilizes a dual-branch feature extraction module to extract the information from TRUS frame and volume to estimate transformation parameters. We also introduce a differentiable 2D slice sampling module which allows gradients backpropagating from an unsupervised image similarity loss for content correspondence learning. Our model shows superior efficiency for real-time interventional guidance with highly competitive registration accuracy.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 7 of its 22 references that are in the map. First posted on arXiv 14 Jul 2021.

Builds on

7 of 22 references.

References · 7

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  3. 2015Spatial Transformer Networkscited by 1,423
  4. 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
  5. 2018Learning Deep Similarity Metric for 3D MR-TRUS Registrationcited by 24
  6. 2017Dilated FCN for Multi-Agent 2D/3D Medical Image Registrationcited by 22
  7. 2020Sensorless Freehand 3D Ultrasound Reconstruction via Deep Contextual Learningcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 4; 2025: 2; 2026: 4.

13 papers.

Sort:

By area:

  1. 2024Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registrationcited by 7
  2. 2023Embedded Feature Similarity Optimization with Specific Parameter Initialization for 2D/3D Medical Image Registrationcited by 4
  3. 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registrationcited by 4
  4. 2024A Narrative Review of Image Processing Techniques Related to Prostate Ultrasoundcited by 3
  5. 2024Deep Regression 2D-3D Ultrasound Registration for Liver Motion Correction in Focal Tumor Thermal Ablationcited by 2
  6. 2024A self-attention model for robust rigid slice-to-volume registration of functional MRIcited by 1
  7. 2025Intraoperative 2D/3D Registration via Spherical Similarity Learning and Differentiable Levenberg-Marquardt Optimizationcited by 1
  8. 2026LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registrationcited by 1
  9. 2022The use of deep learning in interventional radiotherapy (brachytherapy): a review with a focus on open source and open datacited by 0
  10. 2023A Two-Step Deep Learning Method for 3DCT-2DUS Kidney Registration During Breathingcited by 0
  11. 2025NeuralBoneReg: An Instance-Specific Label-Free Point Cloud-Based Method for Multi-Modal Bone Surface Registrationcited by 0
  12. 2026Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registrationcited by 0
1 more
  1. 2026SCoPE-Reg: Efficient Rigid Ultrasound Slice-to-Volume Registration via State-Space Correlation and Closed-Form Pose Estimationcited by 0