# Predicting Slice-to-Volume Transformation in Presence of Arbitrary Subject Motion

arXiv: https://arxiv.org/abs/1702.08891 · HTML: https://mlsanity.com/paper/1702.08891/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Feb 2017.

## Built on by (most cited first, 10 of 10)

- [Fast Auto-Differentiable Digitally Reconstructed Radiographs for Solving Inverse Problems in Intraoperative Imaging](https://mlsanity.com/paper/2208.12737/) (2022)
- [The Impact of Machine Learning on 2D/3D Registration for Image-guided Interventions: A Systematic Review and Perspective](https://mlsanity.com/paper/2108.02238/) (2021)
- [Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration](https://mlsanity.com/paper/2406.14534/) (2024)
- [Adaptive 3D Localization of 2D Freehand Ultrasound Brain Images](https://mlsanity.com/paper/2209.05477/) (2022)
- [AFFIRM: Affinity Fusion-based Framework for Iteratively Random Motion correction of multi-slice fetal brain MRI](https://mlsanity.com/paper/2205.05851/) (2022)
- [Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Brain](https://mlsanity.com/paper/2301.08317/) (2023)
- [Shadow and Light: Digitally Reconstructed Radiographs for Disease Classification](https://mlsanity.com/paper/2406.03688/) (2024)
- [AVP-AP: Self-supervised Automatic View Positioning in 3D cardiac CT via Atlas Prompting](https://mlsanity.com/paper/2504.05966/) (2025)
- [A Literature Review on Fetus Brain Motion Correction in MRI](https://mlsanity.com/paper/2401.16782/) (2024)
- [SUFFICIENT: A scan-specific unsupervised deep learning framework for high-resolution 3D isotropic fetal brain MRI reconstruction](https://mlsanity.com/paper/2505.17472/) (2025)

## Abstract (arXiv)

This paper aims to solve a fundamental problem in intensity-based 2D/3D registration, which concerns the limited capture range and need for very good initialization of state-of-the-art image registration methods. We propose a regression approach that learns to predict rotation and translations of arbitrary 2D image slices from 3D volumes, with respect to a learned canonical atlas co-ordinate system. To this end, we utilize Convolutional Neural Networks (CNNs) to learn the highly complex regression function that maps 2D image slices into their correct position and orientation in 3D space. Our approach is attractive in challenging imaging scenarios, where significant subject motion complicates reconstruction performance of 3D volumes from 2D slice data. We extensively evaluate the effectiveness of our approach quantitatively on simulated MRI brain data with extreme random motion. We further demonstrate qualitative results on fetal MRI where our method is integrated into a full reconstruction and motion compensation pipeline. With our CNN regression approach we obtain an average prediction error of 7mm on simulated data, and convincing reconstruction quality of images of very young fetuses where previous methods fail. We further discuss applications to Computed Tomography and X-ray projections. Our approach is a general solution to the 2D/3D initialization problem. It is computationally efficient, with prediction times per slice of a few milliseconds, making it suitable for real-time scenarios.