FlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flow
Not on the map. Why?
Abstract (arXiv)
We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely corrects for gross differences between moving and fixed volumes in 3D followed by FlowReg-O which performs pixel-wise deformations on a slice-by-slice basis for fine tuning in 2D. The affine network regresses the 3D affine matrix based on a correlation loss function that enforces global similarity. The deformable network operates on 2D image slices based on the optical flow network FlowNet-Simple but with three loss components. The photometric loss minimizes pixel intensity differences differences, the smoothness loss encourages similar magnitudes between neighbouring vectors, and a correlation loss that is used to maintain the intensity similarity between fixed and moving image slices. The proposed method is compared to four open source registration techniques ANTs, Demons, SE, and Voxelmorph. In total, 4643 FLAIR MR imaging volumes are used from dementia and vascular disease cohorts, acquired from over 60 international centres with varying acquisition parameters. A battery of quantitative novel registration validation metrics are proposed that focus on the structural integrity of tissues, spatial alignment, and intensity similarity. Experimental results show FlowReg (FlowReg-A+O) performs better than iterative-based registration algorithms for intensity and spatial alignment metrics with a Pixelwise Agreement of 0.65, correlation coefficient of 0.80, and Mutual Information of 0.29. Among the deep learning frameworks, FlowReg-A or FlowReg-A+O provided the highest performance over all but one of the metrics. Results show that FlowReg is able to obtain high intensity and spatial similarity while maintaining the shape and structure of anatomy and pathology.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 58 references that are in the map. First posted on arXiv 24 Jan 2021.
Builds on
12 of 58 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Spatial Transformer Networkscited by 1,429
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
- 2016Back to Basics: Unsupervised Learning of Optical Flow via Brightness Constancy and Motion Smoothnesscited by 101
- 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
- 2014Multi-Atlas Segmentation of Biomedical Images: A Surveycited by 56
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 0; 2025: 1.
4 papers.
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2021Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised Learningcited by 16
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereocited by 7
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereo14 May 2025
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypoints19 Apr 2023
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow31 Mar 2022
- 2021Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised Learning26 May 2021