GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration
Not on the map. Why?
Abstract (arXiv)
Deep learning-based deformable registration methods have been widely investigated in diverse medical applications. Learning-based deformable registration relies on weighted objective functions trading off registration accuracy and smoothness of the deformation field. Therefore, they inevitably require tuning the hyperparameter for optimal registration performance. Tuning the hyperparameters is highly computationally expensive and introduces undesired dependencies on domain knowledge. In this study, we construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyperparameter-free balance on multiple losses. In GSMorph, we reformulate the optimization procedure by projecting the gradient of similarity loss orthogonally to the plane associated with the smoothness constraint, rather than additionally introducing a hyperparameter to balance these two competing terms. Furthermore, our method is model-agnostic and can be merged into any deep registration network without introducing extra parameters or slowing down inference. In this study, We compared our method with state-of-the-art (SOTA) deformable registration approaches over two publicly available cardiac MRI datasets. GSMorph proves superior to five SOTA learning-based registration models and two conventional registration techniques, SyN and Demons, on both registration accuracy and smoothness.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 26 Jun 2023.
Builds on
14 of 20 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2015Spatial Transformer Networkscited by 1,429
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2016HyperNetworkscited by 1,027
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 85
- 2021Domain Generalization via Gradient Surgerycited by 60
- 2021Conditional Deformable Image Registration with Convolutional Neural Networkcited by 59
2 more
Built on by
Citing papers per year: 2023: 1; 2024: 4.
5 papers.
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registrationcited by 10
- 2024GS-EMA: Integrating Gradient Surgery Exponential Moving Average with Boundary-Aware Contrastive Learning for Enhanced Domain Generalization in Aneurysm Segmentationcited by 1
- 2024CardioSpectrum: Comprehensive Myocardium Motion Analysis with 3D Deep Learning and Geometric Insightscited by 1
- 2024Improving Instance Optimization in Deformable Image Registration with Gradient Projectioncited by 1
- 2024Improving Instance Optimization in Deformable Image Registration with Gradient Projection21 Oct 2024
- 2024CardioSpectrum: Comprehensive Myocardium Motion Analysis with 3D Deep Learning and Geometric Insights4 Jul 2024
- 2024GS-EMA: Integrating Gradient Surgery Exponential Moving Average with Boundary-Aware Contrastive Learning for Enhanced Domain Generalization in Aneurysm Segmentation23 Feb 2024
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration25 Jan 2024
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond28 Jul 2023