DeepTag: An Unsupervised Deep Learning Method for Motion Tracking on Cardiac Tagging Magnetic Resonance Images
Not on the map. Why?
Abstract (arXiv)
Cardiac tagging magnetic resonance imaging (t-MRI) is the gold standard for regional myocardium deformation and cardiac strain estimation. However, this technique has not been widely used in clinical diagnosis, as a result of the difficulty of motion tracking encountered with t-MRI images. In this paper, we propose a novel deep learning-based fully unsupervised method for in vivo motion tracking on t-MRI images. We first estimate the motion field (INF) between any two consecutive t-MRI frames by a bi-directional generative diffeomorphic registration neural network. Using this result, we then estimate the Lagrangian motion field between the reference frame and any other frame through a differentiable composition layer. By utilizing temporal information to perform reasonable estimations on spatio-temporal motion fields, this novel method provides a useful solution for motion tracking and image registration in dynamic medical imaging. Our method has been validated on a representative clinical t-MRI dataset; the experimental results show that our method is superior to conventional motion tracking methods in terms of landmark tracking accuracy and inference efficiency.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 24 of its 58 references that are in the map. First posted on arXiv 4 Mar 2021.
Builds on
24 of 58 references.
References · 24
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2019Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimationcited by 131
- 2019SelFlow: Self-Supervised Learning of Optical Flowcited by 128
- 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
12 more
- 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
- 2018Learning a Probabilistic Model for Diffeomorphic Registrationcited by 62
- 2018Joint Learning of Motion Estimation and Segmentation for Cardiac MR Image Sequencescited by 47
- 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
- 2019Metric Learning for Image Registrationcited by 30
- 2019Region-specific Diffeomorphic Metric Mappingcited by 24
- 2019Bridging Stereo Matching and Optical Flow via Spatiotemporal Correspondencecited by 23
- 2020FOAL: Fast Online Adaptive Learning for Cardiac Motion Estimationcited by 21
- 2018Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flowcited by 16
- 2020Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimationcited by 15
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 8; 2024: 6; 2025: 4; 2026: 2.
26 papers.
Sort:
By area:
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2022DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via A Structure-Specific Generative Methodcited by 17
- 2022MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRIcited by 15
- 20234D Myocardium Reconstruction with Decoupled Motion and Shape Modelcited by 15
- 2023DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learningcited by 14
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2022Mesh-based 3D Motion Tracking in Cardiac MRI using Deep Learningcited by 9
- 2022PC-SwinMorph: Patch Representation for Unsupervised Medical Image Registration and Segmentationcited by 8
- 2024Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Codingcited by 5
- 2023DRIMET: Deep Registration for 3D Incompressible Motion Estimation in Tagged-MRI with Application to the Tonguecited by 2
14 more
- 2023MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correctioncited by 2
- 2024Is Registering Raw Tagged-MR Enough for Strain Estimation in the Era of Deep Learning?cited by 2
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentationcited by 2
- 2025Implicit Neural Representations of Intramyocardial Motion and Straincited by 2
- 2022Collaborative Quantization Embeddings for Intra-Subject Prostate MR Image Registrationcited by 1
- 2023Deep learning in medical image registration: introduction and surveycited by 1
- 2024Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRIcited by 1
- 2025Brightness-Invariant Tracking Estimation in Tagged MRIcited by 1
- 2025Dyna3DGR: 4D Cardiac Motion Tracking with Dynamic 3D Gaussian Representationcited by 1
- 2023LSDM: Long-Short Diffeomorphic Motion for Weakly-Supervised Ultrasound Landmark Trackingcited by 0
- 2024Efficient Brain Imaging Analysis for Alzheimer's and Dementia Detection Using Convolution-Derivative Operationscited by 0
- 2025MCM: Mamba-based Cardiac Motion Tracking using Sequential Images in MRIcited by 0
- 2026Solving a Nonlinear Blind Inverse Problem for Tagged MRI with Physics and Deep Generative Priorscited by 0
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesiscited by 0
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026Solving a Nonlinear Blind Inverse Problem for Tagged MRI with Physics and Deep Generative Priors1 Mar 2026
- 2025Implicit Neural Representations of Intramyocardial Motion and Strain10 Sep 2025
- 2025MCM: Mamba-based Cardiac Motion Tracking using Sequential Images in MRI23 Jul 2025
- 2025Dyna3DGR: 4D Cardiac Motion Tracking with Dynamic 3D Gaussian Representation22 Jul 2025
- 2025Brightness-Invariant Tracking Estimation in Tagged MRI23 May 2025
- 2024Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI21 Nov 2024
- 2024Efficient Brain Imaging Analysis for Alzheimer's and Dementia Detection Using Convolution-Derivative Operations20 Nov 2024
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation30 Oct 2024
- 2024Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Coding28 Oct 2024
- 2024Local Feature Matching Using Deep Learning: A Survey31 Jan 2024
- 2024Is Registering Raw Tagged-MR Enough for Strain Estimation in the Era of Deep Learning?31 Jan 2024
14 more
- 2023DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning25 Sep 2023
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Image22 Sep 2023
- 2023Deep learning in medical image registration: introduction and survey1 Sep 2023
- 20234D Myocardium Reconstruction with Decoupled Motion and Shape Model27 Aug 2023
- 2023MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correction5 Aug 2023
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond28 Jul 2023
- 2023DRIMET: Deep Registration for 3D Incompressible Motion Estimation in Tagged-MRI with Application to the Tongue18 Jan 2023
- 2023LSDM: Long-Short Diffeomorphic Motion for Weakly-Supervised Ultrasound Landmark Tracking11 Jan 2023
- 2022Mesh-based 3D Motion Tracking in Cardiac MRI using Deep Learning5 Sep 2022
- 2022MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRI29 Jul 2022
- 2022Collaborative Quantization Embeddings for Intra-Subject Prostate MR Image Registration13 Jul 2022
- 2022DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via A Structure-Specific Generative Method14 Jun 2022
- 2022PC-SwinMorph: Patch Representation for Unsupervised Medical Image Registration and Segmentation10 Mar 2022
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusion25 Sep 2021
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2022DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via A Structure-Specific Generative Methodcited by 17
- 2022MulViMotion: Shape-aware 3D Myocardial Motion Tracking from Multi-View Cardiac MRIcited by 15
- 20234D Myocardium Reconstruction with Decoupled Motion and Shape Modelcited by 15
- 2023DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learningcited by 14
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 11
- 2022Mesh-based 3D Motion Tracking in Cardiac MRI using Deep Learningcited by 9
- 2022PC-SwinMorph: Patch Representation for Unsupervised Medical Image Registration and Segmentationcited by 8
- 2024Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Codingcited by 5
- 2023DRIMET: Deep Registration for 3D Incompressible Motion Estimation in Tagged-MRI with Application to the Tonguecited by 2
12 most cited of 25 All 25 (JSON)
- 2026Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis20 Aug 2026
- 2026Solving a Nonlinear Blind Inverse Problem for Tagged MRI with Physics and Deep Generative Priors1 Mar 2026
- 2025Implicit Neural Representations of Intramyocardial Motion and Strain10 Sep 2025
- 2025Dyna3DGR: 4D Cardiac Motion Tracking with Dynamic 3D Gaussian Representation22 Jul 2025
- 2025Brightness-Invariant Tracking Estimation in Tagged MRI23 May 2025
- 2024Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI21 Nov 2024
- 2024Efficient Brain Imaging Analysis for Alzheimer's and Dementia Detection Using Convolution-Derivative Operations20 Nov 2024
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation30 Oct 2024
- 2024Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Coding28 Oct 2024
- 2024Local Feature Matching Using Deep Learning: A Survey31 Jan 2024
- 2024Is Registering Raw Tagged-MR Enough for Strain Estimation in the Era of Deep Learning?31 Jan 2024
- 2023DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning25 Sep 2023
12 newest of 25 All 25 (JSON)