mlsanityData to 7 Oct 2026

Deep End-to-end Adaptive k-Space Sampling, Reconstruction, and Registration for Dynamic MRI

arXiv 2411.18249 ↗First posted 27 Nov 2024eess.IV cs.CV physics.med-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Dynamic MRI enables a range of clinical applications, including cardiac function assessment, organ motion tracking, and radiotherapy guidance. However, fully sampling the dynamic k-space data is often infeasible due to time constraints and physiological motion such as respiratory and cardiac motion. This necessitates undersampling, which degrades the quality of reconstructed images. Poor image quality not only hinders visualization but also impairs the estimation of deformation fields, crucial for registering dynamic (moving) images to a static reference image. This registration enables tasks such as motion correction, treatment planning, and quantitative analysis in applications like cardiac imaging and MR-guided radiotherapy. To overcome the challenges posed by undersampling and motion, we introduce an end-to-end deep learning (DL) framework that integrates adaptive dynamic k-space sampling, reconstruction, and registration. Our approach begins with a DL-based adaptive sampling strategy, optimizing dynamic k-space acquisition to capture the most relevant data for each specific case. This is followed by a DL-based reconstruction module that produces images optimized for accurate deformation field estimation from the undersampled moving data. Finally, a registration module estimates the deformation fields aligning the reconstructed dynamic images with a static reference. The proposed framework is independent of specific reconstruction and registration modules allowing for plug-and-play integration of these components. The entire framework is jointly trained using a combination of supervised and unsupervised loss functions, enabling end-to-end optimization for improved performance across all components. Through controlled experiments and ablation studies, we validate each component, demonstrating that each choice contributes to robust motion estimation from undersampled dynamic data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

33 of 69 references.

References · 33

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  5. 2015Spatial Transformer Networkscited by 1,423
  6. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  7. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
  8. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  9. 2017Learned Primal-dual Reconstructioncited by 251
  10. 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
  11. 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
  12. 2020Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challengecited by 59
21 more
  1. 2021AI-based Reconstruction for Fast MRI -- A Systematic Review and Meta-analysiscited by 38
  2. 2021Recurrent Variational Network: A Deep Learning Inverse Problem Solver applied to the task of Accelerated MRI Reconstructioncited by 34
  3. 2019Learning-based Optimization of the Under-sampling Pattern in MRIcited by 32
  4. 2020Extending LOUPE for K-space Under-sampling Pattern Optimization in Multi-coil MRIcited by 22
  5. 2023CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstructioncited by 20
  6. 2022Medical Image Registration via Neural Fieldscited by 19
  7. 2020Multi-Coil MRI Reconstruction Challenge -- Assessing Brain MRI Reconstruction Models and their Generalizability to Varying Coil Configurationscited by 18
  8. 2019Self-Supervised Physics-Based Deep Learning MRI Reconstruction Without Fully-Sampled Datacited by 17
  9. 2024The state-of-the-art in Cardiac MRI Reconstruction: Results of the CMRxRecon Challenge in MICCAI 2023cited by 15
  10. 2022On learning adaptive acquisition policies for undersampled multi-coil MRI reconstructioncited by 14
  11. 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
  12. 2023On Retrospective k-space Subsampling schemes For Deep MRI Reconstructioncited by 12
  13. 2023vSHARP: variable Splitting Half-quadratic Admm algorithm for Reconstruction of inverse-Problemscited by 8
  14. 2018Enhancing Label-Driven Deep Deformable Image Registration with Local Distance Metrics for State-of-the-Art Cardiac Motion Trackingcited by 7
  15. 2023Deep Cardiac MRI Reconstruction with ADMMcited by 6
  16. 2024CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRIcited by 6
  17. 2019Variational Multi-Task MRI Reconstruction: Joint Reconstruction, Registration and Super-Resolutioncited by 5
  18. 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
  19. 2024Deep Multi-contrast Cardiac MRI Reconstruction via vSHARP with Auxiliary Refinement Networkcited by 3
  20. 2024End-to-end Adaptive Dynamic Subsampling and Reconstruction for Cardiac MRIcited by 2
  21. 2023Patient-Adaptive and Learned MRI Data Undersampling Using Neighborhood Clusteringcited by 1

Built on by

Not cited yet.