An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset
Not on the map. Why?
Abstract (arXiv)
Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns the regularization function in a variational model and reconstructs MR images with various under-sampling ratios or patterns that may or may not be seen in the training data by leveraging a heterogeneous dataset. Methods: We propose an unrolling network induced by learnable optimization algorithms (LOA) for solving our nonconvex nonsmooth variational model for MRI reconstruction. In this model, the learnable regularization function contains a task-invariant common feature encoder and task-specific learner represented by a shallow network. To train the network we split the training data into two parts: training and validation, and introduce a bilevel optimization algorithm. The lower-level optimization trains task-invariant parameters for the feature encoder with fixed parameters of the task-specific learner on the training dataset, and the upper-level optimizes the parameters of the task-specific learner on the validation dataset. Results: The average PSNR increases significantly compared to the network trained through conventional supervised learning on the seen CS ratios. We test the result of quick adaption on the unseen tasks after meta-training and in the meanwhile saving half of the training time; Conclusion: We proposed a meta-learning framework consisting of the base network architecture, design of regularization, and bi-level optimization-based training. The network inherits the convergence property of the LOA and interpretation of the variational model. The generalization ability is improved by the designated regularization and bilevel optimization-based training algorithm.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 42 of its 74 references that are in the map. First posted on arXiv 2 Oct 2021.
Builds on
42 of 74 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2014Neural Turing Machinescited by 644
- 2017Learning multiple visual domains with residual adapterscited by 557
30 more
- 2019Meta-Learning with Implicit Gradientscited by 525
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 387
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 379
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 342
- 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 315
- 2018How to train your MAMLcited by 309
- 2017Meta Networkscited by 269
- 2018Probabilistic Model-Agnostic Meta-Learningcited by 256
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 232
- 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 231
- 2018Bayesian Model-Agnostic Meta-Learningcited by 194
- 2018Recasting Gradient-Based Meta-Learning as Hierarchical Bayescited by 180
- 2018An overview of deep learning in medical imaging focusing on MRIcited by 140
- 2019Online Meta-Learningcited by 137
- 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
- 2017Few-Shot Image Recognition by Predicting Parameters from Activationscited by 122
- 2019Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulationcited by 103
- 2020A Survey of Deep Meta-Learningcited by 100
- 2019Meta-Learning without Memorizationcited by 92
- 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
- 2019Hierarchically Structured Meta-learningcited by 68
- 2020Improving Generalization in Meta-learning via Task Augmentationcited by 55
- 2018Deep Bilevel Learningcited by 49
- 2013Challenges of Big Data Analysiscited by 47
- 2019Penalty Method for Inversion-Free Deep Bilevel Optimizationcited by 33
- 2020Automated Relational Meta-learningcited by 25
- 2019Model Learning: Primal Dual Networks for Fast MR imagingcited by 22
- 2020Learnable Descent Algorithm for Nonsmooth Nonconvex Image Reconstructioncited by 15
- 2020Deep Parallel MRI Reconstruction Network Without Coil Sensitivitiescited by 7
Built on by
Citing papers per year: 2022: 4; 2023: 1; 2024: 10; 2025: 2; 2026: 1.
18 papers.
Sort:
- 2024Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approachcited by 24
- 2022A Learnable Variational Model for Joint Multimodal MRI Reconstruction and Synthesiscited by 16
- 2022An Accelerated Doubly Stochastic Gradient Method with Faster Explicit Model Identificationcited by 14
- 2024Application of Multimodal Fusion Deep Learning Model in Disease Recognitioncited by 12
- 2024Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Datacited by 11
- 2024Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Datacited by 11
- 2024Style Transfer: From Stitching to Neural Networkscited by 8
- 2024Multi-task Magnetic Resonance Imaging Reconstruction using Meta-learningcited by 7
- 2022CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoisercited by 6
- 2024Investigation of Customized Medical Decision Algorithms Utilizing Graph Neural Networkscited by 5
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanismscited by 4
- 2023Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentationcited by 3
6 more
- 2024A Brief Overview of Optimization-Based Algorithms for MRI Reconstruction Using Deep Learningcited by 3
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Modelscited by 2
- 2022Distributed Dynamic Safe Screening Algorithms for Sparse Regularizationcited by 1
- 2025Learning to Borrow Features for Improved Detection of Small Objects in Single-Shot Detectorscited by 0
- 2025Deep Unrolled Meta-Learning for Multi-Coil and Multi-Modality MRI with Adaptive Optimizationcited by 0
- 2026Transferable Optimization Network for Cross-Domain Image Reconstructioncited by 0
- 2026Transferable Optimization Network for Cross-Domain Image Reconstruction8 Mar 2026
- 2025Deep Unrolled Meta-Learning for Multi-Coil and Multi-Modality MRI with Adaptive Optimization8 May 2025
- 2025Learning to Borrow Features for Improved Detection of Small Objects in Single-Shot Detectors30 Apr 2025
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models25 Oct 2024
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanisms12 Sep 2024
- 2024Style Transfer: From Stitching to Neural Networks1 Sep 2024
- 2024Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approach13 Aug 2024
- 2024A Brief Overview of Optimization-Based Algorithms for MRI Reconstruction Using Deep Learning3 Jun 2024
- 2024Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Data23 May 2024
- 2024Investigation of Customized Medical Decision Algorithms Utilizing Graph Neural Networks23 May 2024
- 2024Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data22 May 2024
- 2024Application of Multimodal Fusion Deep Learning Model in Disease Recognition22 May 2024
6 more
- 2024Multi-task Magnetic Resonance Imaging Reconstruction using Meta-learning29 Mar 2024
- 2023Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentation6 Feb 2023
- 2022CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser14 Nov 2022
- 2022An Accelerated Doubly Stochastic Gradient Method with Faster Explicit Model Identification11 Aug 2022
- 2022Distributed Dynamic Safe Screening Algorithms for Sparse Regularization23 Apr 2022
- 2022A Learnable Variational Model for Joint Multimodal MRI Reconstruction and Synthesis8 Apr 2022
- 2024Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approachcited by 24
- 2022A Learnable Variational Model for Joint Multimodal MRI Reconstruction and Synthesiscited by 16
- 2022An Accelerated Doubly Stochastic Gradient Method with Faster Explicit Model Identificationcited by 14
- 2024Application of Multimodal Fusion Deep Learning Model in Disease Recognitioncited by 12
- 2024Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Datacited by 11
- 2024Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Datacited by 11
- 2024Style Transfer: From Stitching to Neural Networkscited by 8
- 2024Multi-task Magnetic Resonance Imaging Reconstruction using Meta-learningcited by 7
- 2022CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoisercited by 6
- 2024Investigation of Customized Medical Decision Algorithms Utilizing Graph Neural Networkscited by 5
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanismscited by 4
- 2023Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentationcited by 3
12 most cited of 18 All 18 (JSON)
- 2026Transferable Optimization Network for Cross-Domain Image Reconstruction8 Mar 2026
- 2025Deep Unrolled Meta-Learning for Multi-Coil and Multi-Modality MRI with Adaptive Optimization8 May 2025
- 2025Learning to Borrow Features for Improved Detection of Small Objects in Single-Shot Detectors30 Apr 2025
- 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models25 Oct 2024
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanisms12 Sep 2024
- 2024Style Transfer: From Stitching to Neural Networks1 Sep 2024
- 2024Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approach13 Aug 2024
- 2024A Brief Overview of Optimization-Based Algorithms for MRI Reconstruction Using Deep Learning3 Jun 2024
- 2024Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Data23 May 2024
- 2024Investigation of Customized Medical Decision Algorithms Utilizing Graph Neural Networks23 May 2024
- 2024Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data22 May 2024
- 2024Application of Multimodal Fusion Deep Learning Model in Disease Recognition22 May 2024
12 newest of 18 All 18 (JSON)