Cram'er-Rao bound-informed training of neural networks for quantitative MRI
Not on the map. Why?
Abstract (arXiv)
Neural networks are increasingly used to estimate parameters in quantitative MRI, in particular in magnetic resonance fingerprinting. Their advantages over the gold standard non-linear least square fitting are their superior speed and their immunity to the non-convexity of many fitting problems. We find, however, that in heterogeneous parameter spaces, i.e. in spaces in which the variance of the estimated parameters varies considerably, good performance is hard to achieve and requires arduous tweaking of the loss function, hyper parameters, and the distribution of the training data in parameter space. Here, we address these issues with a theoretically well-founded loss function: the Cram'er-Rao bound (CRB) provides a theoretical lower bound for the variance of an unbiased estimator and we propose to normalize the squared error with respective CRB. With this normalization, we balance the contributions of hard-to-estimate and not-so-hard-to-estimate parameters and areas in parameter space, and avoid a dominance of the former in the overall training loss. Further, the CRB-based loss function equals one for a maximally-efficient unbiased estimator, which we consider the ideal estimator. Hence, the proposed CRB-based loss function provides an absolute evaluation metric. We compare a network trained with the CRB-based loss with a network trained with the commonly used means squared error loss and demonstrate the advantages of the former in numerical, phantom, and in vivo experiments.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 58 references that are in the map. First posted on arXiv 22 Sep 2021.
Builds on
12 of 58 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Group Normalizationcited by 1,514
- 2017Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Datacited by 33
- 2017Better than Real: Complex-valued Neural Nets for MRI Fingerprintingcited by 30
- 2017MR fingerprinting Deep RecOnstruction NEtwork (DRONE)cited by 27
- 2018Magnetic Resonance Fingerprinting using Recurrent Neural Networkscited by 7
- 2018Geometry of Deep Learning for Magnetic Resonance Fingerprintingcited by 6
- 2020Rapid three-dimensional multiparametric MRI with quantitative transient-state imagingcited by 5
- 2018Magnetic Resonance Fingerprinting Reconstruction via Spatiotemporal Convolutional Neural Networkscited by 4
- 2019HYDRA: Hybrid Deep Magnetic Resonance Fingerprintingcited by 2
- 2017Dictionary-Free MRI PERK: Parameter Estimation via Regression with Kernelscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 1.
3 papers.