Flow-based Visual Quality Enhancer for Super-resolution Magnetic Resonance Spectroscopic Imaging
Not on the map. Why?
Abstract (arXiv)
Magnetic Resonance Spectroscopic Imaging (MRSI) is an essential tool for quantifying metabolites in the body, but the low spatial resolution limits its clinical applications. Deep learning-based super-resolution methods provided promising results for improving the spatial resolution of MRSI, but the super-resolved images are often blurry compared to the experimentally-acquired high-resolution images. Attempts have been made with the generative adversarial networks to improve the image visual quality. In this work, we consider another type of generative model, the flow-based model, of which the training is more stable and interpretable compared to the adversarial networks. Specifically, we propose a flow-based enhancer network to improve the visual quality of super-resolution MRSI. Different from previous flow-based models, our enhancer network incorporates anatomical information from additional image modalities (MRI) and uses a learnable base distribution. In addition, we impose a guide loss and a data-consistency loss to encourage the network to generate images with high visual quality while maintaining high fidelity. Experiments on a 1H-MRSI dataset acquired from 25 high-grade glioma patients indicate that our enhancer network outperforms the adversarial networks and the baseline flow-based methods. Our method also allows visual quality adjustment and uncertainty estimation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 20 Jul 2022.
Builds on
20 of 34 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2017The Perception-Distortion Tradeoffcited by 587
- 2019Deep Learning for Image Super-resolution: A Surveycited by 369
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2019Learning Likelihoods with Conditional Normalizing Flowscited by 172
8 more
- 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
- 2020Solving inverse problems using conditional invertible neural networkscited by 37
- 2021Best-Buddy GANs for Highly Detailed Image Super-Resolutioncited by 30
- 2020Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstructioncited by 19
- 2021Conditional Invertible Neural Networks for Medical Imagingcited by 19
- 2018Dense Multi-path U-Net for Ischemic Stroke Lesion Segmentation in Multiple Image Modalitiescited by 13
- 2022Invertible Sharpening Network for MRI Reconstruction Enhancementcited by 5
- 2022Multi-scale Super-resolution Magnetic Resonance Spectroscopic Imaging with Adjustable Sharpnesscited by 4
Built on by
Citing papers per year: 2024: 2.
2 papers.