# Ultrasound Speckle Suppression and Denoising using MRI-derived Normalizing Flow Priors

arXiv: https://arxiv.org/abs/2112.13110 · HTML: https://mlsanity.com/paper/2112.13110/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 41 references that are in the map.
- First posted on arXiv 24 Dec 2021.

## Builds on (most cited first, 16 of 16)

- [Density estimation using Real NVP](https://mlsanity.com/paper/1605.08803/) (2016)
- [Glow: Generative Flow with Invertible 1x1 Convolutions](https://mlsanity.com/paper/1807.03039/) (2018)
- [NICE: Non-linear Independent Components Estimation](https://mlsanity.com/paper/1410.8516/) (2014)
- [Training Deep Nets with Sublinear Memory Cost](https://mlsanity.com/paper/1604.06174/) (2016)
- [Masked Autoregressive Flow for Density Estimation](https://mlsanity.com/paper/1705.07057/) (2017)
- [fastMRI: An Open Dataset and Benchmarks for Accelerated MRI](https://mlsanity.com/paper/1811.08839/) (2018)
- [Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing](https://mlsanity.com/paper/1912.10557/) (2019)
- [Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Design](https://mlsanity.com/paper/1902.00275/) (2019)
- [Invertible generative models for inverse problems: mitigating representation error and dataset bias](https://mlsanity.com/paper/1905.11672/) (2019)
- [Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasound](https://mlsanity.com/paper/1811.08252/) (2018)
- [Deep learning in ultrasound imaging](https://mlsanity.com/paper/1907.02994/) (2019)
- [Deep Unfolding with Normalizing Flow Priors for Inverse Problems](https://mlsanity.com/paper/2107.02848/) (2021)
- [Adaptive Ultrasound Beamforming using Deep Learning](https://mlsanity.com/paper/1909.10342/) (2019)
- [Learning Sub-Sampling and Signal Recovery with Applications in Ultrasound Imaging](https://mlsanity.com/paper/1908.05764/) (2019)
- [Towards CT-quality Ultrasound Imaging using Deep Learning](https://mlsanity.com/paper/1710.06304/) (2017)
- [Domain Adaptation for Ultrasound Beamforming](https://mlsanity.com/paper/2007.03096/) (2020)

## Built on by (most cited first, 4 of 4)

- [Diffusion Models for Medical Image Analysis: A Comprehensive Survey](https://mlsanity.com/paper/2211.07804/) (2022)
- [Dehazing Ultrasound using Diffusion Models](https://mlsanity.com/paper/2307.11204/) (2023)
- [Diffusion as Sound Propagation: Physics-inspired Model for Ultrasound Image Generation](https://mlsanity.com/paper/2407.05428/) (2024)
- [Ultrasound Signal Processing: From Models to Deep Learning](https://mlsanity.com/paper/2204.04466/) (2022)

## Abstract (arXiv)

Ultrasonography offers an inexpensive, widely-accessible and compact medical imaging solution. However, compared to other imaging modalities such as CT and MRI, ultrasound images notoriously suffer from strong speckle noise, which originates from the random interference of sub-wavelength scattering. This deteriorates ultrasound image quality and makes interpretation challenging. We here propose a new unsupervised ultrasound speckle reduction and image denoising method based on maximum-a-posteriori estimation with deep generative priors that are learned from high-quality MRI images. To model the generative tissue reflectivity prior, we exploit normalizing flows, which in recent years have shown to be very powerful in modeling signal priors across a variety of applications. To facilitate generaliation, we factorize the prior and train our flow model on patches from the NYU fastMRI (fully-sampled) dataset. This prior is then used for inference in an iterative denoising scheme. We first validate the utility of our learned priors on noisy MRI data (no prior domain shift), and then turn to evaluating performance on both simulated and in-vivo ultrasound images from the PICMUS and CUBDL datasets. The results show that the method outperforms other (unsupervised) ultrasound denoising methods (NLM and OBNLM) both quantitatively and qualitatively.
