# From Denoising to Compressed Sensing

arXiv: https://arxiv.org/abs/1406.4175 · HTML: https://mlsanity.com/paper/1406.4175/

## Key facts

- Cited by 68 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Jun 2014.

## Built on by (most cited first, 30 of 68)

- [Bayesian imaging using Plug & Play priors: when Langevin meets Tweedie](https://mlsanity.com/paper/2103.04715/) (2021)
- [Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --](https://mlsanity.com/paper/2301.03362/) (2023)
- [Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurements](https://mlsanity.com/paper/2111.12855/) (2021)
- [Provable Probabilistic Imaging using Score-Based Generative Priors](https://mlsanity.com/paper/2310.10835/) (2023)
- [ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensing](https://mlsanity.com/paper/2103.11554/) (2021)
- [Memory-Augmented Deep Unfolding Network for Compressive Sensing](https://mlsanity.com/paper/2110.09766/) (2021)
- [EfficientFi: Towards Large-Scale Lightweight WiFi Sensing via CSI Compression](https://mlsanity.com/paper/2204.04138/) (2022)
- [COAST: COntrollable Arbitrary-Sampling NeTwork for Compressive Sensing](https://mlsanity.com/paper/2107.07225/) (2021)
- [Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Data](https://mlsanity.com/paper/2403.08728/) (2024)
- [Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems](https://mlsanity.com/paper/2112.10948/) (2021)
- [Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue Condition](https://mlsanity.com/paper/2106.03668/) (2021)
- [Theoretical Perspectives on Deep Learning Methods in Inverse Problems](https://mlsanity.com/paper/2206.14373/) (2022)
- [Content-aware Scalable Deep Compressed Sensing](https://mlsanity.com/paper/2207.09313/) (2022)
- [Lexico: Extreme KV Cache Compression via Sparse Coding over Universal Dictionaries](https://mlsanity.com/paper/2412.08890/) (2024)
- [Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensing](https://mlsanity.com/paper/2306.16060/) (2023)
- [CSformer: Bridging Convolution and Transformer for Compressive Sensing](https://mlsanity.com/paper/2112.15299/) (2021)
- [Optimization-Inspired Cross-Attention Transformer for Compressive Sensing](https://mlsanity.com/paper/2304.13986/) (2023)
- [Object Segmentation by Mining Cross-Modal Semantics](https://mlsanity.com/paper/2305.10469/) (2023)
- [Neural Implicit Dictionary via Mixture-of-Expert Training](https://mlsanity.com/paper/2207.03691/) (2022)
- [Image Restoration by Deep Projected GSURE](https://mlsanity.com/paper/2102.02485/) (2021)
- [Deep Model-Based Architectures for Inverse Problems under Mismatched Priors](https://mlsanity.com/paper/2207.13200/) (2022)
- [Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel Imaging](https://mlsanity.com/paper/2505.23180/) (2025)
- [Dual-Scale Transformer for Large-Scale Single-Pixel Imaging](https://mlsanity.com/paper/2404.05001/) (2024)
- [LADMM-Net: An Unrolled Deep Network For Spectral Image Fusion From Compressive Data](https://mlsanity.com/paper/2103.00940/) (2021)
- [An Interpretable MRI Reconstruction Network with Two-grid-cycle Correction and Geometric Prior Distillation](https://mlsanity.com/paper/2205.07062/) (2022)
- [Fast Hierarchical Deep Unfolding Network for Image Compressed Sensing](https://mlsanity.com/paper/2208.01827/) (2022)
- [Deep Unfolding Network for Image Compressed Sensing by Content-adaptive Gradient Updating and Deformation-invariant Non-local Modeling](https://mlsanity.com/paper/2310.10033/) (2023)
- [Dynamic Proximal Unrolling Network for Compressive Imaging](https://mlsanity.com/paper/2107.11007/) (2021)
- [Generalized Tensor Summation Compressive Sensing Network (GTSNET): An Easy to Learn Compressive Sensing Operation](https://mlsanity.com/paper/2108.03167/) (2021)
- [SUD2: Supervision by Denoising Diffusion Models for Image Reconstruction](https://mlsanity.com/paper/2303.09642/) (2023)

## Abstract (arXiv)

A denoising algorithm seeks to remove noise, errors, or perturbations from a signal. Extensive research has been devoted to this arena over the last several decades, and as a result, today's denoisers can effectively remove large amounts of additive white Gaussian noise. A compressed sensing (CS) reconstruction algorithm seeks to recover a structured signal acquired using a small number of randomized measurements. Typical CS reconstruction algorithms can be cast as iteratively estimating a signal from a perturbed observation. This paper answers a natural question: How can one effectively employ a generic denoiser in a CS reconstruction algorithm? In response, we develop an extension of the approximate message passing (AMP) framework, called Denoising-based AMP (D-AMP), that can integrate a wide class of denoisers within its iterations. We demonstrate that, when used with a high performance denoiser for natural images, D-AMP offers state-of-the-art CS recovery performance while operating tens of times faster than competing methods. We explain the exceptional performance of D-AMP by analyzing some of its theoretical features. A key element in D-AMP is the use of an appropriate Onsager correction term in its iterations, which coerces the signal perturbation at each iteration to be very close to the white Gaussian noise that denoisers are typically designed to remove.
