# Onsager-corrected deep learning for sparse linear inverse problems

arXiv: https://arxiv.org/abs/1607.05966 · HTML: https://mlsanity.com/paper/1607.05966/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Jul 2016.

## Built on by (most cited first, 8 of 8)

- [Learning to Optimize: A Primer and A Benchmark](https://mlsanity.com/paper/2103.12828/) (2021)
- [Towards Understanding Graph Neural Networks: An Algorithm Unrolling Perspective](https://mlsanity.com/paper/2206.04471/) (2022)
- [Operational Support Estimator Networks](https://mlsanity.com/paper/2307.06065/) (2023)
- [Time-Embedded Algorithm Unrolling for Computational MRI](https://mlsanity.com/paper/2510.16321/) (2025)
- [A Design Space Study for LISTA and Beyond](https://mlsanity.com/paper/2104.04110/) (2021)
- [Unrolled denoising networks provably learn optimal Bayesian inference](https://mlsanity.com/paper/2409.12947/) (2024)
- [Stability Bounds for the Unfolded Forward-Backward Algorithm](https://mlsanity.com/paper/2412.17888/) (2024)
- [Training Channel Selection for Learning-based 1-bit Precoding in Massive MU-MIMO](https://mlsanity.com/paper/2502.11653/) (2025)

## Abstract (arXiv)

Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to recover a sparse signal from a small number of noisy linear measurements. In this paper, we propose a novel neural-network architecture that decouples prediction errors across layers in the same way that the approximate message passing (AMP) algorithm decouples them across iterations: through Onsager correction. Numerical experiments suggest that our "learned AMP" network significantly improves upon Gregor and LeCun's "learned ISTA" network in both accuracy and complexity.
