Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
Not on the map. Why?
Abstract (arXiv)
Many material and biological samples in scientific imaging are characterized by non-local repeating structures. These are studied using scanning electron microscopy and electron tomography. Sparse sampling of individual pixels in a 2D image acquisition geometry, or sparse sampling of projection images with large tilt increments in a tomography experiment, can enable high speed data acquisition and minimize sample damage caused by the electron beam. In this paper, we present an algorithm for electron tomographic reconstruction and sparse image interpolation that exploits the non-local redundancy in images. We adapt a framework, termed plug-and-play (P&P) priors, to solve these imaging problems in a regularized inversion setting. The power of the P&P approach is that it allows a wide array of modern denoising algorithms to be used as a "prior model" for tomography and image interpolation. We also present sufficient mathematical conditions that ensure convergence of the P&P approach, and we use these insights to design a new non-local means denoising algorithm. Finally, we demonstrate that the algorithm produces higher quality reconstructions on both simulated and real electron microscope data, along with improved convergence properties compared to other methods.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 18; 2023: 17; 2024: 12; 2025: 8; 2026: 7.
78 papers.
Sort:
By area:
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2024A Survey on Diffusion Models for Inverse Problemscited by 173
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstructioncited by 73
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fieldscited by 48
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
- 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
38 more
- 2024Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learningcited by 35
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2023Generative Plug and Play: Posterior Sampling for Inverse Problemscited by 24
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2021Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue Conditioncited by 22
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
- 2021SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guaranteescited by 18
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2022Approximation of Lipschitz Functions using Deep Spline Neural Networkscited by 15
- 2023Provably Convergent Plug-and-Play Quasi-Newton Methodscited by 15
- 2022On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descentcited by 14
- 2021Graph Signal Restoration Using Nested Deep Algorithm Unrollingcited by 13
- 2021Wasserstein Patch Prior for Image Superresolutioncited by 13
- 2023Designing Stable Neural Networks using Convex Analysis and ODEscited by 10
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysiscited by 10
- 2021Deformation-Compensated Learning for Image Reconstruction without Ground Truthcited by 9
- 2022Deep Model-Based Architectures for Inverse Problems under Mismatched Priorscited by 8
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
- 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problemscited by 8
- 2022PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descentcited by 7
- 2022CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoisercited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2022Deep Equilibrium Models for Video Snapshot Compressive Imagingcited by 5
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mappingcited by 5
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
- 2025MAP Estimation with Denoisers: Convergence Rates and Guaranteescited by 5
- 2022PAC-Bayesian Learning of Optimization Algorithmscited by 4
- 2022Tuning-free Plug-and-Play Hyperspectral Image Deconvolution with Deep Priorscited by 4
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problemscited by 4
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIMcited by 4
- 2022Bregman Plug-and-Play Priorscited by 3
- 2022Supervision by Denoising for Medical Image Segmentationcited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2023Convergence of Nonconvex PnP-ADMM with MMSE Denoiserscited by 3
50 most cited of 78 All 78 (JSON)
- 2026Quantum-Inspired Trainable and Parameter-Efficient Tensor Networks for Image Inpainting15 Sep 2026
- 2026Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion30 Aug 2026
- 2026ScoreField: Neural Inverse Scattering with Score-Based Generative Priors3 Aug 2026
- 2026Trainable Nonexpansive Denoisers for Contractive Image Reconstruction25 Jul 2026
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIM21 Jul 2026
- 2026h-control: Training-Free Camera Control via Block-Conditional Gibbs Refinement12 May 2026
- 2025Diffusion Model Based Signal Recovery Under 1-Bit Quantization16 Nov 2025
- 2025MAP Estimation with Denoisers: Convergence Rates and Guarantees21 Jul 2025
- 2025Moir'eXNet: Adaptive Multi-Scale Demoir'eing with Linear Attention Test-Time Training and Truncated Flow Matching Prior19 Jun 2025
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problems28 May 2025
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problems13 May 2025
38 more
- 2025RELD: Regularization by Latent Diffusion Models for Image Restoration28 Mar 2025
- 2025Radio Map Estimation via Latent Domain Plug-and-Play Denoising23 Jan 2025
- 2025Self-supervised Deep Hyperspectral Inpainting with the Plug and Play and Deep Image Prior Models14 Jan 2025
- 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problems15 Oct 2024
- 2024Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method15 Oct 2024
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imaging10 Oct 2024
- 2024A Generalization Result for Convergence in Learning-to-Optimize10 Oct 2024
- 2024A Survey on Diffusion Models for Inverse Problems30 Sep 2024
- 2024Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning10 Sep 2024
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration18 Jul 2024
- 2024Plug-and-Play Algorithm Convergence Analysis From The Standpoint of Stochastic Differential Equation22 Apr 2024
- 2024Overcoming Distribution Shifts in Plug-and-Play Methods with Test-Time Training15 Mar 2024
- 2024Learning pseudo-contractive denoisers for inverse problems8 Feb 2024
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularization1 Feb 2024
- 2024Low-resolution Prior Equilibrium Network for CT Reconstruction28 Jan 2024
- 2023An ℓ1-Plug-and-Play Approach for MPI Using a Zero Shot Denoiser with Evaluation on the 3D Open MPI Dataset30 Dec 2023
- 2023Convergence of Nonconvex PnP-ADMM with MMSE Denoisers30 Nov 2023
- 2023Efficient Model-Based Deep Learning via Network Pruning and Fine-Tuning3 Nov 2023
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parameter2 Nov 2023
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problems22 Oct 2023
- 2023Provable Probabilistic Imaging using Score-Based Generative Priors16 Oct 2023
- 2023How Much Training Data is Memorized in Overparameterized Autoencoders? An Inverse Problem Perspective on Memorization Evaluation4 Oct 2023
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis29 Sep 2023
- 2023On the Contractivity of Plug-and-Play Operators28 Sep 2023
- 2023Designing Stable Neural Networks using Convex Analysis and ODEs29 Jun 2023
- 2023Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations13 Jun 2023
- 2023Generative Plug and Play: Posterior Sampling for Inverse Problems12 Jun 2023
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problems22 May 2023
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Prior12 May 2023
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems17 Apr 2023
- 2023Provably Convergent Plug-and-Play Quasi-Newton Methods9 Mar 2023
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --9 Jan 2023
- 2022Tuning-free Plug-and-Play Hyperspectral Image Deconvolution with Deep Priors28 Nov 2022
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction22 Nov 2022
- 2022CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser14 Nov 2022
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions28 Oct 2022
- 2022PAC-Bayesian Learning of Optimization Algorithms20 Oct 2022
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mapping12 Oct 2022
50 newest of 78 All 78 (JSON)
- 2024A Survey on Diffusion Models for Inverse Problemscited by 173
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstructioncited by 73
- 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problemscited by 8
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIMcited by 4
- 2024Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Methodcited by 2
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problemscited by 2
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Priorcited by 1
- 2025Moir'eXNet: Adaptive Multi-Scale Demoir'eing with Linear Attention Test-Time Training and Truncated Flow Matching Priorcited by 1
- 2025Diffusion Model Based Signal Recovery Under 1-Bit Quantizationcited by 1
- 2025RELD: Regularization by Latent Diffusion Models for Image Restorationcited by 0
- 2026h-control: Training-Free Camera Control via Block-Conditional Gibbs Refinementcited by 0
- 2026Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusioncited by 0
- 2026Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion30 Aug 2026
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIM21 Jul 2026
- 2026h-control: Training-Free Camera Control via Block-Conditional Gibbs Refinement12 May 2026
- 2025Diffusion Model Based Signal Recovery Under 1-Bit Quantization16 Nov 2025
- 2025Moir'eXNet: Adaptive Multi-Scale Demoir'eing with Linear Attention Test-Time Training and Truncated Flow Matching Prior19 Jun 2025
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problems28 May 2025
- 2025RELD: Regularization by Latent Diffusion Models for Image Restoration28 Mar 2025
- 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problems15 Oct 2024
- 2024Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method15 Oct 2024
- 2024A Survey on Diffusion Models for Inverse Problems30 Sep 2024
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Prior12 May 2023
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction22 Nov 2022
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2023Image Denoising: The Deep Learning Revolution and Beyond -- A Survey Paper --cited by 71
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fieldscited by 48
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
- 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
- 2024Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learningcited by 35
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
12 most cited of 66 All 66 (JSON)
- 2026Quantum-Inspired Trainable and Parameter-Efficient Tensor Networks for Image Inpainting15 Sep 2026
- 2026ScoreField: Neural Inverse Scattering with Score-Based Generative Priors3 Aug 2026
- 2026Trainable Nonexpansive Denoisers for Contractive Image Reconstruction25 Jul 2026
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2025MAP Estimation with Denoisers: Convergence Rates and Guarantees21 Jul 2025
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problems13 May 2025
- 2025Radio Map Estimation via Latent Domain Plug-and-Play Denoising23 Jan 2025
- 2025Self-supervised Deep Hyperspectral Inpainting with the Plug and Play and Deep Image Prior Models14 Jan 2025
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imaging10 Oct 2024
- 2024A Generalization Result for Convergence in Learning-to-Optimize10 Oct 2024
- 2024Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning10 Sep 2024
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration18 Jul 2024
12 newest of 66 All 66 (JSON)