Video Restoration with a Deep Plug-and-Play Prior
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of the prior in an alternating optimization scheme. We distinguish ourselves from prior PnP work by directly applying that method to restore a digital video from a degraded video observation. This way, a network trained once for denoising can be repurposed for other video restoration tasks. Our experiments in video deblurring, super-resolution, and interpolation of random missing pixels all show a clear benefit to using a network specifically designed for video denoising, as it yields better restoration performance and better temporal stability than a single image network with similar denoising performance using the same PnP formulation. Moreover, our method compares favorably to applying a different state-of-the-art PnP scheme separately on each frame of the sequence. This opens new perspectives in the field of video restoration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 58 references that are in the map. First posted on arXiv 6 Sep 2022.
Builds on
28 of 58 references.
References · 28
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
16 more
- 2019FastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimationcited by 128
- 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2019Robust and interpretable blind image denoising via bias-free convolutional neural networkscited by 87
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
- 2017Unrolled Optimization with Deep Priorscited by 40
- 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
- 2020Depth image denoising using nuclear norm and learning graph modelcited by 20
- 2015Poisson Inverse Problems by the Plug-and-Play schemecited by 17
- 2022On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descentcited by 14
- 2020Plug-and-play ISTA converges with kernel denoiserscited by 12
- 2019Neumann Networks for Inverse Problems in Imagingcited by 9
- 2015Postprocessing of Compressed Images via Sequential Denoisingcited by 8
Built on by
Citing papers per year: 2025: 1.
1 paper.