Learning to solve TV regularized problems with unrolled algorithms
Not on the map. Why?
Abstract (arXiv)
Total Variation (TV) is a popular regularization strategy that promotes piece-wise constant signals by constraining the ℓ1-norm of the first order derivative of the estimated signal. The resulting optimization problem is usually solved using iterative algorithms such as proximal gradient descent, primal-dual algorithms or ADMM. However, such methods can require a very large number of iterations to converge to a suitable solution. In this paper, we accelerate such iterative algorithms by unfolding proximal gradient descent solvers in order to learn their parameters for 1D TV regularized problems. While this could be done using the synthesis formulation, we demonstrate that this leads to slower performances. The main difficulty in applying such methods in the analysis formulation lies in proposing a way to compute the derivatives through the proximal operator. As our main contribution, we develop and characterize two approaches to do so, describe their benefits and limitations, and discuss the regime where they can actually improve over iterative procedures. We validate those findings with experiments on synthetic and real data.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 1; 2024: 3.
8 papers.
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2021Efficient and Modular Implicit Differentiationcited by 199
- 2021Implicit differentiation for fast hyperparameter selection in non-smooth convex learningcited by 22
- 2022Total Variation Optimization Layers for Computer Visioncited by 8
- 2023Deep Unrolling Networks with Recurrent Momentum Acceleration for Nonlinear Inverse Problemscited by 3
- 2024Non-Asymptotic Uncertainty Quantification in High-Dimensional Learningcited by 2
- 2024Double Momentum Method for Lower-Level Constrained Bilevel Optimizationcited by 0
- 2024Analysis and Synthesis Denoisers for Forward-Backward Plug-and-Play Algorithmscited by 0
- 2024Analysis and Synthesis Denoisers for Forward-Backward Plug-and-Play Algorithms20 Nov 2024
- 2024Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning18 Jul 2024
- 2024Double Momentum Method for Lower-Level Constrained Bilevel Optimization25 Jun 2024
- 2023Deep Unrolling Networks with Recurrent Momentum Acceleration for Nonlinear Inverse Problems30 Jul 2023
- 2022Total Variation Optimization Layers for Computer Vision7 Apr 2022
- 2021Efficient and Modular Implicit Differentiation31 May 2021
- 2021Implicit differentiation for fast hyperparameter selection in non-smooth convex learning4 May 2021
- 2021Learning to Optimize: A Primer and A Benchmark23 Mar 2021