mlsanityData to 14 Oct 2026

A lifted Bregman strategy for training unfolded proximal neural network Gaussian denoisers

arXiv 2408.08742 ↗First posted 16 Aug 2024math.OC cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unfolded proximal neural networks (PNNs) form a family of methods that combines deep learning and proximal optimization approaches. They consist in designing a neural network for a specific task by unrolling a proximal algorithm for a fixed number of iterations, where linearities can be learned from prior training procedure. PNNs have shown to be more robust than traditional deep learning approaches while reaching at least as good performances, in particular in computational imaging. However, training PNNs still depends on the efficiency of available training algorithms. In this work, we propose a lifted training formulation based on Bregman distances for unfolded PNNs. Leveraging the deterministic mini-batch block-coordinate forward-backward method, we design a bespoke computational strategy beyond traditional back-propagation methods for solving the resulting learning problem efficiently. We assess the behaviour of the proposed training approach for PNNs through numerical simulations on image denoising, considering a denoising PNN whose structure is based on dual proximal-gradient iterations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 16 Aug 2024.

Builds on

15 of 38 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  5. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
  6. 2017Learned Primal-dual Reconstructioncited by 251
  7. 2016Training Neural Networks Without Gradients: A Scalable ADMM Approachcited by 61
  8. 2018Deep Neural Network Structures Solving Variational Inequalitiescited by 26
  9. 2018Fenchel Lifted Networks: A Lagrange Relaxation of Neural Network Trainingcited by 19
  10. 2022Lifted Bregman Training of Neural Networkscited by 10
  11. 2019Contrastive Learning for Lifted Networkscited by 9
  12. 2020A deep primal-dual proximal network for image restorationcited by 9
3 more
  1. 2023A Lifted Bregman Formulation for the Inversion of Deep Neural Networkscited by 2
  2. 2022An alternative approach to train neural networks using monotone variational inequalitycited by 1
  3. 2022A Variational Inequality Model for Learning Neural Networkscited by 1

Built on by

Not cited yet.