mlsanityData to 14 Oct 2026

Learning truly monotone operators with applications to nonlinear inverse problems

arXiv 2404.00390 ↗First posted 30 Mar 2024math.OC cs.LG cs.NAcited by 2

Not on the map. Why?

Abstract (arXiv)

This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone inclusion problems, commonly encountered in image processing tasks. The Forward-Backward-Forward (FBF) algorithm is employed to address these problems, offering a solution even when the Lipschitz constant of the neural network is unknown. Notably, the FBF algorithm provides convergence guarantees under the condition that the learned operator is monotone. Building on plug-and-play methodologies, our objective is to apply these newly learned operators to solving non-linear inverse problems. To achieve this, we initially formulate the problem as a variational inclusion problem. Subsequently, we train a monotone neural network to approximate an operator that may not inherently be monotone. Leveraging the FBF algorithm, we then show simulation examples where the non-linear inverse problem is successfully solved.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 49 references that are in the map. First posted on arXiv 30 Mar 2024.

Builds on

25 of 49 references.

References · 25

  1. 2015Variational Inference with Normalizing Flowscited by 2,170
  2. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
  3. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 198
  4. 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 127
  5. 2020Descending through a Crowded Valley - Benchmarking Deep Learning Optimizerscited by 119
  6. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 108
  7. 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 96
  8. 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 80
  9. 2019Conservative set valued fields, automatic differentiation, stochastic gradient method and deep learningcited by 72
  10. 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
  11. 2019Lipschitz Certificates for Layered Network Structures Driven by Averaged Activation Operatorscited by 55
  12. 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
13 more
  1. 2022Constrained Monotonic Neural Networkscited by 32
  2. 2019Backpropagation-Friendly Eigendecompositioncited by 27
  3. 2021Benchmarking Invertible Architectures on Inverse Problemscited by 25
  4. 2023Generative Plug and Play: Posterior Sampling for Inverse Problemscited by 24
  5. 2020Fixed Point Strategies in Data Sciencecited by 16
  6. 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
  7. 2023Learning Gradients of Convex Functions with Monotone Gradient Networkscited by 7
  8. 2022Invertible Monotone Operators for Normalizing Flowscited by 6
  9. 2022Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problemscited by 5
  10. 2022Bregman Plug-and-Play Priorscited by 3
  11. 2023A Plug-and-Play Method with Inpainting Network for Bayesian Uncertainty Quantification in Imagingcited by 2
  12. 2021A Variational Inequality Model for the Construction of Signals from Inconsistent Nonlinear Equationscited by 1
  13. 2023A primal-dual data-driven method for computational optical imaging with a photonic lanterncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.