mlsanityData to 7 Oct 2026

Majorization-Minimization Networks for Inverse Problems: An Application to EEG Imaging

arXiv 2602.03855 ↗First posted 23 Jan 2026eess.SP cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Inverse problems are often ill-posed and require optimization schemes with strong stability and convergence guarantees. While learning-based approaches such as deep unrolling and meta-learning achieve strong empirical performance, they typically lack explicit control over descent and curvature, limiting robustness. We propose a learned Majorization-Minimization (MM) framework for inverse problems within a bilevel optimization setting. Instead of learning a full optimizer, we learn a structured curvature majorant that governs each MM step while preserving classical MM descent guarantees. The majorant is parameterized by a lightweight recurrent neural network and explicitly constrained to satisfy valid MM conditions. For cosine-similarity losses, we derive explicit curvature bounds yielding diagonal majorants. When analytic bounds are unavailable, we rely on efficient Hessian-vector product-based spectral estimation to automatically upper-bound local curvature without forming the Hessian explicitly. Experiments on EEG source imaging demonstrate improved accuracy, stability, and cross-dataset generalization over deep-unrolled and meta-learning baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 62 references that are in the map. First posted on arXiv 23 Jan 2026.

Builds on

32 of 62 references.

References · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2021Convex optimizationcited by 2,479
  6. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  7. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  8. 2022Denoising Diffusion Restoration Modelscited by 951
  9. 2016Learning to learn by gradient descent by gradient descentcited by 616
  10. 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
  11. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
  12. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
20 more
  1. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
  2. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
  3. 2017Learned Primal-dual Reconstructioncited by 251
  4. 2018Approximation Methods for Bilevel Programmingcited by 231
  5. 2020Bilevel Optimization: Convergence Analysis and Enhanced Designcited by 219
  6. 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
  7. 2016Learning to Optimizecited by 195
  8. 2017Learned Optimizers that Scale and Generalizecited by 109
  9. 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
  10. 2020FISTA-Net: Learning A Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imagingcited by 74
  11. 2019Meta-Curvaturecited by 70
  12. 2017Unrolled Optimization with Deep Priorscited by 40
  13. 2020Learning Variational Data Assimilation Models and Solverscited by 36
  14. 2021Bilevel methods for image reconstructioncited by 20
  15. 2022Transformer-Based Learned Optimizationcited by 13
  16. 2019Bilevel Optimization, Deep Learning and Fractional Laplacian Regularization with Applications in Tomographycited by 8
  17. 2022Data-Driven Mirror Descent with Input-Convex Neural Networkscited by 8
  18. 2021Learned Half-Quadratic Splitting Network for MR Image Reconstructioncited by 5
  19. 2024Greedy Learning to Optimize with Convergence Guaranteescited by 3
  20. 2023A Second-Order Majorant Algorithm for Nonnegative Matrix Factorizationcited by 2

Built on by

Not cited yet.