Majorization-Minimization Networks for Inverse Problems: An Application to EEG Imaging
Not on the map. Why?
Abstract (arXiv)
Inverse problems are often ill-posed and require optimization schemes with strong stability and convergence guarantees. While learning-based approaches such as deep unrolling and meta-learning achieve strong empirical performance, they typically lack explicit control over descent and curvature, limiting robustness. We propose a learned Majorization-Minimization (MM) framework for inverse problems within a bilevel optimization setting. Instead of learning a full optimizer, we learn a structured curvature majorant that governs each MM step while preserving classical MM descent guarantees. The majorant is parameterized by a lightweight recurrent neural network and explicitly constrained to satisfy valid MM conditions. For cosine-similarity losses, we derive explicit curvature bounds yielding diagonal majorants. When analytic bounds are unavailable, we rely on efficient Hessian-vector product-based spectral estimation to automatically upper-bound local curvature without forming the Hessian explicitly. Experiments on EEG source imaging demonstrate improved accuracy, stability, and cross-dataset generalization over deep-unrolled and meta-learning baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 62 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
32 of 62 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2021Convex optimizationcited by 2,479
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
20 more
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2017Learned Primal-dual Reconstructioncited by 251
- 2018Approximation Methods for Bilevel Programmingcited by 231
- 2020Bilevel Optimization: Convergence Analysis and Enhanced Designcited by 219
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2016Learning to Optimizecited by 195
- 2017Learned Optimizers that Scale and Generalizecited by 109
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2020FISTA-Net: Learning A Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imagingcited by 74
- 2019Meta-Curvaturecited by 70
- 2017Unrolled Optimization with Deep Priorscited by 40
- 2020Learning Variational Data Assimilation Models and Solverscited by 36
- 2021Bilevel methods for image reconstructioncited by 20
- 2022Transformer-Based Learned Optimizationcited by 13
- 2019Bilevel Optimization, Deep Learning and Fractional Laplacian Regularization with Applications in Tomographycited by 8
- 2022Data-Driven Mirror Descent with Input-Convex Neural Networkscited by 8
- 2021Learned Half-Quadratic Splitting Network for MR Image Reconstructioncited by 5
- 2024Greedy Learning to Optimize with Convergence Guaranteescited by 3
- 2023A Second-Order Majorant Algorithm for Nonnegative Matrix Factorizationcited by 2
Built on by
Not cited yet.