mlsanityData to 14 Oct 2026

Deep Unfolding: Recent Developments, Theory, and Design Guidelines

arXiv 2512.03768 ↗First posted 3 Dec 2025cs.LG eess.SPcited by 7

Not on the map. Why?

Abstract (arXiv)

Optimization methods play a central role in signal processing, serving as the mathematical foundation for inference, estimation, and control. While classical iterative optimization algorithms provide interpretability and theoretical guarantees, they often rely on surrogate objectives, require careful hyperparameter tuning, and exhibit substantial computational latency. Conversely, machine learning (ML ) offers powerful data-driven modeling capabilities but lacks the structure, transparency, and efficiency needed for optimization-driven inference. Deep unfolding has recently emerged as a compelling framework that bridges these two paradigms by systematically transforming iterative optimization algorithms into structured, trainable ML architectures. This article provides a tutorial-style overview of deep unfolding, presenting a unified perspective of methodologies for converting optimization solvers into ML models and highlighting their conceptual, theoretical, and practical implications. We review the foundations of optimization for inference and for learning, introduce four representative design paradigms for deep unfolding, and discuss the distinctive training schemes that arise from their iterative nature. Furthermore, we survey recent theoretical advances that establish convergence and generalization guarantees for unfolded optimizers, and provide comparative qualitative and empirical studies illustrating their relative trade-offs in complexity, interpretability, and robustness.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 68 references that are in the map. First posted on arXiv 3 Dec 2025.

Builds on

38 of 68 references.

References · 38

  1. 2021Convex optimizationcited by 2,515
  2. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 421
  3. 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
  4. 2023Handbook of Convergence Theorems for (Stochastic) Gradient Methodscited by 163
  5. 2020Model-Based Deep Learningcited by 141
  6. 2022On the Implicit Bias in Deep-Learning Algorithmscited by 86
  7. 2018Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholdscited by 85
  8. 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 77
  9. 2018Learning to Detectcited by 63
  10. 2020Unfolding WMMSE using Graph Neural Networks for Efficient Power Allocationcited by 61
  11. 2022Model-Based Deep Learning: On the Intersection of Deep Learning and Optimizationcited by 50
  12. 2016Fast Algorithms for Robust PCA via Gradient Descentcited by 39
26 more
  1. 2019Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?cited by 38
  2. 2021Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detectioncited by 34
  3. 2019Learning Convex Optimization Control Policiescited by 31
  4. 2019Adaptive Neural Signal Detection for Massive MIMOcited by 27
  5. 2020DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detectioncited by 24
  6. 2020Safeguarded Learned Convex Optimizationcited by 24
  7. 2021Hyperparameter Tuning is All You Need for LISTAcited by 22
  8. 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problemscited by 22
  9. 2020Learning Convex Optimization Modelscited by 16
  10. 2020Compressive Sensing and Neural Networks from a Statistical Learning Perspectivecited by 15
  11. 2021LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receiverscited by 11
  12. 2021RTSNet: Learning to Smooth in Partially Known State-Space Models (Preprint)cited by 11
  13. 2021Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networkscited by 11
  14. 2023Learn to Rapidly and Robustly Optimize Hybrid Precodingcited by 11
  15. 2024Deep Distributed Optimization for Large-Scale Quadratic Programmingcited by 11
  16. 2022Online Meta-Learning For Hybrid Model-Based Deep Receiverscited by 9
  17. 2023Robust Stochastically-Descending Unrolled Networkscited by 9
  18. 2023Deep Graph Unfolding for Beamforming in MU-MIMO Interference Networkscited by 6
  19. 2023Generalization and Estimation Error Bounds for Model-based Neural Networkscited by 6
  20. 2024Modular Hypernetworks for Scalable and Adaptive Deep MIMO Receiverscited by 5
  21. 2022PAC-Bayesian Learning of Optimization Algorithmscited by 4
  22. 2023Optimization Guarantees of Unfolded ISTA and ADMM Networks With Smooth Soft-Thresholdingcited by 4
  23. 2025Unveiling and Mitigating Adversarial Vulnerabilities in Iterative Optimizerscited by 4
  24. 2024Asynchronous Online Adaptation via Modular Drift Detection for Deep Receiverscited by 2
  25. 2024Adaptive Backtracking Line Searchcited by 2
  26. 2025Deep Unfolding with Approximated Computations for Rapid Optimizationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.