Generalization analysis of an unfolding network for analysis-based Compressed Sensing
Not on the map. Why?
Abstract (arXiv)
Unfolding networks have shown promising results in the Compressed Sensing (CS) field. Yet, the investigation of their generalization ability is still in its infancy. In this paper, we perform a generalization analysis of a state-of-the-art ADMM-based unfolding network, which jointly learns a decoder for CS and a sparsifying redundant analysis operator. To this end, we first impose a structural constraint on the learnable sparsifier, which parametrizes the network's hypothesis class. For the latter, we estimate its Rademacher complexity. With this estimate in hand, we deliver generalization error bounds -- which scale like the square root of the number of layers -- for the examined network. Finally, the validity of our theory is assessed and numerical comparisons to a state-of-the-art unfolding network are made, on synthetic and real-world datasets. Our experimental results demonstrate that our proposed framework complies with our theoretical findings and outperforms the baseline, consistently for all datasets.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 63 references that are in the map. First posted on arXiv 9 Mar 2023.
Builds on
20 of 63 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2017Spectrally-normalized margin bounds for neural networkscited by 686
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 421
- 2018Stronger generalization bounds for deep nets via a compression approachcited by 307
- 2019Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networkscited by 222
- 2016A vector-contraction inequality for Rademacher complexitiescited by 142
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 121
- 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 77
- 2020Iterative Algorithm Induced Deep-Unfolding Neural Networks: Precoding Design for Multiuser MIMO Systemscited by 44
- 2019Information-Theoretic Lower Bounds for Compressive Sensing with Generative Modelscited by 25
- 2022Memory-augmented Deep Unfolding Network for Guided Image Super-resolutioncited by 25
8 more
- 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problemscited by 22
- 2020Compressive Sensing and Neural Networks from a Statistical Learning Perspectivecited by 15
- 2021ADMM-DAD net: a deep unfolding network for analysis compressed sensingcited by 8
- 2015Dictionary Learning for Blind One Bit Compressed Sensingcited by 5
- 2019Fast Compressive Sensing Recovery Using Generative Models with Structured Latent Variablescited by 5
- 2021LADMM-Net: An Unrolled Deep Network For Spectral Image Fusion From Compressive Datacited by 5
- 2022DECONET: an Unfolding Network for Analysis-based Compressed Sensing with Generalization Error Boundscited by 4
- 2020Interpretable Deep Recurrent Neural Networks via Unfolding Reweighted ℓ1-ℓ1 Minimization: Architecture Design and Generalization Analysiscited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.
- 2025How to warm-start your unfolding networkcited by 0
- 2025Adversarial generalization of unfolding (model-based) networkscited by 0
- 2025Adversarial generalization of unfolding (model-based) networks18 Sep 2025
- 2025How to warm-start your unfolding network3 Feb 2025