mlsanityData to 14 Oct 2026

Unrolling PALM for sparse semi-blind source separation

arXiv 2112.05694 ↗First posted 10 Dec 2021astro-ph.IM cs.LG eess.IVcited by 3

Not on the map. Why?

Abstract (arXiv)

Sparse Blind Source Separation (BSS) has become a well established tool for a wide range of applications - for instance, in astrophysics and remote sensing. Classical sparse BSS methods, such as the Proximal Alternating Linearized Minimization (PALM) algorithm, nevertheless often suffer from a difficult hyperparameter choice, which undermines their results. To bypass this pitfall, we propose in this work to build on the thriving field of algorithm unfolding/unrolling. Unrolling PALM enables to leverage the data-driven knowledge stemming from realistic simulations or ground-truth data by learning both PALM hyperparameters and variables. In contrast to most existing unrolled algorithms, which assume a fixed known dictionary during the training and testing phases, this article further emphasizes on the ability to deal with variable mixing matrices (a.k.a. dictionaries). The proposed Learned PALM (LPALM) algorithm thus enables to perform semi-blind source separation, which is key to increase the generalization of the learnt model in real-world applications. We illustrate the relevance of LPALM in astrophysical multispectral imaging: the algorithm not only needs up to 104-105 times fewer iterations than PALM, but also improves the separation quality, while avoiding the cumbersome hyperparameter and initialization choice of PALM. We further show that LPALM outperforms other unrolled source separation methods in the semi-blind setting.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 10 Dec 2021.

Builds on

13 of 41 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 421
  4. 2018Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholdscited by 85
  5. 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 77
  6. 2019Learning step sizes for unfolded sparse codingcited by 30
  7. 2013Nonlinear unmixing of hyperspectral images: models and algorithmscited by 27
  8. 2021Deep J-Sense: Accelerated MRI Reconstruction via Unrolled Alternating Optimizationcited by 19
  9. 2016Tradeoffs between Convergence Speed and Reconstruction Accuracy in Inverse Problemscited by 12
  10. 2016Understanding Trainable Sparse Coding via Matrix Factorizationcited by 12
  11. 2018LSALSA: Accelerated Source Separation via Learned Sparse Codingcited by 7
  12. 2021deep unfolding for non-negative matrix factorization with application to mutational signature analysiscited by 4
1 more
  1. 2014Sparsity and adaptivity for the blind separation of partially correlated sourcescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 2.

3 papers.