Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detection
Not on the map. Why?
Abstract (arXiv)
Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for high-dimensional RPCA problems, which we call Learned Robust PCA (LRPCA). LRPCA is highly efficient, and its free parameters can be effectively learned to optimize via deep unfolding. Moreover, we extend deep unfolding from finite iterations to infinite iterations via a novel feedforward-recurrent-mixed neural network model. We establish the recovery guarantee of LRPCA under mild assumptions for RPCA. Numerical experiments show that LRPCA outperforms the state-of-the-art RPCA algorithms, such as ScaledGD and AltProj, on both synthetic datasets and real-world applications.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 20 of its 49 references that are in the map. First posted on arXiv 11 Oct 2021.
Builds on
20 of 49 references.
References · 20
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Learned Optimizers that Scale and Generalizecited by 109
- 2018Understanding and correcting pathologies in the training of learned optimizerscited by 97
- 2018Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholdscited by 83
- 2020Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descentcited by 70
- 2017Learned D-AMP: Principled Neural Network based Compressive Image Recoverycited by 65
- 2018Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasoundcited by 43
- 2014Non-convex Robust PCAcited by 41
- 2016Fast Algorithms for Robust PCA via Gradient Descentcited by 39
- 2020Training Stronger Baselines for Learning to Optimizecited by 31
8 more
- 2016Maximal Sparsity with Deep Networks?cited by 29
- 2017Accelerated Alternating Projections for Robust Principal Component Analysiscited by 25
- 2021Generalized Low-rank plus Sparse Tensor Estimation by Fast Riemannian Optimizationcited by 24
- 2021Robust CUR Decomposition: Theory and Imaging Applicationscited by 20
- 2020Rapid Robust Principal Component Analysis: CUR Accelerated Inexact Low Rank Estimationcited by 16
- 2016Nearly-optimal Robust Matrix Completioncited by 13
- 2021Fast Robust Tensor Principal Component Analysis via Fiber CUR Decompositioncited by 8
- 2020A Deep-Unfolded Reference-Based RPCA Network For Video Foreground-Background Separationcited by 6
Built on by
Citing papers per year: 2021: 1; 2022: 8; 2023: 5; 2024: 8; 2025: 7; 2026: 5.
34 papers.
Sort:
By area:
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2023LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuningcited by 92
- 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
- 2021Hyperparameter Tuning is All You Need for LISTAcited by 22
- 2023Towards Constituting Mathematical Structures for Learning to Optimizecited by 13
- 2022Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descentcited by 11
- 2023Robust Tensor CUR Decompositions: Rapid Low-Tucker-Rank Tensor Recovery with Sparse Corruptioncited by 11
- 2025RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentationcited by 11
- 2022Riemannian CUR Decompositions for Robust Principal Component Analysiscited by 7
- 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learningcited by 7
- 2025Deep Unfolding: Recent Developments, Theory, and Design Guidelinescited by 7
- 2022LR-CSNet: Low-Rank Deep Unfolding Network for Image Compressive Sensingcited by 6
22 more
- 2024Specularity Factorization for Low-Light Enhancementcited by 6
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
- 2024On the Robustness of Cross-Concentrated Sampling for Matrix Completioncited by 5
- 2024Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recoverycited by 4
- 2025Efficient Over-parameterized Matrix Sensing from Noisy Measurements via Alternating Preconditioned Gradient Descentcited by 4
- 2024Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architecturescited by 3
- 2024Accelerating Ill-conditioned Hankel Matrix Recovery via Structured Newton-like Descentcited by 3
- 2023Deep Unrolling for Nonconvex Robust Principal Component Analysiscited by 2
- 2024Structured Sampling for Robust Euclidean Distance Geometrycited by 2
- 2025Learnable Scaled Gradient Descent for Guaranteed Robust Tensor PCAcited by 2
- 2022Working memory inspired hierarchical video decomposition with transformative representationscited by 1
- 2025FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCAcited by 1
- 2022A Deep-Unfolded Spatiotemporal RPCA Network For L+S Decompositioncited by 0
- 2024Generative Principal Component Regression via Variational Inferencecited by 0
- 2024Adaptive Anomaly Detection in Network Flows with Low-Rank Tensor Decompositions and Deep Unrollingcited by 0
- 2025Nuclear Diffusion Models for Low-Rank Background Suppression in Videoscited by 0
- 2025Factor Decorrelation Enhanced Data Removal from Deep Predictive Modelscited by 0
- 2026Robust Principal Component Completioncited by 0
- 2026Mean-Shift PCA by Knockoff Meancited by 0
- 2026Learning to Distributedly Estimate under Partially Known Dynamics: A Covariance-Agnostic Neural Kalman Consensus Filtercited by 0
- 2026LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detectioncited by 0
- 2026Robust Low-Tubal-Rank Tensor Completion under Cross-Concentrated Samplingcited by 0
- 2026Robust Low-Tubal-Rank Tensor Completion under Cross-Concentrated Sampling4 Aug 2026
- 2026LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection6 Jul 2026
- 2026Learning to Distributedly Estimate under Partially Known Dynamics: A Covariance-Agnostic Neural Kalman Consensus Filter26 Jun 2026
- 2026Mean-Shift PCA by Knockoff Mean25 May 2026
- 2026Robust Principal Component Completion26 Mar 2026
- 2025Deep Unfolding: Recent Developments, Theory, and Design Guidelines3 Dec 2025
- 2025Factor Decorrelation Enhanced Data Removal from Deep Predictive Models27 Sep 2025
- 2025Nuclear Diffusion Models for Low-Rank Background Suppression in Videos25 Sep 2025
- 2025RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation6 Aug 2025
- 2025FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA1 Jun 2025
- 2025Efficient Over-parameterized Matrix Sensing from Noisy Measurements via Alternating Preconditioned Gradient Descent1 Feb 2025
- 2025Learnable Scaled Gradient Descent for Guaranteed Robust Tensor PCA8 Jan 2025
22 more
- 2024Structured Sampling for Robust Euclidean Distance Geometry14 Dec 2024
- 2024Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recovery22 Oct 2024
- 2024Adaptive Anomaly Detection in Network Flows with Low-Rank Tensor Decompositions and Deep Unrolling17 Sep 2024
- 2024Generative Principal Component Regression via Variational Inference3 Sep 2024
- 2024Accelerating Ill-conditioned Hankel Matrix Recovery via Structured Newton-like Descent11 Jun 2024
- 2024Specularity Factorization for Low-Light Enhancement2 Apr 2024
- 2024Solving Inverse Problems with Model Mismatch using Untrained Neural Networks within Model-based Architectures7 Mar 2024
- 2024On the Robustness of Cross-Concentrated Sampling for Matrix Completion28 Jan 2024
- 2023LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning20 Nov 2023
- 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detection2 Nov 2023
- 2023Deep Unrolling for Nonconvex Robust Principal Component Analysis12 Jul 2023
- 2023Towards Constituting Mathematical Structures for Learning to Optimize29 May 2023
- 2023Robust Tensor CUR Decompositions: Rapid Low-Tucker-Rank Tensor Recovery with Sparse Corruption6 May 2023
- 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learning21 Dec 2022
- 2022LR-CSNet: Low-Rank Deep Unfolding Network for Image Compressive Sensing18 Dec 2022
- 2022A Deep-Unfolded Spatiotemporal RPCA Network For L+S Decomposition6 Nov 2022
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detection26 Sep 2022
- 2022ADBench: Anomaly Detection Benchmark19 Jun 2022
- 2022Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent18 Jun 2022
- 2022Riemannian CUR Decompositions for Robust Principal Component Analysis17 Jun 2022
- 2022Working memory inspired hierarchical video decomposition with transformative representations21 Apr 2022
- 2021Hyperparameter Tuning is All You Need for LISTA29 Oct 2021
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2023LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuningcited by 92
- 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
- 2021Hyperparameter Tuning is All You Need for LISTAcited by 22
- 2023Towards Constituting Mathematical Structures for Learning to Optimizecited by 13
- 2022Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descentcited by 11
- 2023Robust Tensor CUR Decompositions: Rapid Low-Tucker-Rank Tensor Recovery with Sparse Corruptioncited by 11
- 2025RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentationcited by 11
- 2022Riemannian CUR Decompositions for Robust Principal Component Analysiscited by 7
- 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learningcited by 7
- 2025Deep Unfolding: Recent Developments, Theory, and Design Guidelinescited by 7
- 2022LR-CSNet: Low-Rank Deep Unfolding Network for Image Compressive Sensingcited by 6
12 most cited of 33 All 33 (JSON)
- 2026Robust Low-Tubal-Rank Tensor Completion under Cross-Concentrated Sampling4 Aug 2026
- 2026LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection6 Jul 2026
- 2026Learning to Distributedly Estimate under Partially Known Dynamics: A Covariance-Agnostic Neural Kalman Consensus Filter26 Jun 2026
- 2026Mean-Shift PCA by Knockoff Mean25 May 2026
- 2026Robust Principal Component Completion26 Mar 2026
- 2025Deep Unfolding: Recent Developments, Theory, and Design Guidelines3 Dec 2025
- 2025Factor Decorrelation Enhanced Data Removal from Deep Predictive Models27 Sep 2025
- 2025RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation6 Aug 2025
- 2025FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA1 Jun 2025
- 2025Efficient Over-parameterized Matrix Sensing from Noisy Measurements via Alternating Preconditioned Gradient Descent1 Feb 2025
- 2025Learnable Scaled Gradient Descent for Guaranteed Robust Tensor PCA8 Jan 2025
- 2024Structured Sampling for Robust Euclidean Distance Geometry14 Dec 2024
12 newest of 33 All 33 (JSON)