Learnable Scaled Gradient Descent for Guaranteed Robust Tensor PCA
Not on the map. Why?
Abstract (arXiv)
Robust tensor principal component analysis (RTPCA) aims to separate the low-rank and sparse components from multi-dimensional data, making it an essential technique in the signal processing and computer vision fields. Recently emerging tensor singular value decomposition (t-SVD) has gained considerable attention for its ability to better capture the low-rank structure of tensors compared to traditional matrix SVD. However, existing methods often rely on the computationally expensive tensor nuclear norm (TNN), which limits their scalability for real-world tensors. To address this issue, we explore an efficient scaled gradient descent (SGD) approach within the t-SVD framework for the first time, and propose the RTPCA-SGD method. Theoretically, we rigorously establish the recovery guarantees of RTPCA-SGD under mild assumptions, demonstrating that with appropriate parameter selection, it achieves linear convergence to the true low-rank tensor at a constant rate, independent of the condition number. To enhance its practical applicability, we further propose a learnable self-supervised deep unfolding model, which enables effective parameter learning. Numerical experiments on both synthetic and real-world datasets demonstrate the superior performance of the proposed methods while maintaining competitive computational efficiency, especially consuming less time than RTPCA-TNN.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 64 references that are in the map. First posted on arXiv 8 Jan 2025.
Builds on
23 of 64 references.
References · 23
- 2016Tensor Decomposition for Signal Processing and Machine Learningcited by 223
- 2016Tensor Ring Decompositioncited by 125
- 2018Tensor Robust Principal Component Analysis with A New Tensor Nuclear Normcited by 110
- 2015Exact tensor completion using t-SVDcited by 70
- 2020Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descentcited by 70
- 2014Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determinationcited by 65
- 2014Novel methods for multilinear data completion and de-noising based on tensor-SVDcited by 56
- 2018Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasoundcited by 43
- 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
- 2023Guaranteed Tensor Recovery Fused Low-rankness and Smoothnesscited by 41
- 2013Square Deal: Lower Bounds and Improved Relaxations for Tensor Recoverycited by 37
- 2017Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimizationcited by 35
11 more
- 2021Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detectioncited by 34
- 2017Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear normcited by 19
- 2018Tensor N-tubal rank and its convex relaxation for low-rank tensor recoverycited by 19
- 2020Dictionary Learning with Low-rank Coding Coefficients for Tensor Completioncited by 19
- 2022Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descentcited by 11
- 2023Robust Tensor CUR Decompositions: Rapid Low-Tucker-Rank Tensor Recovery with Sparse Corruptioncited by 11
- 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learningcited by 7
- 2024Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descentcited by 7
- 2019A Fast Algorithm for Cosine Transform Based Tensor Singular Value Decompositioncited by 6
- 2020A Deep-Unfolded Reference-Based RPCA Network For Video Foreground-Background Separationcited by 6
- 2024Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recoverycited by 4
Built on by
Citing papers per year: 2025: 2.
2 papers.