mlsanityData to 7 Oct 2026

Learnable Scaled Gradient Descent for Guaranteed Robust Tensor PCA

arXiv 2501.04565 ↗First posted 8 Jan 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Robust tensor principal component analysis (RTPCA) aims to separate the low-rank and sparse components from multi-dimensional data, making it an essential technique in the signal processing and computer vision fields. Recently emerging tensor singular value decomposition (t-SVD) has gained considerable attention for its ability to better capture the low-rank structure of tensors compared to traditional matrix SVD. However, existing methods often rely on the computationally expensive tensor nuclear norm (TNN), which limits their scalability for real-world tensors. To address this issue, we explore an efficient scaled gradient descent (SGD) approach within the t-SVD framework for the first time, and propose the RTPCA-SGD method. Theoretically, we rigorously establish the recovery guarantees of RTPCA-SGD under mild assumptions, demonstrating that with appropriate parameter selection, it achieves linear convergence to the true low-rank tensor at a constant rate, independent of the condition number. To enhance its practical applicability, we further propose a learnable self-supervised deep unfolding model, which enables effective parameter learning. Numerical experiments on both synthetic and real-world datasets demonstrate the superior performance of the proposed methods while maintaining competitive computational efficiency, especially consuming less time than RTPCA-TNN.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 64 references that are in the map. First posted on arXiv 8 Jan 2025.

Builds on

23 of 64 references.

References · 23

  1. 2016Tensor Decomposition for Signal Processing and Machine Learningcited by 223
  2. 2016Tensor Ring Decompositioncited by 125
  3. 2018Tensor Robust Principal Component Analysis with A New Tensor Nuclear Normcited by 110
  4. 2015Exact tensor completion using t-SVDcited by 70
  5. 2020Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descentcited by 70
  6. 2014Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determinationcited by 65
  7. 2014Novel methods for multilinear data completion and de-noising based on tensor-SVDcited by 56
  8. 2018Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasoundcited by 43
  9. 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
  10. 2023Guaranteed Tensor Recovery Fused Low-rankness and Smoothnesscited by 41
  11. 2013Square Deal: Lower Bounds and Improved Relaxations for Tensor Recoverycited by 37
  12. 2017Tensor Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Tensors via Convex Optimizationcited by 35
11 more
  1. 2021Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detectioncited by 34
  2. 2017Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear normcited by 19
  3. 2018Tensor N-tubal rank and its convex relaxation for low-rank tensor recoverycited by 19
  4. 2020Dictionary Learning with Low-rank Coding Coefficients for Tensor Completioncited by 19
  5. 2022Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descentcited by 11
  6. 2023Robust Tensor CUR Decompositions: Rapid Low-Tucker-Rank Tensor Recovery with Sparse Corruptioncited by 11
  7. 2022Deep Unfolded Tensor Robust PCA with Self-supervised Learningcited by 7
  8. 2024Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descentcited by 7
  9. 2019A Fast Algorithm for Cosine Transform Based Tensor Singular Value Decompositioncited by 6
  10. 2020A Deep-Unfolded Reference-Based RPCA Network For Video Foreground-Background Separationcited by 6
  11. 2024Guarantees of a Preconditioned Subgradient Algorithm for Overparameterized Asymmetric Low-rank Matrix Recoverycited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.