Fixed-Rank Approximation of a Positive-Semidefinite Matrix from Streaming Data
Not on the map. Why?
Abstract (arXiv)
Several important applications, such as streaming PCA and semidefinite programming, involve a large-scale positive-semidefinite (psd) matrix that is presented as a sequence of linear updates. Because of storage limitations, it may only be possible to retain a sketch of the psd matrix. This paper develops a new algorithm for fixed-rank psd approximation from a sketch. The approach combines the Nystrom approximation with a novel mechanism for rank truncation. Theoretical analysis establishes that the proposed method can achieve any prescribed relative error in the Schatten 1-norm and that it exploits the spectral decay of the input matrix. Computer experiments show that the proposed method dominates alternative techniques for fixed-rank psd matrix approximation across a wide range of examples.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 5; 2025: 7; 2026: 1.
22 papers.
Sort:
- 2022Rewiring with Positional Encodings for Graph Neural Networkscited by 35
- 2022Randomly pivoted Cholesky: Practical approximation of a kernel matrix with few entry evaluationscited by 31
- 2021Learning to Forecast Dynamical Systems from Streaming Datacited by 17
- 2023Sampling-based Nystr"om Approximation and Kernel Quadraturecited by 17
- 2024On the Crucial Role of Initialization for Matrix Factorizationcited by 15
- 2022SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimatescited by 8
- 2022Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasetscited by 5
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuningcited by 5
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketchingcited by 4
- 2024CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networkscited by 4
- 2025SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learningcited by 4
- 2025Turbocharging Gaussian Process Inference with Approximate Sketch-and-Projectcited by 3
10 more
- 2026Low-Rank Adaptation Redux for Large Modelscited by 2
- 2025Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methodscited by 1
- 2025Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebracited by 1
- 2022Efficient error and variance estimation for randomized matrix computationscited by 0
- 2023Boosting Nystr"om Methodcited by 0
- 2024Polynomial Precision Dependence Solutions to Alignment Research Center Matrix Completion Problemscited by 0
- 2024Suboptimality bounds for trace-bounded SDPs enable a faster and scalable low-rank SDP solver SDPLR+cited by 0
- 2025What is a Sketch-and-Precondition Derivation for Low-Rank Approximation? Inverse Power Error or Inverse Power Estimation?cited by 0
- 2025NysAct: A Scalable Preconditioned Gradient Descent using Nystrom Approximationcited by 0
- 2025Generalized infinite dimensional Alpha-Procrustes based geometriescited by 0
- 2026Low-Rank Adaptation Redux for Large Models23 Apr 2026
- 2025Generalized infinite dimensional Alpha-Procrustes based geometries12 Nov 2025
- 2025NysAct: A Scalable Preconditioned Gradient Descent using Nystrom Approximation10 Jun 2025
- 2025Turbocharging Gaussian Process Inference with Approximate Sketch-and-Project19 May 2025
- 2025Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra16 May 2025
- 2025Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods20 Apr 2025
- 2025What is a Sketch-and-Precondition Derivation for Low-Rank Approximation? Inverse Power Error or Inverse Power Estimation?11 Feb 2025
- 2025SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learning27 Jan 2025
- 2024CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks2 Nov 2024
- 2024On the Crucial Role of Initialization for Matrix Factorization24 Oct 2024
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning8 Jul 2024
- 2024Suboptimality bounds for trace-bounded SDPs enable a faster and scalable low-rank SDP solver SDPLR+14 Jun 2024
10 more
- 2024Polynomial Precision Dependence Solutions to Alignment Research Center Matrix Completion Problems8 Jan 2024
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketching19 Dec 2023
- 2023Boosting Nystr"om Method21 Feb 2023
- 2023Sampling-based Nystr"om Approximation and Kernel Quadrature23 Jan 2023
- 2022SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates16 Nov 2022
- 2022Randomly pivoted Cholesky: Practical approximation of a kernel matrix with few entry evaluations13 Jul 2022
- 2022Efficient error and variance estimation for randomized matrix computations13 Jul 2022
- 2022Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasets3 Feb 2022
- 2022Rewiring with Positional Encodings for Graph Neural Networks29 Jan 2022
- 2021Learning to Forecast Dynamical Systems from Streaming Data20 Sep 2021
- 2022Rewiring with Positional Encodings for Graph Neural Networkscited by 35
- 2022Randomly pivoted Cholesky: Practical approximation of a kernel matrix with few entry evaluationscited by 31
- 2021Learning to Forecast Dynamical Systems from Streaming Datacited by 17
- 2023Sampling-based Nystr"om Approximation and Kernel Quadraturecited by 17
- 2024On the Crucial Role of Initialization for Matrix Factorizationcited by 15
- 2022SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimatescited by 8
- 2022Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasetscited by 5
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuningcited by 5
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketchingcited by 4
- 2024CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networkscited by 4
- 2025SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learningcited by 4
- 2025Turbocharging Gaussian Process Inference with Approximate Sketch-and-Projectcited by 3
12 most cited of 22 All 22 (JSON)
- 2026Low-Rank Adaptation Redux for Large Models23 Apr 2026
- 2025Generalized infinite dimensional Alpha-Procrustes based geometries12 Nov 2025
- 2025NysAct: A Scalable Preconditioned Gradient Descent using Nystrom Approximation10 Jun 2025
- 2025Turbocharging Gaussian Process Inference with Approximate Sketch-and-Project19 May 2025
- 2025Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra16 May 2025
- 2025Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods20 Apr 2025
- 2025What is a Sketch-and-Precondition Derivation for Low-Rank Approximation? Inverse Power Error or Inverse Power Estimation?11 Feb 2025
- 2025SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learning27 Jan 2025
- 2024CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks2 Nov 2024
- 2024On the Crucial Role of Initialization for Matrix Factorization24 Oct 2024
- 2024Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning8 Jul 2024
- 2024Suboptimality bounds for trace-bounded SDPs enable a faster and scalable low-rank SDP solver SDPLR+14 Jun 2024
12 newest of 22 All 22 (JSON)