Polynomial-time Tensor Decompositions with Sum-of-Squares
Not on the map. Why?
Abstract (arXiv)
We give new algorithms based on the sum-of-squares method for tensor decomposition. Our results improve the best known running times from quasi-polynomial to polynomial for several problems, including decomposing random overcomplete 3-tensors and learning overcomplete dictionaries with constant relative sparsity. We also give the first robust analysis for decomposing overcomplete 4-tensors in the smoothed analysis model. A key ingredient of our analysis is to establish small spectral gaps in moment matrices derived from solutions to sum-of-squares relaxations. To enable this analysis we augment sum-of-squares relaxations with spectral analogs of maximum entropy constraints.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 4; 2022: 8; 2023: 3; 2024: 3; 2025: 2; 2026: 1.
22 papers.
Sort:
By area:
- 2021Clustering Mixtures with Almost Optimal Separation in Polynomial Timecited by 28
- 2023Learning Narrow One-Hidden-Layer ReLU Networkscited by 14
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithmscited by 13
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimationcited by 7
- 2021The Complexity of Sparse Tensor PCAcited by 7
- 2022A Robust Spectral Algorithm for Overcomplete Tensor Decompositioncited by 7
- 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomialscited by 6
- 2022Fast algorithm for overcomplete order-3 tensor decompositioncited by 5
- 2023Closed-Loop Transcription via Convolutional Sparse Codingcited by 4
- 2022Dictionary Learning for the Almost-Linear Sparsity Regimecited by 3
- 2022Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Modelscited by 3
10 more
- 2022Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyondcited by 2
- 2021Conditional Linear Regression for Heterogeneous Covariancescited by 1
- 2022Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Designcited by 1
- 2024Tensor Methods in High Dimensional Data Analysis: Opportunities and Challengescited by 1
- 2025Rotated Mean-Field Variational Inference and Iterative Gaussianizationcited by 1
- 2023Robust Mean Estimation Without Moments for Symmetric Distributionscited by 0
- 2024Computational Lower Bounds for Regret Minimization in Normal-Form Gamescited by 0
- 2024Overcomplete Tensor Decomposition via Koszul-Young Flatteningscited by 0
- 2025Federated Independent Component Analysis via Spectral Alignment and Robust Aggregationcited by 0
- 2026Low-degree Lower bounds for clustering in moderate dimensioncited by 0
- 2026Low-degree Lower bounds for clustering in moderate dimension26 Feb 2026
- 2025Rotated Mean-Field Variational Inference and Iterative Gaussianization9 Oct 2025
- 2025Federated Independent Component Analysis via Spectral Alignment and Robust Aggregation26 May 2025
- 2024Overcomplete Tensor Decomposition via Koszul-Young Flattenings21 Nov 2024
- 2024Computational Lower Bounds for Regret Minimization in Normal-Form Games4 Nov 2024
- 2024Tensor Methods in High Dimensional Data Analysis: Opportunities and Challenges28 May 2024
- 2023Learning Narrow One-Hidden-Layer ReLU Networks20 Apr 2023
- 2023Robust Mean Estimation Without Moments for Symmetric Distributions21 Feb 2023
- 2023Closed-Loop Transcription via Convolutional Sparse Coding18 Feb 2023
- 2022Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond7 Dec 2022
- 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomials10 Nov 2022
- 2022Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Models7 Nov 2022
10 more
- 2022Dictionary Learning for the Almost-Linear Sparsity Regime19 Oct 2022
- 2022Estimation Contracts for Outlier-Robust Geometric Perception22 Aug 2022
- 2022Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Design16 Apr 2022
- 2022A Robust Spectral Algorithm for Overcomplete Tensor Decomposition5 Mar 2022
- 2022Fast algorithm for overcomplete order-3 tensor decomposition14 Feb 2022
- 2021Clustering Mixtures with Almost Optimal Separation in Polynomial Time1 Dec 2021
- 2021Conditional Linear Regression for Heterogeneous Covariances15 Nov 2021
- 2021The Complexity of Sparse Tensor PCA11 Jun 2021
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimation5 Jan 2021
- 2018Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms21 Feb 2018
- 2021Clustering Mixtures with Almost Optimal Separation in Polynomial Timecited by 28
- 2023Learning Narrow One-Hidden-Layer ReLU Networkscited by 14
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimationcited by 7
- 2021The Complexity of Sparse Tensor PCAcited by 7
- 2022A Robust Spectral Algorithm for Overcomplete Tensor Decompositioncited by 7
- 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomialscited by 6
- 2022Fast algorithm for overcomplete order-3 tensor decompositioncited by 5
- 2023Closed-Loop Transcription via Convolutional Sparse Codingcited by 4
- 2022Dictionary Learning for the Almost-Linear Sparsity Regimecited by 3
- 2022Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Modelscited by 3
- 2022Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyondcited by 2
12 most cited of 21 All 21 (JSON)
- 2026Low-degree Lower bounds for clustering in moderate dimension26 Feb 2026
- 2025Rotated Mean-Field Variational Inference and Iterative Gaussianization9 Oct 2025
- 2025Federated Independent Component Analysis via Spectral Alignment and Robust Aggregation26 May 2025
- 2024Overcomplete Tensor Decomposition via Koszul-Young Flattenings21 Nov 2024
- 2024Computational Lower Bounds for Regret Minimization in Normal-Form Games4 Nov 2024
- 2024Tensor Methods in High Dimensional Data Analysis: Opportunities and Challenges28 May 2024
- 2023Learning Narrow One-Hidden-Layer ReLU Networks20 Apr 2023
- 2023Robust Mean Estimation Without Moments for Symmetric Distributions21 Feb 2023
- 2023Closed-Loop Transcription via Convolutional Sparse Coding18 Feb 2023
- 2022Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond7 Dec 2022
- 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomials10 Nov 2022
- 2022Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Models7 Nov 2022
12 newest of 21 All 21 (JSON)