Generalized Low Rank Models
Not on the map. Why?
Abstract (arXiv)
Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal, and other data types. This framework encompasses many well known techniques in data analysis, such as nonnegative matrix factorization, matrix completion, sparse and robust PCA, k-means, k-SVD, and maximum margin matrix factorization. The method handles heterogeneous data sets, and leads to coherent schemes for compressing, denoising, and imputing missing entries across all data types simultaneously. It also admits a number of interesting interpretations of the low rank factors, which allow clustering of examples or of features. We propose several parallel algorithms for fitting generalized low rank models, and describe implementations and numerical results.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 6; 2024: 14; 2025: 11; 2026: 9.
55 papers.
Sort:
By area:
- 2021Is Attention Better Than Matrix Decomposition?cited by 75
- 2024Multi-Task Dense Prediction via Mixture of Low-Rank Expertscited by 58
- 2022Machine Learning in Aerodynamic Shape Optimizationcited by 39
- 2022Fair and efficient contribution valuation for vertical federated learningcited by 18
- 2022Tensor and Matrix Low-Rank Value-Function Approximation in Reinforcement Learningcited by 16
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learningcited by 13
- 2021Low-rank State-action Value-function Approximationcited by 10
- 2022Graph-based Neural Acceleration for Nonnegative Matrix Factorizationcited by 9
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Banditscited by 9
- 2023Doubly High-Dimensional Contextual Bandits: An Interpretable Model for Joint Assortment-Pricingcited by 8
- 2022Federated PCA on Grassmann Manifold for Anomaly Detection in IoT Networkscited by 5
- 2022Unsupervised EHR-based Phenotyping via Matrix and Tensor Decompositionscited by 4
38 more
- 2022Sparse PCA With Multiple Componentscited by 4
- 2024Dual Simplex Volume Maximization for Simplex-Structured Matrix Factorizationcited by 4
- 2024High-dimensional analysis of ridge regression for non-identically distributed data with a variance profilecited by 4
- 2025An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decompositioncited by 4
- 2021A Framework of Inertial Alternating Direction Method of Multipliers for Non-Convex Non-Smooth Optimizationcited by 3
- 2022Signal Decomposition Using Masked Proximal Operatorscited by 3
- 2024Checking the Sufficiently Scattered Condition using a Global Non-Convex Optimization Softwarecited by 3
- 2024Federated PCA on Grassmann Manifold for IoT Anomaly Detectioncited by 3
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learningcited by 3
- 2021Weighted Low-Rank Matrix Approximation: Acceleration and Applicationscited by 2
- 2023Archetypal Analysis++: Rethinking the Initialization Strategycited by 2
- 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imagingcited by 2
- 2023Disjunctive Branch-and-Bound for Certifiably Optimal Low-Rank Matrix Completioncited by 2
- 2023Factor Fitting, Rank Allocation, and Partitioning in Multilevel Low Rank Matricescited by 2
- 2024Mixed Matrix Completion in Complex Survey Sampling under Heterogeneous Missingnesscited by 2
- 2024Privacy-Preserving Distributed Nonnegative Matrix Factorizationcited by 2
- 2024Matrix Low-Rank Trust Region Policy Optimizationcited by 2
- 2024Matrix Low-Rank Approximation For Policy Gradient Methodscited by 2
- 2024Learning Counterfactual Distributions via Kernel Nearest Neighborscited by 2
- 2025Disciplined Biconvex Programmingcited by 2
- 2026Manifold-based Algorithms for the Hadamard Decompositioncited by 2
- 2021Low Rank Forecastingcited by 1
- 2023Algorithms for Boolean Matrix Factorization using Integer Programmingcited by 1
- 2024Parameter inference from a non-stationary unknown processcited by 1
- 2025An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decompositioncited by 1
- 2026AI Evaluation Should Require Standardized Item-Level Data Releasescited by 1
- 2022Asymptotics of ℓ2 Regularized Network Embeddingscited by 0
- 2024Tailed Low-Rank Matrix Factorization for Similarity Matrix Completioncited by 0
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing datacited by 0
- 2025Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learningcited by 0
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyondcited by 0
- 2025Supervised Coupled Matrix-Tensor Factorization (SCMTF) for Computational Phenotyping of Patient Reported Outcomes in Ulcerative Colitiscited by 0
- 2025Robustness of Minimum-Volume Nonnegative Matrix Factorization under an Expanded Sufficiently Scattered Conditioncited by 0
- 2025Multilingual Lexical Feature Analysis of Spoken Language for Predicting Major Depression Symptom Severitycited by 0
- 2025Algorithms for Boolean Matrix Factorization using Integer Programming and Heuristicscited by 0
- 2025Low-rank MMSE filters, Kronecker-product representation, and regularization: a new perspectivecited by 0
- 2026Fast and Effective Computation of Generalized Symmetric Matrix Factorizationcited by 0
- 2026LAPLEX: The FFT of Learnable Laplace Kernelscited by 0
50 most cited of 55 All 55 (JSON)
- 2026On the Regularization Landscape for the Linear Recommendation Models10 Sep 2026
- 2026Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure21 Aug 2026
- 2026On the Complexity of Low-Rank Matrix Signing and Entrywise Power Matrix Factorization6 Jul 2026
- 2026Asymptotic Signal Subspace Recovery in Softmax Attention Models21 Jun 2026
- 2026Latent Structural Categorical Matrix Completion with Application to Quasispecies Analysis6 Jun 2026
- 2026Manifold-based Algorithms for the Hadamard Decomposition27 May 2026
- 2026LAPLEX: The FFT of Learnable Laplace Kernels23 May 2026
- 2026Fast and Effective Computation of Generalized Symmetric Matrix Factorization19 Mar 2026
- 2026AI Evaluation Should Require Standardized Item-Level Data Releases27 Feb 2026
- 2025Low-rank MMSE filters, Kronecker-product representation, and regularization: a new perspective16 Dec 2025
- 2025Algorithms for Boolean Matrix Factorization using Integer Programming and Heuristics3 Dec 2025
- 2025Multilingual Lexical Feature Analysis of Spoken Language for Predicting Major Depression Symptom Severity10 Nov 2025
38 more
- 2025Robustness of Minimum-Volume Nonnegative Matrix Factorization under an Expanded Sufficiently Scattered Condition6 Nov 2025
- 2025Disciplined Biconvex Programming3 Nov 2025
- 2025Supervised Coupled Matrix-Tensor Factorization (SCMTF) for Computational Phenotyping of Patient Reported Outcomes in Ulcerative Colitis24 Jun 2025
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyond20 May 2025
- 2025An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decomposition21 Mar 2025
- 2025An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decomposition4 Mar 2025
- 2025Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning12 Jan 2025
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learning8 Jan 2025
- 2024Stochastic gradient descent estimation of generalized matrix factorization models with application to single-cell RNA sequencing data29 Dec 2024
- 2024Learning Counterfactual Distributions via Kernel Nearest Neighbors17 Oct 2024
- 2024Tailed Low-Rank Matrix Factorization for Similarity Matrix Completion29 Sep 2024
- 2024Parameter inference from a non-stationary unknown process12 Jul 2024
- 2024Federated PCA on Grassmann Manifold for IoT Anomaly Detection10 Jul 2024
- 2024Matrix Low-Rank Approximation For Policy Gradient Methods27 May 2024
- 2024Matrix Low-Rank Trust Region Policy Optimization27 May 2024
- 2024High-dimensional analysis of ridge regression for non-identically distributed data with a variance profile29 Mar 2024
- 2024Dual Simplex Volume Maximization for Simplex-Structured Matrix Factorization29 Mar 2024
- 2024Privacy-Preserving Distributed Nonnegative Matrix Factorization27 Mar 2024
- 2024Multi-Task Dense Prediction via Mixture of Low-Rank Experts26 Mar 2024
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits17 Feb 2024
- 2024Checking the Sufficiently Scattered Condition using a Global Non-Convex Optimization Software8 Feb 2024
- 2024Mixed Matrix Completion in Complex Survey Sampling under Heterogeneous Missingness6 Feb 2024
- 2023Factor Fitting, Rank Allocation, and Partitioning in Multilevel Low Rank Matrices30 Oct 2023
- 2023Doubly High-Dimensional Contextual Bandits: An Interpretable Model for Joint Assortment-Pricing14 Sep 2023
- 2023Disjunctive Branch-and-Bound for Certifiably Optimal Low-Rank Matrix Completion20 May 2023
- 2023Algorithms for Boolean Matrix Factorization using Integer Programming17 May 2023
- 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imaging7 Apr 2023
- 2023Archetypal Analysis++: Rethinking the Initialization Strategy31 Jan 2023
- 2022Federated PCA on Grassmann Manifold for Anomaly Detection in IoT Networks23 Dec 2022
- 2022Sparse PCA With Multiple Components29 Sep 2022
- 2022Unsupervised EHR-based Phenotyping via Matrix and Tensor Decompositions1 Sep 2022
- 2022Signal Decomposition Using Masked Proximal Operators18 Feb 2022
- 2022Machine Learning in Aerodynamic Shape Optimization15 Feb 2022
- 2022Graph-based Neural Acceleration for Nonnegative Matrix Factorization1 Feb 2022
- 2022Tensor and Matrix Low-Rank Value-Function Approximation in Reinforcement Learning21 Jan 2022
- 2022Fair and efficient contribution valuation for vertical federated learning7 Jan 2022
- 2022Asymptotics of ℓ2 Regularized Network Embeddings5 Jan 2022
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learning1 Dec 2021
50 newest of 55 All 55 (JSON)
- 2021Is Attention Better Than Matrix Decomposition?cited by 75
- 2022Machine Learning in Aerodynamic Shape Optimizationcited by 39
- 2022Fair and efficient contribution valuation for vertical federated learningcited by 18
- 2022Tensor and Matrix Low-Rank Value-Function Approximation in Reinforcement Learningcited by 16
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learningcited by 13
- 2021Low-rank State-action Value-function Approximationcited by 10
- 2022Graph-based Neural Acceleration for Nonnegative Matrix Factorizationcited by 9
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Banditscited by 9
- 2023Doubly High-Dimensional Contextual Bandits: An Interpretable Model for Joint Assortment-Pricingcited by 8
- 2022Federated PCA on Grassmann Manifold for Anomaly Detection in IoT Networkscited by 5
- 2022Unsupervised EHR-based Phenotyping via Matrix and Tensor Decompositionscited by 4
- 2022Sparse PCA With Multiple Componentscited by 4
12 most cited of 53 All 53 (JSON)
- 2026On the Regularization Landscape for the Linear Recommendation Models10 Sep 2026
- 2026Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure21 Aug 2026
- 2026On the Complexity of Low-Rank Matrix Signing and Entrywise Power Matrix Factorization6 Jul 2026
- 2026Asymptotic Signal Subspace Recovery in Softmax Attention Models21 Jun 2026
- 2026Latent Structural Categorical Matrix Completion with Application to Quasispecies Analysis6 Jun 2026
- 2026Manifold-based Algorithms for the Hadamard Decomposition27 May 2026
- 2026LAPLEX: The FFT of Learnable Laplace Kernels23 May 2026
- 2026Fast and Effective Computation of Generalized Symmetric Matrix Factorization19 Mar 2026
- 2026AI Evaluation Should Require Standardized Item-Level Data Releases27 Feb 2026
- 2025Low-rank MMSE filters, Kronecker-product representation, and regularization: a new perspective16 Dec 2025
- 2025Algorithms for Boolean Matrix Factorization using Integer Programming and Heuristics3 Dec 2025
- 2025Multilingual Lexical Feature Analysis of Spoken Language for Predicting Major Depression Symptom Severity10 Nov 2025
12 newest of 53 All 53 (JSON)