Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares
Not on the map. Why?
Abstract (arXiv)
The matrix-completion problem has attracted a lot of attention, largely as a result of the celebrated Netflix competition. Two popular approaches for solving the problem are nuclear-norm-regularized matrix approximation (Candes and Tao, 2009, Mazumder, Hastie and Tibshirani, 2010), and maximum-margin matrix factorization (Srebro, Rennie and Jaakkola, 2005). These two procedures are in some cases solving equivalent problems, but with quite different algorithms. In this article we bring the two approaches together, leading to an efficient algorithm for large matrix factorization and completion that outperforms both of these. We develop a software package "softImpute" in R for implementing our approaches, and a distributed version for very large matrices using the "Spark" cluster programming environment.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 15; 2023: 15; 2024: 24; 2025: 18; 2026: 15.
104 papers.
Sort:
By area:
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2023Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Treescited by 60
- 2021Causal Matrix Completioncited by 45
- 2023ReMasker: Imputing Tabular Data with Masked Autoencodingcited by 35
- 2023Transformed Distribution Matching for Missing Value Imputationcited by 31
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputationcited by 17
- 2021Multiple Imputation via Generative Adversarial Network for High-dimensional Blockwise Missing Value Problemscited by 15
- 2022Data Imputation with Iterative Graph Reconstructioncited by 15
- 2021Smooth Bilevel Programming for Sparse Regularizationcited by 14
- 2022Numerical Optimizations for Weighted Low-rank Estimation on Language Modelcited by 14
- 2024On Speeding Up Language Model Evaluationcited by 14
- 2025Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetriescited by 13
38 more
- 2022Handling Missing Data via Max-Entropy Regularized Graph Autoencodercited by 12
- 2022Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensingcited by 11
- 2022Smooth over-parameterized solvers for non-smooth structured optimizationcited by 11
- 2021Multi-source Learning via Completion of Block-wise Overlapping Noisy Matricescited by 10
- 2022Efficient Nearest Neighbor Search for Cross-Encoder Models using Matrix Factorizationcited by 10
- 2023Recursive Video Lane Detectioncited by 9
- 2021Fairness in Missing Data Imputationcited by 8
- 2021Matrix Completion with Model-free Weightingcited by 6
- 2024A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Modelscited by 5
- 2024Explainability of Machine Learning Models under Missing Datacited by 5
- 2021Low-rank Matrix Recovery With Unknown Correspondencecited by 4
- 2023AmGCL: Feature Imputation of Attribute Missing Graph via Self-supervised Contrastive Learningcited by 4
- 2024Unmasking Trees for Tabular Datacited by 4
- 2021Wasserstein Graph Neural Networks for Graphs with Missing Attributescited by 3
- 2022Multiple Imputation with Neural Network Gaussian Process for High-dimensional Incomplete Datacited by 3
- 2023Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approachcited by 3
- 2024Asymptotic Dynamics of Alternating Minimization for Bilinear Regressioncited by 3
- 2024Online Policy Learning and Inference by Matrix Completioncited by 3
- 2024On the Low-Rank Parametrization of Reward Models for Controlled Language Generationcited by 3
- 2025Incomplete Graph Learning: A Comprehensive Surveycited by 3
- 2025CACTI: Leveraging Copy Masking and Contextual Information to Improve Tabular Data Imputationcited by 3
- 2021The Power of Subsampling in Submodular Maximizationcited by 2
- 2021How Low Can We Go: Trading Memory for Error in Low-Precision Trainingcited by 2
- 2021Weighted Low-Rank Matrix Approximation: Acceleration and Applicationscited by 2
- 2022Principal Component Analysis based frameworks for efficient missing data imputation algorithmscited by 2
- 2023Conditional expectation with regularization for missing data imputationcited by 2
- 2023Adversarial Learning for Feature Shift Detection and Correctioncited by 2
- 2024Causal Imputation for Counterfactual SCMs: Bridging Graphs and Latent Factor Modelscited by 2
- 2024Statistical Inference For Noisy Matrix Completion Incorporating Auxiliary Informationcited by 2
- 2024RE-RecSys: An End-to-End system for recommending properties in Real-Estate domaincited by 2
- 2024Learning Counterfactual Distributions via Kernel Nearest Neighborscited by 2
- 2025Representation Learning of Lab Values via Masked AutoEncoderscited by 2
- 2025Missing Data in Signal Processing and Machine Learning: Models, Methods and Modern Approachescited by 2
- 2025One Pipeline, Many Transformers: Pattern-Specific Imputation Specialists for Tabular Missing Datacited by 2
- 2026Large Language Models for Missing Data Imputation: Understanding Behavior, Hallucination Effects, and Control Mechanismscited by 2
- 2026SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulationcited by 2
- 2021NoisyCUR: An algorithm for two-cost budgeted matrix completioncited by 1
- 2021Dimension Reduction for Data with Heterogeneous Missingnesscited by 1
50 most cited of 104 All 104 (JSON)
- 2026Retraction-Based Gradient Projection Algorithms on Manifolds25 Sep 2026
- 2026Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data11 Sep 2026
- 2026Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure21 Aug 2026
- 2026Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation8 Jul 2026
- 2026MNAR-k-means: A k-means Clustering for Data Missing Not at Random with Magnitude-Decaying Probability30 Jun 2026
- 2026Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate24 May 2026
- 2026Learning Causal Orderings for In-Context Tabular Prediction21 May 2026
- 2026Group-Aware Matrix Estimation and Latent Subspace Recovery19 May 2026
- 2026An Exterior Method for Nonnegative Matrix Factorization19 May 2026
- 2026Predicting missing values: A good idea?5 May 2026
- 2026VineLM: Trie-Based Fine-Grained Control for Agentic Workflows9 Apr 2026
- 2026SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation8 Apr 2026
38 more
- 2026Large Language Models for Missing Data Imputation: Understanding Behavior, Hallucination Effects, and Control Mechanisms20 Mar 2026
- 2026Beyond SGD, Without SVD: Proximal Subspace Iteration LoRA with Diagonal Fractional K-FAC18 Feb 2026
- 2026One-Sided Matrix Completion from Ultra-Sparse Samples18 Jan 2026
- 2025Generalization Bounds for Semi-supervised Matrix Completion with Distributional Side Information17 Nov 2025
- 2025Efficient Tensor Completion Algorithms for Highly Oscillatory Operators20 Oct 2025
- 2025One Pipeline, Many Transformers: Pattern-Specific Imputation Specialists for Tabular Missing Data3 Oct 2025
- 2025TabINR: An Implicit Neural Representation Framework for Tabular Data Imputation1 Oct 2025
- 2025Core-elements Subsampling for Alternating Least Squares22 Sep 2025
- 2025kNNSampler: Stochastic Imputations for Recovering Missing Value Distributions10 Sep 2025
- 2025Conv4Rec: A 1-by-1 Convolutional AutoEncoder for User Profiling through Joint Analysis of Implicit and Explicit Feedbacks9 Sep 2025
- 2025Towards Bridging Review Sparsity in Recommendation with Textual Edge Graph Representation2 Aug 2025
- 2025IMAGIC-500: IMputation benchmark on A Generative Imaginary Country (500k samples)10 Jun 2025
- 2025N2: A Unified Python Package and Test Bench for Nearest Neighbor-Based Matrix Completion4 Jun 2025
- 2025CACTI: Leveraging Copy Masking and Contextual Information to Improve Tabular Data Imputation2 Jun 2025
- 2025Missing Data in Signal Processing and Machine Learning: Models, Methods and Modern Approaches2 Jun 2025
- 2025Optimal Transport with Heterogeneously Missing Data22 May 2025
- 2025Adaptively-weighted Nearest Neighbors for Matrix Completion14 May 2025
- 2025Low Rank Learning for Offline Query Optimization8 Apr 2025
- 2025Incomplete Graph Learning: A Comprehensive Survey18 Feb 2025
- 2025Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries4 Feb 2025
- 2025Representation Learning of Lab Values via Masked AutoEncoders5 Jan 2025
- 2024Towards Reliable Recommender Systems for Rating Data30 Dec 2024
- 2024Two-Sided Nearest Neighbors: An adaptive and minimax optimal procedure for matrix completion20 Nov 2024
- 2024Enhancing Missing Data Imputation through Combined Bipartite Graph and Complete Directed Graph7 Nov 2024
- 2024Low-rank Bayesian matrix completion via geodesic Hamiltonian Monte Carlo on Stiefel manifolds27 Oct 2024
- 2024Learning Counterfactual Distributions via Kernel Nearest Neighbors17 Oct 2024
- 2024M3-Impute: Mask-guided Representation Learning for Missing Value Imputation11 Oct 2024
- 2024On subdifferential chain rule of matrix factorization and beyond7 Oct 2024
- 2024On Speeding Up Language Model Evaluation8 Jul 2024
- 2024Unmasking Trees for Tabular Data8 Jul 2024
- 2024On the Low-Rank Parametrization of Reward Models for Controlled Language Generation5 Jul 2024
- 2024Directly Handling Missing Data in Linear Discriminant Analysis for Enhancing Classification Accuracy and Interpretability30 Jun 2024
- 2024Explainability of Machine Learning Models under Missing Data29 Jun 2024
- 2024Convergence of the majorized PAM method with subspace correction for low-rank composite factorization model7 Jun 2024
- 2024Reweighted Solutions for Weighted Low Rank Approximation4 Jun 2024
- 2024DiffPuter: Empowering Diffusion Models for Missing Data Imputation31 May 2024
- 2024Gradient Guided Hypotheses: A unified solution to enable machine learning models on scarce and noisy data regimes29 May 2024
- 2024A Context-Aware Approach for Enhancing Data Imputation with Pre-trained Language Models28 May 2024
50 newest of 104 All 104 (JSON)
- 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 81
- 2023Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Treescited by 60
- 2021Causal Matrix Completioncited by 45
- 2023ReMasker: Imputing Tabular Data with Masked Autoencodingcited by 35
- 2023Transformed Distribution Matching for Missing Value Imputationcited by 31
- 2021Multiple Imputation via Generative Adversarial Network for High-dimensional Blockwise Missing Value Problemscited by 15
- 2022Data Imputation with Iterative Graph Reconstructioncited by 15
- 2021Smooth Bilevel Programming for Sparse Regularizationcited by 14
- 2022Numerical Optimizations for Weighted Low-rank Estimation on Language Modelcited by 14
- 2024On Speeding Up Language Model Evaluationcited by 14
- 2025Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetriescited by 13
- 2022Handling Missing Data via Max-Entropy Regularized Graph Autoencodercited by 12
12 most cited of 101 All 101 (JSON)
- 2026Retraction-Based Gradient Projection Algorithms on Manifolds25 Sep 2026
- 2026Synthetic Nearest Neighbors: Extending Synthetic Controls for Matrix Completion with Missing Not at Random Data11 Sep 2026
- 2026Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure21 Aug 2026
- 2026Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation8 Jul 2026
- 2026MNAR-k-means: A k-means Clustering for Data Missing Not at Random with Magnitude-Decaying Probability30 Jun 2026
- 2026Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate24 May 2026
- 2026Learning Causal Orderings for In-Context Tabular Prediction21 May 2026
- 2026Group-Aware Matrix Estimation and Latent Subspace Recovery19 May 2026
- 2026An Exterior Method for Nonnegative Matrix Factorization19 May 2026
- 2026Predicting missing values: A good idea?5 May 2026
- 2026SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation8 Apr 2026
- 2026Large Language Models for Missing Data Imputation: Understanding Behavior, Hallucination Effects, and Control Mechanisms20 Mar 2026
12 newest of 101 All 101 (JSON)