mlsanityData to 7 Oct 2026

Simulation comparisons between Bayesian and de-biased estimators in low-rank matrix completion

arXiv 2103.11749 ↗First posted 22 Mar 2021stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we study the low-rank matrix completion problem, a class of machine learning problems, that aims at the prediction of missing entries in a partially observed matrix. Such problems appear in several challenging applications such as collaborative filtering, image processing, and genotype imputation. We compare the Bayesian approaches and a recently introduced de-biased estimator which provides a useful way to build confidence intervals of interest. From a theoretical viewpoint, the de-biased estimator comes with a sharp minimax-optimal rate of estimation error whereas the Bayesian approach reaches this rate with an additional logarithmic factor. Our simulation studies show originally interesting results that the de-biased estimator is just as good as the Bayesian estimators. Moreover, Bayesian approaches are much more stable and can outperform the de-biased estimator in the case of small samples. In addition, we also find that the empirical coverage rate of the confidence intervals obtained by the de-biased estimator for an entry is absolutely lower than of the considered credible interval. These results suggest further theoretical studies on the estimation error and the concentration of Bayesian methods as they are quite limited up to present.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 46 references that are in the map. First posted on arXiv 22 Mar 2021.

Builds on

10 of 46 references.

References · 10

  1. 2020Neural Collaborative Filtering vs. Matrix Factorization Revisitedcited by 123
  2. 2014Matrix Completion and Low-Rank SVD via Fast Alternating Least Squarescited by 104
  3. 2017Concentration of tempered posteriors and of their variational approximationscited by 66
  4. 2019On the Difficulty of Evaluating Baselines: A Study on Recommender Systemscited by 46
  5. 2019Inference and Uncertainty Quantification for Noisy Matrix Completioncited by 39
  6. 20161-bit Matrix Completion: PAC-Bayesian Analysis of a Variational Approximationcited by 11
  7. 2017Fast Low-Rank Bayesian Matrix Completion with Hierarchical Gaussian Prior Modelscited by 11
  8. 2013Bayesian methods for low-rank matrix estimation: short survey and theoretical studycited by 7
  9. 2019Multi-View Matrix Completion for Multi-Label Image Classificationcited by 6
  10. 2014Bayesian matrix completion: prior specificationcited by 3

Built on by

Not cited yet.