Embarrassingly Shallow Autoencoders for Sparse Data
Not on the map. Why?
Abstract (arXiv)
Combining simple elements from the literature, we define a linear model that is geared toward sparse data, in particular implicit feedback data for recommender systems. We show that its training objective has a closed-form solution, and discuss the resulting conceptual insights. Surprisingly, this simple model achieves better ranking accuracy than various state-of-the-art collaborative-filtering approaches, including deep non-linear models, on most of the publicly available data-sets used in our experiments.
Key facts. Cited by 93 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 15; 2023: 25; 2024: 12; 2025: 14; 2026: 10.
93 papers.
Sort:
By area:
- 2023Data Distillation: A Surveycited by 86
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
- 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
- 2021How Powerful is Graph Convolution for Recommendation?cited by 50
- 2022Blurring-Sharpening Process Models for Collaborative Filteringcited by 35
- 2022CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attentioncited by 22
- 2021Revisiting the Performance of iALS on Item Recommendation Benchmarkscited by 21
- 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
- 2023Evaluating ChatGPT as a Recommender System: A Rigorous Approachcited by 20
- 2023Adap-τ: Adaptively Modulating Embedding Magnitude for Recommendationcited by 19
- 2021Towards a Better Understanding of Linear Models for Recommendationcited by 18
- 2023AutoSeqRec: Autoencoder for Efficient Sequential Recommendationcited by 15
38 more
- 2022Collaborative Filtering with Attribution Alignment for Review-based Non-overlapped Cross Domain Recommendationcited by 14
- 2022Breaking Feedback Loops in Recommender Systems with Causal Inferencecited by 14
- 2023On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendationcited by 13
- 2024From Variability to Stability: Advancing RecSys Benchmarking Practicescited by 12
- 2025Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1Mcited by 12
- 2022Revisiting Neighborhood-based Link Prediction for Collaborative Filteringcited by 11
- 2021On Estimating Recommendation Evaluation Metrics under Samplingcited by 8
- 2021Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachabilitycited by 8
- 2021Trust your neighbors: A comprehensive survey of neighborhood-based methods for recommender systemscited by 8
- 2023Toward a Better Understanding of Loss Functions for Collaborative Filteringcited by 8
- 2023It's Enough: Relaxing Diagonal Constraints in Linear Autoencoders for Recommendationcited by 7
- 2025Graph Spectral Filtering with Chebyshev Interpolation for Recommendationcited by 7
- 2021Reenvisioning Collaborative Filtering vs Matrix Factorizationcited by 6
- 2023RecFusion: A Binomial Diffusion Process for 1D Data for Recommendationcited by 6
- 2023Recommendation Unlearning via Matrix Correctioncited by 6
- 2021Local Collaborative Autoencoderscited by 5
- 2023Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)cited by 5
- 2023BSL: Understanding and Improving Softmax Loss for Recommendationcited by 5
- 2024How Fair is Your Diffusion Recommender Model?cited by 5
- 2024TEARS: Textual Representations for Scrutable Recommendationscited by 5
- 2021Session-aware Linear Item-Item Models for Session-based Recommendationcited by 4
- 2023When Newer is Not Better: Does Deep Learning Really Benefit Recommendation From Implicit Feedback?cited by 4
- 2025Yambda-5B -- A Large-Scale Multi-modal Dataset for Ranking And Retrievalcited by 4
- 2021Deep Variational Autoencoder with Shallow Parallel Path for Top-N Recommendation (VASP)cited by 3
- 2021iALS++: Speeding up Matrix Factorization with Subspace Optimizationcited by 3
- 2022On the Generalizability and Predictability of Recommender Systemscited by 3
- 2022Fine-tuning Partition-aware Item Similarities for Efficient and Scalable Recommendationcited by 3
- 2023Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven Analysiscited by 3
- 2024Temporal Linear Item-Item Model for Sequential Recommendationcited by 3
- 2025PAC-Bayes Bounds for Multivariate Linear Regression and Linear Autoencoderscited by 3
- 2026Why not Collaborative Filtering in Dual View? Bridging Sparse and Dense Modelscited by 3
- 2022Generalization Bounds for Inductive Matrix Completion in Low-noise Settingscited by 2
- 2023Distributional Off-Policy Evaluation for Slate Recommendationscited by 2
- 2023Impression-Informed Multi-Behavior Recommender System: A Hierarchical Graph Attention Approachcited by 2
- 2025Recommendation Is a Dish Better Served Warmcited by 2
- 2025Ultra Fast Warm Start Solution for Graph Recommendationscited by 2
- 2021On the Regularization of Autoencoderscited by 1
- 2022An Evaluation Study of Generative Adversarial Networks for Collaborative Filteringcited by 1
50 most cited of 93 All 93 (JSON)
- 2026On the Regularization Landscape for the Linear Recommendation Models10 Sep 2026
- 2026DualSpectralCF: Training-Free Sign-Aware Spectral Collaborative Filtering10 Aug 2026
- 2026TailSpec-EASE: Knowledge-Graph-Regularized Linear Recommendation for Web Long-Tail Discovery8 Aug 2026
- 2026ZoRRO: A Zero-Weight Personalized Recommender System for Scalable News Recommendation12 Jul 2026
- 2026Memory Is No Longer a Bottleneck: Memory-Efficient Graph Filtering for Scalable Collaborative Filtering19 Jun 2026
- 2026Bradley-Terry Rankings for Recommender Systems Across Dataset Taxonomies5 Jun 2026
- 2026Generalizing Linear Autoencoder Recommenders with Decoupled Expected Quadratic Loss8 Mar 2026
- 2026AlphaFree: Recommendation Free from Users, IDs, and GNNs3 Mar 2026
- 2026Why not Collaborative Filtering in Dual View? Bridging Sparse and Dense Models14 Jan 2026
- 2026Exploring Diversity, Novelty, and Popularity Bias in ChatGPT's Recommendations5 Jan 2026
- 2025PAC-Bayes Bounds for Multivariate Linear Regression and Linear Autoencoders15 Dec 2025
- 2025On the Mechanisms of Collaborative Learning in VAE Recommenders10 Nov 2025
38 more
- 2025Does Weighting Improve Matrix Factorization for Recommender Systems?12 Oct 2025
- 2025Ultra Fast Warm Start Solution for Graph Recommendations1 Sep 2025
- 2025What Data is Really Necessary? A Feasibility Study of Inference Data Minimization for Recommender Systems29 Aug 2025
- 2025LLM-Enhanced Linear Autoencoders for Recommendation19 Aug 2025
- 2025Recommendation Is a Dish Better Served Warm11 Aug 2025
- 2025Yambda-5B -- A Large-Scale Multi-modal Dataset for Ranking And Retrieval28 May 2025
- 2025Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1M15 May 2025
- 2025Graph Spectral Filtering with Chebyshev Interpolation for Recommendation1 May 2025
- 2025Shallow AutoEncoding Recommender with Cold Start Handling via Side Features3 Apr 2025
- 2025Enhancing Collaborative Filtering-Based Course Recommendations by Exploiting Time-to-Event Information with Survival Analysis27 Feb 2025
- 2025Collaborative Diffusion Model for Recommender System31 Jan 2025
- 2025Private Selection with Heterogeneous Sensitivities9 Jan 2025
- 2024Temporal Linear Item-Item Model for Sequential Recommendation10 Dec 2024
- 2024TEARS: Textual Representations for Scrutable Recommendations25 Oct 2024
- 2024Geometric Collaborative Filtering with Convergence4 Oct 2024
- 2024Quantifying User Coherence: A Unified Framework for Analyzing Recommender Systems Across Domains3 Oct 2024
- 2024How Fair is Your Diffusion Recommender Model?6 Sep 2024
- 2024Fair Augmentation for Graph Collaborative Filtering22 Aug 2024
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learning24 Jun 2024
- 2024Greedy SLIM: A SLIM-Based Approach For Preference Elicitation10 Jun 2024
- 2024ImplicitSLIM and How it Improves Embedding-based Collaborative Filtering31 May 2024
- 2024Measuring the Predictability of Recommender Systems using Structural Complexity Metrics12 Apr 2024
- 2024From Variability to Stability: Advancing RecSys Benchmarking Practices15 Feb 2024
- 2024Fast Dual-Regularized Autoencoder for Sparse Biological Data30 Jan 2024
- 2023BSL: Understanding and Improving Softmax Loss for Recommendation20 Dec 2023
- 2023Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)13 Dec 2023
- 2023(Debiased) Contrastive Learning Loss for Recommendation (Technical Report)13 Dec 2023
- 2023Evaluating ChatGPT as a Recommender System: A Rigorous Approach7 Sep 2023
- 2023Impression-Informed Multi-Behavior Recommender System: A Hierarchical Graph Attention Approach6 Sep 2023
- 2023Distributional Off-Policy Evaluation for Slate Recommendations27 Aug 2023
- 2023Implicit ZCA Whitening Effects of Linear Autoencoders for Recommendation15 Aug 2023
- 2023Bridging Offline-Online Evaluation with a Time-dependent and Popularity Bias-free Offline Metric for Recommenders14 Aug 2023
- 2023AutoSeqRec: Autoencoder for Efficient Sequential Recommendation14 Aug 2023
- 2023Toward a Better Understanding of Loss Functions for Collaborative Filtering11 Aug 2023
- 2023Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven Analysis1 Aug 2023
- 2023Recommendation Unlearning via Matrix Correction29 Jul 2023
- 2023On (Normalised) Discounted Cumulative Gain as an Off-Policy Evaluation Metric for Top-n Recommendation27 Jul 2023
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences26 Jul 2023
50 newest of 93 All 93 (JSON)
- 2023RecFusion: A Binomial Diffusion Process for 1D Data for Recommendationcited by 6
- 2024How Fair is Your Diffusion Recommender Model?cited by 5
- 2025Collaborative Diffusion Model for Recommender Systemcited by 1
- 2025Collaborative Diffusion Model for Recommender System31 Jan 2025
- 2024How Fair is Your Diffusion Recommender Model?6 Sep 2024
- 2023RecFusion: A Binomial Diffusion Process for 1D Data for Recommendation15 Jun 2023
- 2023Data Distillation: A Surveycited by 86
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
- 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
- 2021How Powerful is Graph Convolution for Recommendation?cited by 50
- 2022Blurring-Sharpening Process Models for Collaborative Filteringcited by 35
- 2022CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attentioncited by 22
- 2021Revisiting the Performance of iALS on Item Recommendation Benchmarkscited by 21
- 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
- 2023Evaluating ChatGPT as a Recommender System: A Rigorous Approachcited by 20
- 2023Adap-τ: Adaptively Modulating Embedding Magnitude for Recommendationcited by 19
- 2021Towards a Better Understanding of Linear Models for Recommendationcited by 18
- 2023AutoSeqRec: Autoencoder for Efficient Sequential Recommendationcited by 15
12 most cited of 90 All 90 (JSON)
- 2026On the Regularization Landscape for the Linear Recommendation Models10 Sep 2026
- 2026DualSpectralCF: Training-Free Sign-Aware Spectral Collaborative Filtering10 Aug 2026
- 2026TailSpec-EASE: Knowledge-Graph-Regularized Linear Recommendation for Web Long-Tail Discovery8 Aug 2026
- 2026ZoRRO: A Zero-Weight Personalized Recommender System for Scalable News Recommendation12 Jul 2026
- 2026Memory Is No Longer a Bottleneck: Memory-Efficient Graph Filtering for Scalable Collaborative Filtering19 Jun 2026
- 2026Bradley-Terry Rankings for Recommender Systems Across Dataset Taxonomies5 Jun 2026
- 2026Generalizing Linear Autoencoder Recommenders with Decoupled Expected Quadratic Loss8 Mar 2026
- 2026AlphaFree: Recommendation Free from Users, IDs, and GNNs3 Mar 2026
- 2026Why not Collaborative Filtering in Dual View? Bridging Sparse and Dense Models14 Jan 2026
- 2026Exploring Diversity, Novelty, and Popularity Bias in ChatGPT's Recommendations5 Jan 2026
- 2025PAC-Bayes Bounds for Multivariate Linear Regression and Linear Autoencoders15 Dec 2025
- 2025On the Mechanisms of Collaborative Learning in VAE Recommenders10 Nov 2025
12 newest of 90 All 90 (JSON)