# Rethinking Missing Data: Aleatoric Uncertainty-Aware Recommendation

arXiv: https://arxiv.org/abs/2209.11679 · HTML: https://mlsanity.com/paper/2209.11679/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 28 of its 67 references that are in the map.
- First posted on arXiv 22 Sep 2022.

## Builds on (most cited first, 28 of 28)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?](https://mlsanity.com/paper/1703.04977/) (2017)
- [LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation](https://mlsanity.com/paper/2002.02126/) (2020)
- [A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges](https://mlsanity.com/paper/2011.06225/) (2020)
- [Variational Autoencoders for Collaborative Filtering](https://mlsanity.com/paper/1802.05814/) (2018)
- [Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks](https://mlsanity.com/paper/1807.07356/) (2018)
- [Recommendations as Treatments: Debiasing Learning and Evaluation](https://mlsanity.com/paper/1602.05352/) (2016)
- [Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation](https://mlsanity.com/paper/2003.03773/) (2020)
- [Causal Intervention for Leveraging Popularity Bias in Recommendation](https://mlsanity.com/paper/2105.06067/) (2021)
- [Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba](https://mlsanity.com/paper/1803.02349/) (2018)
- [Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System](https://mlsanity.com/paper/2010.15363/) (2020)
- [Managing Popularity Bias in Recommender Systems with Personalized Re-ranking](https://mlsanity.com/paper/1901.07555/) (2019)
- [Unbiased Recommender Learning from Missing-Not-At-Random Implicit Feedback](https://mlsanity.com/paper/1909.03601/) (2019)
- [Modeling User Exposure in Recommendation](https://mlsanity.com/paper/1510.07025/) (2015)
- [AutoDebias: Learning to Debias for Recommendation](https://mlsanity.com/paper/2105.04170/) (2021)
- [PU Learning for Matrix Completion](https://mlsanity.com/paper/1411.6081/) (2014)
- [Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasets](https://mlsanity.com/paper/2207.05471/) (2022)
- [Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation](https://mlsanity.com/paper/2106.06165/) (2021)
- [M2GRL: A Multi-task Multi-view Graph Representation Learning Framework for Web-scale Recommender Systems](https://mlsanity.com/paper/2005.10110/) (2020)
- [Sampler Design for Implicit Feedback Data by Noisy-label Robust Learning](https://mlsanity.com/paper/2007.07204/) (2020)
- [Fast Adaptively Weighted Matrix Factorization for Recommendation with Implicit Feedback](https://mlsanity.com/paper/2003.01892/) (2020)
- [UKD: Debiasing Conversion Rate Estimation via Uncertainty-regularized Knowledge Distillation](https://mlsanity.com/paper/2201.08024/) (2022)
- [Addressing Confounding Feature Issue for Causal Recommendation](https://mlsanity.com/paper/2205.06532/) (2022)
- [Convolutional Gaussian Embeddings for Personalized Recommendation with Uncertainty](https://mlsanity.com/paper/2006.10932/) (2020)
- [Be Causal: De-biasing Social Network Confounding in Recommendation](https://mlsanity.com/paper/2105.07775/) (2021)
- [Scalable Recommendation with Poisson Factorization](https://mlsanity.com/paper/1311.1704/) (2013)
- [Deep density networks and uncertainty in recommender systems](https://mlsanity.com/paper/1711.02487/) (2017)
- [Multi-output Gaussian Processes for Uncertainty-aware Recommender Systems](https://mlsanity.com/paper/2106.04221/) (2021)

## Built on by (most cited first, 6 of 6)

- [Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation](https://mlsanity.com/paper/2301.12197/) (2023)
- [Improving Uncertainty Quantification of Variance Networks by Tree-Structured Learning](https://mlsanity.com/paper/2212.12658/) (2022)
- [Conv4Rec: A 1-by-1 Convolutional AutoEncoder for User Profiling through Joint Analysis of Implicit and Explicit Feedbacks](https://mlsanity.com/paper/2509.07499/) (2025)
- [Empirical and Experimental Perspectives on Big Data in Recommendation Systems: A Comprehensive Survey](https://mlsanity.com/paper/2402.03368/) (2024)
- [Taylor-Sensus Network: Embracing Noise to Enlighten Uncertainty for Scientific Data](https://mlsanity.com/paper/2409.07942/) (2024)
- [Enhancing guidance for missing data in diffusion-based sequential recommendation](https://mlsanity.com/paper/2601.15673/) (2026)

## Abstract (arXiv)

Historical interactions are the default choice for recommender model training, which typically exhibit high sparsity, i.e., most user-item pairs are unobserved missing data. A standard choice is treating the missing data as negative training samples and estimating interaction likelihood between user-item pairs along with the observed interactions. In this way, some potential interactions are inevitably mislabeled during training, which will hurt the model fidelity, hindering the model to recall the mislabeled items, especially the long-tail ones. In this work, we investigate the mislabeling issue from a new perspective of aleatoric uncertainty, which describes the inherent randomness of missing data. The randomness pushes us to go beyond merely the interaction likelihood and embrace aleatoric uncertainty modeling. Towards this end, we propose a new Aleatoric Uncertainty-aware Recommendation (AUR) framework that consists of a new uncertainty estimator along with a normal recommender model. According to the theory of aleatoric uncertainty, we derive a new recommendation objective to learn the estimator. As the chance of mislabeling reflects the potential of a pair, AUR makes recommendations according to the uncertainty, which is demonstrated to improve the recommendation performance of less popular items without sacrificing the overall performance. We instantiate AUR on three representative recommender models: Matrix Factorization (MF), LightGCN, and VAE from mainstream model architectures. Extensive results on two real-world datasets validate the effectiveness of AUR w.r.t. better recommendation results, especially on long-tail items.
