Fast Multi-Step Critiquing for VAE-based Recommender Systems
Not on the map. Why?
Abstract (arXiv)
Recent studies have shown that providing personalized explanations alongside recommendations increases trust and perceived quality. Furthermore, it gives users an opportunity to refine the recommendations by critiquing parts of the explanations. On one hand, current recommender systems model the recommendation, explanation, and critiquing objectives jointly, but this creates an inherent trade-off between their respective performance. On the other hand, although recent latent linear critiquing approaches are built upon an existing recommender system, they suffer from computational inefficiency at inference due to the objective optimized at each conversation's turn. We address these deficiencies with M&Ms-VAE, a novel variational autoencoder for recommendation and explanation that is based on multimodal modeling assumptions. We train the model under a weak supervision scheme to simulate both fully and partially observed variables. Then, we leverage the generalization ability of a trained M&Ms-VAE model to embed the user preference and the critique separately. Our work's most important innovation is our critiquing module, which is built upon and trained in a self-supervised manner with a simple ranking objective. Experiments on four real-world datasets demonstrate that among state-of-the-art models, our system is the first to dominate or match the performance in terms of recommendation, explanation, and multi-step critiquing. Moreover, M&Ms-VAE processes the critiques up to 25.6x faster than the best baselines. Finally, we show that our model infers coherent joint and cross generation, even under weak supervision, thanks to our multimodal-based modeling and training scheme.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 3 May 2021.
Builds on
19 of 51 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2017Neural Collaborative Filteringcited by 1,108
- 2019On the Convergence of Adam and Beyondcited by 834
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2015Generating Sentences from a Continuous Spacecited by 607
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
- 2018Variational Autoencoders for Collaborative Filteringcited by 308
- 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2018Learning Factorized Multimodal Representationscited by 171
7 more
- 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
- 2020Multimodal Generative Learning Utilizing Jensen-Shannon-Divergencecited by 48
- 2020Analysis of Q-learning with Adaptation and Momentum Restart for Gradient Descentcited by 26
- 2020How Useful are Reviews for Recommendation? A Critical Review and Potential Improvementscited by 24
- 2020HotelRec: a Novel Very Large-Scale Hotel Recommendation Datasetcited by 14
- 2020Interacting with Explanations through Critiquingcited by 9
- 2018Knowledge-aware Autoencoders for Explainable Recommender Sytemscited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 0; 2025: 1.
6 papers.
- 2023Editable User Profiles for Controllable Text Recommendationcited by 16
- 2023A Survey on Fairness-aware Recommender Systemscited by 14
- 2021Self-Supervised Bot Play for Conversational Recommendation with Justificationscited by 5
- 2022Assistive Recipe Editing through Critiquingcited by 2
- 2025Privacy-Utility-Bias Trade-offs for Privacy-Preserving Recommender Systemscited by 2
- 2022Positive and Negative Critiquing for VAE-based Recommenderscited by 0
- 2025Privacy-Utility-Bias Trade-offs for Privacy-Preserving Recommender Systems27 Nov 2025
- 2023A Survey on Fairness-aware Recommender Systems1 Jun 2023
- 2023Editable User Profiles for Controllable Text Recommendation9 Apr 2023
- 2022Assistive Recipe Editing through Critiquing5 May 2022
- 2022Positive and Negative Critiquing for VAE-based Recommenders5 Apr 2022
- 2021Self-Supervised Bot Play for Conversational Recommendation with Justifications9 Dec 2021