Consensus Learning from Heterogeneous Objectives for One-Class Collaborative Filtering
Not on the map. Why?
Abstract (arXiv)
Over the past decades, for One-Class Collaborative Filtering (OCCF), many learning objectives have been researched based on a variety of underlying probabilistic models. From our analysis, we observe that models trained with different OCCF objectives capture distinct aspects of user-item relationships, which in turn produces complementary recommendations. This paper proposes a novel OCCF framework, named ConCF, that exploits the complementarity from heterogeneous objectives throughout the training process, generating a more generalizable model. ConCF constructs a multi-branch variant of a given target model by adding auxiliary heads, each of which is trained with heterogeneous objectives. Then, it generates consensus by consolidating the various views from the heads, and guides the heads based on the consensus. The heads are collaboratively evolved based on their complementarity throughout the training, which again results in generating more accurate consensus iteratively. After training, we convert the multi-branch architecture back to the original target model by removing the auxiliary heads, thus there is no extra inference cost for the deployment. Our extensive experiments on real-world datasets demonstrate that ConCF significantly improves the generalization of the model by exploiting the complementarity from heterogeneous objectives.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 26 Feb 2022.
Builds on
32 of 65 references.
References · 32
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2017Neural Collaborative Filteringcited by 1,108
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2019Neural Graph Collaborative Filteringcited by 660
- 2017Deep Mutual Learningcited by 621
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2018Variational Autoencoders for Collaborative Filteringcited by 308
- 2018Knowledge Distillation by On-the-Fly Native Ensemblecited by 186
- 2018Collaborative Learning for Deep Neural Networkscited by 69
- 2018Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender Systemcited by 60
20 more
- 2020Peer Collaborative Learning for Online Knowledge Distillationcited by 58
- 2018Adversarial Personalized Ranking for Recommendationcited by 48
- 2017Latent Relational Metric Learning via Memory-based Attention for Collaborative Rankingcited by 38
- 2020Simplify and Robustify Negative Sampling for Implicit Collaborative Filteringcited by 34
- 2021Dynamic Graph Collaborative Filteringcited by 33
- 2021Socially-Aware Self-Supervised Tri-Training for Recommendationcited by 32
- 2021AutoLoss: Automated Loss Function Search in Recommendationscited by 31
- 2019AM-LFS: AutoML for Loss Function Searchcited by 29
- 2020DE-RRD: A Knowledge Distillation Framework for Recommender Systemcited by 28
- 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
- 2021Topology Distillation for Recommender Systemcited by 24
- 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22
- 2021Bidirectional Distillation for Top-K Recommender Systemcited by 21
- 2019Multi-stakeholder Recommendation and its Connection to Multi-sided Fairnesscited by 19
- 2019Improving End-to-End Sequential Recommendations with Intent-aware Diversificationcited by 12
- 2020Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modelingcited by 12
- 2019Distilling Structured Knowledge into Embeddings for Explainable and Accurate Recommendationcited by 10
- 2021Dual Correction Strategy for Ranking Distillation in Top-N Recommender Systemcited by 10
- 2019Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systemscited by 7
- 2018Neural Collaborative Rankingcited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 3.
5 papers.
- 2023Distillation from Heterogeneous Models for Top-K Recommendationcited by 13
- 2023MvFS: Multi-view Feature Selection for Recommender Systemcited by 10
- 2024Doubly Calibrated Estimator for Recommendation on Data Missing Not At Randomcited by 7
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Enginecited by 6
- 2024MVIGER: Multi-View Variational Integration of Complementary Knowledge for Generative Recommendercited by 2
- 2024RRADistill: Distilling LLMs' Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine8 Oct 2024
- 2024MVIGER: Multi-View Variational Integration of Complementary Knowledge for Generative Recommender16 Aug 2024
- 2024Doubly Calibrated Estimator for Recommendation on Data Missing Not At Random26 Feb 2024
- 2023MvFS: Multi-view Feature Selection for Recommender System5 Sep 2023
- 2023Distillation from Heterogeneous Models for Top-K Recommendation2 Mar 2023