mlsanityData to 7 Oct 2026

Consensus Learning from Heterogeneous Objectives for One-Class Collaborative Filtering

arXiv 2202.13140 ↗First posted 26 Feb 2022cs.LG cs.IRcited by 5

Not on the map. Why?

Abstract (arXiv)

Over the past decades, for One-Class Collaborative Filtering (OCCF), many learning objectives have been researched based on a variety of underlying probabilistic models. From our analysis, we observe that models trained with different OCCF objectives capture distinct aspects of user-item relationships, which in turn produces complementary recommendations. This paper proposes a novel OCCF framework, named ConCF, that exploits the complementarity from heterogeneous objectives throughout the training process, generating a more generalizable model. ConCF constructs a multi-branch variant of a given target model by adding auxiliary heads, each of which is trained with heterogeneous objectives. Then, it generates consensus by consolidating the various views from the heads, and guides the heads based on the consensus. The heads are collaboratively evolved based on their complementarity throughout the training, which again results in generating more accurate consensus iteratively. After training, we convert the multi-branch architecture back to the original target model by removing the auxiliary heads, thus there is no extra inference cost for the deployment. Our extensive experiments on real-world datasets demonstrate that ConCF significantly improves the generalization of the model by exploiting the complementarity from heterogeneous objectives.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 26 Feb 2022.

Builds on

32 of 65 references.

References · 32

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  3. 2017Neural Collaborative Filteringcited by 1,108
  4. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  5. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  6. 2019Neural Graph Collaborative Filteringcited by 660
  7. 2017Deep Mutual Learningcited by 621
  8. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
  9. 2018Variational Autoencoders for Collaborative Filteringcited by 308
  10. 2018Knowledge Distillation by On-the-Fly Native Ensemblecited by 186
  11. 2018Collaborative Learning for Deep Neural Networkscited by 69
  12. 2018Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender Systemcited by 60
20 more
  1. 2020Peer Collaborative Learning for Online Knowledge Distillationcited by 58
  2. 2018Adversarial Personalized Ranking for Recommendationcited by 48
  3. 2017Latent Relational Metric Learning via Memory-based Attention for Collaborative Rankingcited by 38
  4. 2020Simplify and Robustify Negative Sampling for Implicit Collaborative Filteringcited by 34
  5. 2021Dynamic Graph Collaborative Filteringcited by 33
  6. 2021Socially-Aware Self-Supervised Tri-Training for Recommendationcited by 32
  7. 2021AutoLoss: Automated Loss Function Search in Recommendationscited by 31
  8. 2019AM-LFS: AutoML for Loss Function Searchcited by 29
  9. 2020DE-RRD: A Knowledge Distillation Framework for Recommender Systemcited by 28
  10. 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
  11. 2021Topology Distillation for Recommender Systemcited by 24
  12. 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22
  13. 2021Bidirectional Distillation for Top-K Recommender Systemcited by 21
  14. 2019Multi-stakeholder Recommendation and its Connection to Multi-sided Fairnesscited by 19
  15. 2019Improving End-to-End Sequential Recommendations with Intent-aware Diversificationcited by 12
  16. 2020Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modelingcited by 12
  17. 2019Distilling Structured Knowledge into Embeddings for Explainable and Accurate Recommendationcited by 10
  18. 2021Dual Correction Strategy for Ranking Distillation in Top-N Recommender Systemcited by 10
  19. 2019Collaborative Metric Learning with Memory Network for Multi-Relational Recommender Systemscited by 7
  20. 2018Neural Collaborative Rankingcited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 3.

5 papers.