mlsanityData to 7 Oct 2026

Improved Diversity-Promoting Collaborative Metric Learning for Recommendation

arXiv 2409.01012 ↗First posted 2 Sep 2024cs.IR cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and collaborative filtering. Following the convention of RS, existing practices exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called textitDiversity-Promoting Collaborative Metric Learning (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to introduce a set of multiple representations for each user in the system where users' preference toward an item is aggregated by taking the minimum item-user distance among their embedding set. Specifically, we instantiate two effective assignment strategies to explore a proper quantity of vectors for each user. Meanwhile, a textitDiversity Control Regularization Scheme (DCRS) is developed to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could induce a smaller generalization error than traditional CML. Furthermore, we notice that CML-based approaches usually require textitnegative sampling to reduce the heavy computational burden caused by the pairwise objective therein. In this paper, we reveal the fundamental limitation of the widely adopted hard-aware sampling from the One-Way Partial AUC (OPAUC) perspective and then develop an effective sampling alternative for the CML-based paradigm. Finally, comprehensive experiments over a range of benchmark datasets speak to the efficacy of DPCML. Code are available at urlhttps://github.com/statusrank/LibCML.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 66 of its 157 references that are in the map. First posted on arXiv 2 Sep 2024.

Builds on

66 of 157 references.

References · 66

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  3. 2017Neural Collaborative Filteringcited by 1,108
  4. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  5. 2019Neural Graph Collaborative Filteringcited by 660
  6. 2020Contrastive Learning with Hard Negative Samplescited by 619
  7. 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
  8. 2018Variational Autoencoders for Collaborative Filteringcited by 308
  9. 2017Sampling Matters in Deep Embedding Learningcited by 285
  10. 2014Learning Fine-grained Image Similarity with Deep Rankingcited by 189
  11. 2019SoftTriple Loss: Deep Metric Learning Without Triplet Samplingcited by 163
  12. 2020Neural Collaborative Filtering vs. Matrix Factorization Revisitedcited by 123
38 more
  1. 2019Learning Disentangled Representations for Recommendationcited by 110
  2. 2017Deep Metric Learning with Angular Losscited by 107
  3. 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 100
  4. 2022AUC Maximization in the Era of Big Data and AI: A Surveycited by 100
  5. 2017Smart Mining for Deep Metric Learningcited by 96
  6. 2018RepMet: Representative-based metric learning for classification and one-shot object detectioncited by 85
  7. 2020Denoising Implicit Feedback for Recommendationcited by 80
  8. 2017On Sampling Strategies for Neural Network-based Collaborative Filteringcited by 71
  9. 2019Generalization bounds for deep convolutional neural networkscited by 58
  10. 2019Hardness-Aware Deep Metric Learningcited by 55
  11. 2021A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learningcited by 54
  12. 2017Learning with Average Top-k Losscited by 52
  13. 2018Outer Product-based Neural Collaborative Filteringcited by 41
  14. 2020Reinforced Negative Sampling over Knowledge Graph for Recommendationcited by 40
  15. 2017Latent Relational Metric Learning via Memory-based Attention for Collaborative Rankingcited by 38
  16. 2019Learning Similarity Conditions Without Explicit Supervisioncited by 36
  17. 2021Learning with Multiclass AUC: Theory and Algorithmscited by 35
  18. 2021DGCN: Diversified Recommendation with Graph Convolutional Networkscited by 29
  19. 2022When AUC meets DRO: Optimizing Partial AUC for Deep Learning with Non-Convex Convergence Guaranteecited by 29
  20. 2020PiRank: Scalable Learning To Rank via Differentiable Sortingcited by 26
  21. 2016A Neural Autoregressive Approach to Collaborative Filteringcited by 23
  22. 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22
  23. 2019Recommendations and User Agency: The Reachability of Collaboratively-Filtered Informationcited by 21
  24. 2020Towards Open-World Recommendation: An Inductive Model-based Collaborative Filtering Approachcited by 20
  25. 2023On the Theories Behind Hard Negative Sampling for Recommendationcited by 18
  26. 2019Multi-Component Graph Convolutional Collaborative Filteringcited by 17
  27. 2019Collaborative Translational Metric Learningcited by 16
  28. 2020Sharing Matters for Generalization in Deep Metric Learningcited by 15
  29. 2022Large-scale Optimization of Partial AUC in a Range of False Positive Ratescited by 15
  30. 2022Rethinking Collaborative Metric Learning: Toward an Efficient Alternative without Negative Samplingcited by 14
  31. 2019Unimodal-uniform Constrained Wasserstein Training for Medical Diagnosiscited by 13
  32. 2022Hard Negative Sampling Strategies for Contrastive Representation Learningcited by 13
  33. 2019Improving Collaborative Metric Learning with Efficient Negative Samplingcited by 11
  34. 2022Multi-block Min-max Bilevel Optimization with Applications in Multi-task Deep AUC Maximizationcited by 11
  35. 2015Local Rademacher Complexity Bounds based on Covering Numberscited by 10
  36. 2021Recommending Accurate and Diverse Items Using Bilateral Branch Networkcited by 10
  37. 2021The Stereotyping Problem in Collaboratively Filtered Recommender Systemscited by 10
  38. 2022Benchmarking Deep AUROC Optimization: Loss Functions and Algorithmic Choicescited by 10

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 3.

9 papers.