Exact-K Recommendation via Maximal Clique Optimization
Not on the map. Why?
Abstract (arXiv)
This paper targets to a novel but practical recommendation problem named exact-K recommendation. It is different from traditional top-K recommendation, as it focuses more on (constrained) combinatorial optimization which will optimize to recommend a whole set of K items called card, rather than ranking optimization which assumes that "better" items should be put into top positions. Thus we take the first step to give a formal problem definition, and innovatively reduce it to Maximum Clique Optimization based on graph. To tackle this specific combinatorial optimization problem which is NP-hard, we propose Graph Attention Networks (GAttN) with a Multi-head Self-attention encoder and a decoder with attention mechanism. It can end-to-end learn the joint distribution of the K items and generate an optimal card rather than rank individual items by prediction scores. Then we propose Reinforcement Learning from Demonstrations (RLfD) which combines the advantages in behavior cloning and reinforcement learning, making it sufficient- and-efficient to train the model. Extensive experiments on three datasets demonstrate the effectiveness of our proposed GAttN with RLfD method, it outperforms several strong baselines with a relative improvement of 7.7% and 4.7% on average in Precision and Hit Ratio respectively, and achieves state-of-the-art (SOTA) performance for the exact-K recommendation problem.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 1; 2023: 3; 2024: 4.
14 papers.
Sort:
By area:
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 19
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendationcited by 18
- 2021Variation Control and Evaluation for Generative SlateRecommendationscited by 10
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Rewardcited by 10
- 2021Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendationcited by 9
- 2021Supervised Advantage Actor-Critic for Recommender Systemscited by 8
- 2021RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender Systemcited by 5
- 2021Value Penalized Q-Learning for Recommender Systemscited by 4
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendationcited by 1
- 2023Master-slave Deep Architecture for Top-K Multi-armed Bandits with Non-linear Bandit Feedback and Diversity Constraintscited by 0
- 2023Adversarial Batch Inverse Reinforcement Learning: Learn to Reward from Imperfect Demonstration for Interactive Recommendationcited by 0
- 2024Non-autoregressive Personalized Bundle Generationcited by 0
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation11 Sep 2024
- 2024Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce1 Aug 2024
- 2024Do Not Wait: Learning Re-Ranking Model Without User Feedback At Serving Time in E-Commerce20 Jun 2024
- 2024Non-autoregressive Personalized Bundle Generation11 Jun 2024
- 2023Adversarial Batch Inverse Reinforcement Learning: Learn to Reward from Imperfect Demonstration for Interactive Recommendation30 Oct 2023
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendation1 Oct 2023
- 2023Master-slave Deep Architecture for Top-K Multi-armed Bandits with Non-linear Bandit Feedback and Diversity Constraints24 Aug 2023
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward25 Sep 2022
- 2021Supervised Advantage Actor-Critic for Recommender Systems5 Nov 2021
- 2021RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender System18 Oct 2021
- 2021Value Penalized Q-Learning for Recommender Systems15 Oct 2021
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directions8 Sep 2021
- 2023Adversarial Batch Inverse Reinforcement Learning: Learn to Reward from Imperfect Demonstration for Interactive Recommendation30 Oct 2023
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendation1 Oct 2023
- 2021Value Penalized Q-Learning for Recommender Systems15 Oct 2021
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 19
- 2021Variation Control and Evaluation for Generative SlateRecommendationscited by 10
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Rewardcited by 10
- 2021Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendationcited by 9
- 2021Supervised Advantage Actor-Critic for Recommender Systemscited by 8
- 2021RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender Systemcited by 5
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendationcited by 1
- 2023Master-slave Deep Architecture for Top-K Multi-armed Bandits with Non-linear Bandit Feedback and Diversity Constraintscited by 0
- 2024Non-autoregressive Personalized Bundle Generationcited by 0
- 2024Do Not Wait: Learning Re-Ranking Model Without User Feedback At Serving Time in E-Commercecited by 0
- 2024Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commercecited by 0
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation11 Sep 2024
- 2024Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce1 Aug 2024
- 2024Do Not Wait: Learning Re-Ranking Model Without User Feedback At Serving Time in E-Commerce20 Jun 2024
- 2024Non-autoregressive Personalized Bundle Generation11 Jun 2024
- 2023Master-slave Deep Architecture for Top-K Multi-armed Bandits with Non-linear Bandit Feedback and Diversity Constraints24 Aug 2023
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward25 Sep 2022
- 2021Supervised Advantage Actor-Critic for Recommender Systems5 Nov 2021
- 2021RL4RS: A Real-World Dataset for Reinforcement Learning based Recommender System18 Oct 2021
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directions8 Sep 2021
- 2021Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendation20 Aug 2021
- 2021Variation Control and Evaluation for Generative SlateRecommendations26 Feb 2021
Similar, not cited
Close in wording, no citation either way
- 2025Tuning-Free LLM Can Build A Strong Recommender Under Sparse Connectivity And Knowledge Gap Via Extracting Intent
- 2026Objective Shaping with Hard Negatives: Windowed Partial AUC Optimization for RL-based LLM Recommenders ↗
- 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Models
- 2024Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity
- 2023DiffKG: Knowledge Graph Diffusion Model for Recommendation
- 2026X-KGRank: A Knowledge Graph RAG Framework for Explainable Recommendations via Pattern Mining and LLM Re-Ranking
- 2024An Automatic Graph Construction Framework based on Large Language Models for Recommendation
- 2021Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendation