Mixture-of-Experts Knowledge Graph Retrieval-Augmented Generation for Multi-Agent LLM-based Recommendation
On the map: Retrieval-augmented generation → RAG for recommendation
also in 2 more
Abstract (arXiv)
Large language models (LLMs) have recently been adopted for recommendations due to their ability to understand user intent and item semantics. However, LLM-based recommender systems often rely on parametric knowledge and suffer from outdated knowledge, motivating knowledge graph retrieval-augmented generation (KG-RAG) to ground recommendations on structured, up-to-date KGs. Despite this promise, effective KG-RAG in recommendations faces great challenges. First, users' queries vary in complexity and require KG knowledge at different granularities, whereas existing methods adopt a one-size-fits-all retrieval strategy, leading to over-retrieval for simple queries and under-retrieval for complex ones. In addition, augmenting LLMs with KG knowledge requires translating graph-structured data into linear text, which may introduce noise and cause structural information loss. Moreover, the selection of retrieval granularity lacks direct supervision and must be inferred from the final recommendation after alignment and downstream utilization, making query-aware retrieval hard to learn end-to-end. To address these issues, we propose MixRAGRec, a cooperative multi-agent framework for KG-RAG recommendations. MixRAGRec integrates a Mixture-of-Experts Retrieval Agent that routes each query to a KG retrieval expert with different granularities, a Knowledge Preference Alignment Agent that converts structured knowledge into LLM-friendly natural language, and a Contrastive Learning-reinforced Recommendation Agent trained with contrastive preference feedback. Notably, we introduce Mixture-of-Experts Multi-Agent Policy Optimization (MMAPO) to train three agents under a unified objective. Extensive experiments on real-world datasets demonstrate the effectiveness of our framework.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in RAG for recommendation, one of 15 directions in Retrieval-augmented generation. Builds on 33 of its 54 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
33 of 54 references.
Closest ancestors · 5
Same direction, newest first
- 2025WebRec: Enhancing LLM-based Recommendations with Attention-guided RAG from Web18 Nov
- 2025Graph Retrieval-Augmented LLM for Conversational Recommendation Systems9 Mar
- 2025G-Refer: Graph Retrieval-Augmented Large Language Model for Explainable Recommendation18 Feb
- 2025RALLRec: Improving Retrieval Augmented Large Language Model Recommendation with Representation Learning10 Feb
- 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation4 Jan
Other references · 28
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023Active Retrieval Augmented Generationcited by 506
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
16 more
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
- 2024Let Your Graph Do the Talking: Encoding Structured Data for LLMscited by 112
- 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 99
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2023Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answeringcited by 64
- 2023LLaRA: Large Language-Recommendation Assistantcited by 56
- 2024NoteLLM: A Retrievable Large Language Model for Note Recommendationcited by 33
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2023Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendationcited by 29
- 2025Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with LLMscited by 20
- 2025Collaborative Retrieval for Large Language Model-based Conversational Recommender Systemscited by 16
- 2023Multi-agent Attacks for Black-box Social Recommendationscited by 9
- 2026STReasoner: Empowering LLMs for Spatio-Temporal Reasoning in Time Series via Spatial-Aware Reinforcement Learningcited by 7
- 2025ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responsescited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025KERAG_R: Knowledge-Enhanced Retrieval-Augmented Generation for Recommendation
- 2025LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking
- 2025MIXRAG : Mixture-of-Experts Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering
- 2026MATRAG: Multi-Agent Transparent Retrieval-Augmented Generation for Explainable Recommendations
- 2026X-KGRank: A Knowledge Graph RAG Framework for Explainable Recommendations via Pattern Mining and LLM Re-Ranking
- 2024Enhancing High-order Interaction Awareness in LLM-based Recommender Model
- 2025Comparative Analysis of Neural Retriever-Reranker Pipelines for Retrieval-Augmented Generation over Knowledge Graphs in E-commerce Applications
- 2025ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation