Retrieval-Augmented Purifier for Robust LLM-Empowered Recommendation
On the map: Retrieval-augmented generation → RAG for recommendation
Abstract (arXiv)
Recently, Large Language Model (LLM)-empowered recommender systems have revolutionized personalized recommendation frameworks and attracted extensive attention. Despite the remarkable success, existing LLM-empowered RecSys have been demonstrated to be highly vulnerable to minor perturbations. To mitigate the negative impact of such vulnerabilities, one potential solution is to employ collaborative signals based on item-item co-occurrence to purify the malicious collaborative knowledge from the user's historical interactions inserted by attackers. On the other hand, due to the capabilities to expand insufficient internal knowledge of LLMs, Retrieval-Augmented Generation (RAG) techniques provide unprecedented opportunities to enhance the robustness of LLM-empowered recommender systems by introducing external collaborative knowledge. Therefore, in this paper, we propose a novel framework (RETURN) by retrieving external collaborative signals to purify the poisoned user profiles and enhance the robustness of LLM-empowered RecSys in a plug-and-play manner. Specifically, retrieval-augmented perturbation positioning is proposed to identify potential perturbations within the users' historical sequences by retrieving external knowledge from collaborative item graphs. After that, we further retrieve the collaborative knowledge to cleanse the perturbations by using either deletion or replacement strategies and introduce a robust ensemble recommendation strategy to generate final robust predictions. Extensive experiments on three real-world datasets demonstrate the effectiveness of the proposed RETURN.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in RAG for recommendation, one of 15 directions in Retrieval-augmented generation. Builds on 69 of its 113 references that are in the map. First posted on arXiv 3 Apr 2025.
Builds on
69 of 113 references.
Closest ancestors · 4
Same direction, newest first
- 2025G-Refer: Graph Retrieval-Augmented Large Language Model for Explainable Recommendation18 Feb
- 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation4 Jan
- 2024Retrieval-Augmented Conversational Recommendation with Prompt-based Semi-Structured Natural Language State Tracking25 May
- 2024CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendation11 Mar
Other references · 65
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2020Reformer: The Efficient Transformercited by 1,668
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 431
38 more
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2023A Survey of Hallucination in Large Foundation Modelscited by 368
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
- 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 244
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 195
- 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 192
- 2023On the Reliability of Watermarks for Large Language Modelscited by 189
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2022A Survey on Retrieval-Augmented Text Generationcited by 158
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 142
- 2023An LLM can Fool Itself: A Prompt-Based Adversarial Attackcited by 116
- 2024Efficient Adversarial Training in LLMs with Continuous Attackscited by 113
- 2020Adversarial Training for Large Neural Language Modelscited by 111
- 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
- 2015Inferring Networks of Substitutable and Complementary Productscited by 92
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2020Denoising Implicit Feedback for Recommendationcited by 80
- 2021Contrastive Learning for Cold-Start Recommendationcited by 79
- 2023The Art of Defending: A Systematic Evaluation and Analysis of LLM Defense Strategies on Safety and Over-Defensivenesscited by 67
- 2023LLaRA: Large Language-Recommendation Assistantcited by 56
- 2020GCN-Based User Representation Learning for Unifying Robust Recommendation and Fraudster Detectioncited by 54
- 2021Graph Trend Filtering Networks for Recommendationscited by 53
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
- 2019Improving Neural Language Modeling via Adversarial Trainingcited by 49
- 2020Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issuecited by 48
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
- 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
- 2023Amazon-M2: A Multilingual Multi-locale Shopping Session Dataset for Recommendation and Text Generationcited by 42
- 2024A Survey of Mambacited by 39
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2019Deep Social Collaborative Filteringcited by 32
- 2020Attacking Black-box Recommendations via Copying Cross-domain User Profilescited by 31
- 2024Leveraging LLM Reasoning Enhances Personalized Recommender Systemscited by 28
- 2022Knowledge-enhanced Black-box Attacks for Recommendationscited by 26
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQAcited by 11
- 2025Exploring Backdoor Attack and Defense for LLM-empowered Recommendationscited by 6
- 2026Autonomous Information Seeking: A Roadmap for Agentic Recommender Systemscited by 4
- 2025WebRec: Enhancing LLM-based Recommendations with Attention-guided RAG from Webcited by 2
- 2026PriHA: A RAG-Enhanced LLM Framework for Primary Healthcare Assistant in Hong Kongcited by 0
- 2026Diffusion Language Model for Recommendationcited by 0
- 2026Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendationcited by 0
- 2026Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation8 Oct 2026
- 2026Diffusion Language Model for Recommendation23 Jul 2026
- 2026Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems5 Jul 2026
- 2026PriHA: A RAG-Enhanced LLM Framework for Primary Healthcare Assistant in Hong Kong10 Apr 2026
- 2025WebRec: Enhancing LLM-based Recommendations with Attention-guided RAG from Web18 Nov 2025
- 2025mKG-RAG: Leveraging Multimodal Knowledge Graphs in Retrieval-Augmented Generation for Knowledge-intensive VQA7 Aug 2025
- 2025Exploring Backdoor Attack and Defense for LLM-empowered Recommendations15 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Do LLMs Understand Collaborative Signals? Diagnosis and Repair
- 2025ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendation
- 2025LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking
- 2025RALLRec+: Retrieval Augmented Large Language Model Recommendation with Reasoning
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
- 2025Balancing Fine-tuning and RAG: A Hybrid Strategy for Dynamic LLM Recommendation Updates
- 2025EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration
- 2025LLMs as Better Recommenders with Natural Language Collaborative Signals: A Self-Assessing Retrieval Approach