mlsanityData to 14 Oct 2026

RAG-VisualRec: An Open Resource for Vision- and Text-Enhanced Retrieval-Augmented Generation in Recommendation

arXiv 2506.20817 ↗First posted 25 Jun 2025cs.IR cs.MMcited by 3

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

This paper addresses the challenge of building multimodal recommender systems for the movie domain, where sparse item metadata (e.g., title and genres) can limit retrieval quality and downstream recommendations. We introduce RAG-VisualRec, an open resource and reproducible pipeline that combines (i) LLM-generated item-side plot descriptions and (ii) trailer-derived visual (and optional audio) embeddings, supporting both retrieval-augmented generation (RAG) and collaborative-filtering style workflows. Our pipeline augments sparse metadata into richer textual signals and integrates modalities via configurable fusion strategies (e.g., PCA and CCA) before retrieval and optional LLM-based re-ranking. Beyond providing the resource, we provide a complementary analysis that increases transparency and reproducibility. In particular, we introduce LLMGenQC, a critic-based quality-control module (LLM-as-judge) that audits synthetic synopses for semantic alignment with metadata, consistency, safety, and basic sanity checks, releasing critic scores and pass/fail labels alongside the generated artifacts. We report ablation studies that quantify the impact of key design choices, including retrieval depth, fusion strategy, and user-embedding construction. Across experiments, CCA-based fusion consistently improves recall over unimodal baselines, while LLM-based re-ranking typically improves nDCG by refining top-K selection from the retrieved candidate pool, especially when textual evidence is limited. By releasing RAG-VisualRec, we enable further research on multimodal RAG recommenders, quality auditing of LLM-generated side information, and long-tail oriented evaluation protocols. All code, data, and detailed documentation are publicly available at: https://github.com/RecSys-lab/RAG-VisualRec.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 17 of its 29 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

17 of 29 references.

References · 17

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  2. 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
  3. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 57
  4. 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
  5. 2023A Content-Driven Micro-Video Recommendation Dataset at Scalecited by 45
  6. 2025Poison-RAG: Adversarial Data Poisoning Attacks on Retrieval-Augmented Generation in Recommender Systemscited by 32
  7. 2024MMREC: LLM Based Multi-Modal Recommender Systemcited by 22
  8. 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Modelscited by 18
  9. 2023MMRec: Simplifying Multimodal Recommendationcited by 17
  10. 2024Federated Recommendation via Hybrid Retrieval Augmented Generationcited by 16
  11. 2024Recommendation with Generative Modelscited by 13
  12. 2025Toward Holistic Evaluation of Recommender Systems Powered by Generative Modelscited by 11
5 more
  1. 2025Graph Retrieval-Augmented LLM for Conversational Recommendation Systemscited by 10
  2. 2024Embedding-Informed Adaptive Retrieval-Augmented Generation of Large Language Modelscited by 9
  3. 2025Stealthy LLM-Driven Data Poisoning Attacks Against Embedding-Based Retrieval-Augmented Recommender Systemscited by 8
  4. 2024Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendationcited by 4
  5. 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Popcorn: A Configurable Benchmark for Visual Evidence in Multimodal Movie Recommendation ↗
  2. 2026OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation
  3. 2026MM-VeriRec: Failure-Guided Fusion for Verifiable Agentic Multimodal Recommendation
  4. 2025Describe What You See with Multimodal Large Language Models to Enhance Video Recommendations
  5. 2026VLM4Rec: Multimodal Semantic Representation for Recommendation with Large Vision-Language Models
  6. 2026TriAlignGR: Triangular Multitask Alignment with Multimodal Deep Interest Mining for Generative Recommendation
  7. 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation
  8. 2025LLM4Rec: Large Language Models for Multimodal Generative Recommendation with Causal Debiasing