Enhancing Multimodal Recommendations with Vision-Language Models and Information-Aware Fusion
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
Abstract (arXiv)
Recent advances in multimodal recommendation (MMR) highlight the potential of integrating visual and textual content to enrich item representations. However, existing methods often rely on coarse visual features and naive fusion strategies, resulting in redundant or misaligned representations. From an information-theoretic perspective, effective fusion should balance unique, shared, and redundant modality information to preserve complementary cues. To this end, we propose VIRAL, a novel Vision-Language and Information-aware Recommendation framework that enhances multimodal fusion through two components: (i) a VLM-based visual enrichment module that generates fine-grained, title-guided descriptions for semantically aligned image representations, and (ii) an information-aware fusion module inspired by Partial Information Decomposition (PID) to disentangle and integrate complementary signals. Experiments on three Amazon datasets show that VIRAL consistently outperforms strong multimodal baselines and substantially improves the contribution of visual features.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 8 of its 13 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
8 of 13 references.
References · 8
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
- 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 53
- 2024MENTOR: Multi-level Self-supervised Learning for Multimodal Recommendationcited by 21
- 2023Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendationcited by 15
- 2025COHESION: Composite Graph Convolutional Network with Dual-Stage Fusion for Multimodal Recommendationcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VLM4Rec: Multimodal Semantic Representation for Recommendation with Large Vision-Language Models
- 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation
- 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models
- 2026OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation
- 2024NoteLLM-2: Multimodal Large Representation Models for Recommendation
- 2025Frozen LVLMs for Micro-Video Recommendation: A Systematic Study of Feature Extraction and Fusion ↗
- 2026MM-VeriRec: Failure-Guided Fusion for Verifiable Agentic Multimodal Recommendation
- 2025Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation