ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation
On the map: LLM agents and tool use → Agentic recommender systems
Abstract (arXiv)
Recent advances in multimodal recommenders excel at feature fusion but remain opaque and inefficient decision-makers, lacking explicit reasoning and self-awareness of uncertainty. We introduce ReasonRec, a reasoning-augmented multimodal agent structured around a three-stage explicit reasoning pipeline. Specifically, we propose a reasoning-aware visual instruction tuning strategy that systematically transforms diverse recommendation tasks into unified CoT prompts, enabling the VLM to explicitly articulate intermediate decision steps. Additionally, our evidence-horizon curriculum progressively enhances the reasoning complexity to better handle cold-start and long-tail user scenarios, significantly boosting model generalization. Furthermore, the uncertainty-guided delegation mechanism empowers the agent to assess its own confidence, strategically allocating computational resources to optimize both recommendation accuracy and inference efficiency. Comprehensive experiments on four standard recommendation tasks across five real-world datasets demonstrate that ReasonRec achieves over 30% relative improvement in key ranking metrics compared to state-of-the-art multimodal recommenders. Crucially, ReasonRec substantially reduces inference latency by dynamically delegating up to 35% of queries to efficient sub-models without compromising accuracy. Extensive ablation studies further confirm that each proposed reasoning and planning mechanism individually contributes substantially to ReasonRec's overall effectiveness. Collectively, our results illustrate a clear pathway towards interpretable, adaptive, and efficient multimodal recommendation through explicit reasoning and agentic design.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agentic recommender systems, one of 16 directions in LLM agents and tool use. Builds on 48 of its 65 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
48 of 65 references.
References · 48
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
36 more
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 501
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
- 2023MIMIC-IT: Multi-Modal In-Context Instruction Tuningcited by 267
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
- 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Modelscited by 167
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 121
- 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
- 2024Large Multimodal Agents: A Surveycited by 105
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2022Personalized Prompt Learning for Explainable Recommendationcited by 79
- 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 73
- 2021Personalized Transformer for Explainable Recommendationcited by 59
- 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
- 2020Open Benchmarking for Click-Through Rate Predictioncited by 53
- 2019Adaptive Factorization Network: Learning Adaptive-Order Feature Interactionscited by 48
- 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
- 2023VIP5: Towards Multimodal Foundation Models for Recommendationcited by 46
- 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
- 2022TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedbackcited by 27
- 2024Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyondcited by 25
- 2023An Image Dataset for Benchmarking Recommender Systems with Raw Pixelscited by 18
- 2019Explainable Fashion Recommendation: A Semantic Attribute Region Guided Approachcited by 17
- 2026GR2: Generative Reasoning Re-rankercited by 11
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning
- 2025Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation
- 2026Agents as Knowledge Integrator and Utilizer in Multimodal Recommendation
- 2026Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation
- 2026MLLMRec-R1: Incentivizing Reasoning Capability in Large Language Models for Multimodal Sequential Recommendation
- 2024ReasoningRec: Bridging Personalized Recommendations and Human-Interpretable Explanations through LLM Reasoning
- 2026RecThinker: An Agentic Framework for Tool-Augmented Reasoning in Recommendation
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation