mlsanityData to 14 Oct 2026

ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation

arXiv 2606.28357 ↗First posted 8 Jun 2026cs.IR cs.AIcited by 3

On the map: LLM agents and tool use → Agentic recommender systems

Abstract (arXiv)

Recent advances in multimodal recommenders excel at feature fusion but remain opaque and inefficient decision-makers, lacking explicit reasoning and self-awareness of uncertainty. We introduce ReasonRec, a reasoning-augmented multimodal agent structured around a three-stage explicit reasoning pipeline. Specifically, we propose a reasoning-aware visual instruction tuning strategy that systematically transforms diverse recommendation tasks into unified CoT prompts, enabling the VLM to explicitly articulate intermediate decision steps. Additionally, our evidence-horizon curriculum progressively enhances the reasoning complexity to better handle cold-start and long-tail user scenarios, significantly boosting model generalization. Furthermore, the uncertainty-guided delegation mechanism empowers the agent to assess its own confidence, strategically allocating computational resources to optimize both recommendation accuracy and inference efficiency. Comprehensive experiments on four standard recommendation tasks across five real-world datasets demonstrate that ReasonRec achieves over 30% relative improvement in key ranking metrics compared to state-of-the-art multimodal recommenders. Crucially, ReasonRec substantially reduces inference latency by dynamically delegating up to 35% of queries to efficient sub-models without compromising accuracy. Extensive ablation studies further confirm that each proposed reasoning and planning mechanism individually contributes substantially to ReasonRec's overall effectiveness. Collectively, our results illustrate a clear pathway towards interpretable, adaptive, and efficient multimodal recommendation through explicit reasoning and agentic design.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agentic recommender systems, one of 16 directions in LLM agents and tool use. Builds on 48 of its 65 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

48 of 65 references.

References · 48

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  9. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  10. 2018Self-Attentive Sequential Recommendationcited by 1,184
  11. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  12. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
36 more
  1. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  2. 2016Wide & Deep Learning for Recommender Systemscited by 747
  3. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  4. 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 501
  5. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
  6. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  7. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  8. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  9. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  10. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
  11. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  12. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
  13. 2023MIMIC-IT: Multi-Modal In-Context Instruction Tuningcited by 267
  14. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
  15. 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Modelscited by 167
  16. 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
  17. 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
  18. 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 121
  19. 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
  20. 2024Large Multimodal Agents: A Surveycited by 105
  21. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  22. 2022Personalized Prompt Learning for Explainable Recommendationcited by 79
  23. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  24. 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 73
  25. 2021Personalized Transformer for Explainable Recommendationcited by 59
  26. 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
  27. 2020Open Benchmarking for Click-Through Rate Predictioncited by 53
  28. 2019Adaptive Factorization Network: Learning Adaptive-Order Feature Interactionscited by 48
  29. 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
  30. 2023VIP5: Towards Multimodal Foundation Models for Recommendationcited by 46
  31. 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
  32. 2022TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedbackcited by 27
  33. 2024Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyondcited by 25
  34. 2023An Image Dataset for Benchmarking Recommender Systems with Raw Pixelscited by 18
  35. 2019Explainable Fashion Recommendation: A Semantic Attribute Region Guided Approachcited by 17
  36. 2026GR2: Generative Reasoning Re-rankercited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning
  2. 2025Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation
  3. 2026Agents as Knowledge Integrator and Utilizer in Multimodal Recommendation
  4. 2026Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation
  5. 2026MLLMRec-R1: Incentivizing Reasoning Capability in Large Language Models for Multimodal Sequential Recommendation
  6. 2024ReasoningRec: Bridging Personalized Recommendations and Human-Interpretable Explanations through LLM Reasoning
  7. 2026RecThinker: An Agentic Framework for Tool-Augmented Reasoning in Recommendation
  8. 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation