Latent-Aligned Reasoning for Multimodal Recommendation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model's own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 28 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
24 of 28 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 172
11 more
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2019Multimodal Intelligence: Representation Learning, Information Fusion, and Applicationscited by 89
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
- 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 54
- 2025CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Eracited by 41
- 2020Large Scale Product Graph Construction for Recommendation in E-commercecited by 28
- 2025Visual question answering: from early developments to recent advances -- a surveycited by 19
- 2021Why Do We Click: Visual Impression-aware News Recommendationcited by 10
- 2024Why Not Together? A Multiple-Round Recommender System for Queries and Itemscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-aligned Latent Reasoning for Multi-modal Large Language Model
- 2025Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation
- 2026Fill the GAP: A Granular Alignment Paradigm for Visual Reasoning in Multimodal Large Language Models
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space
- 2026Learning Modal-Mixed Chain-of-Thought Reasoning with Latent Embeddings
- 2026Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
- 2026Multimodal Latent Reasoning via Predictive Embeddings
- 2026Semantic-Enriched Latent Visual Reasoning