Bootstrap Latent Representations for Multi-modal Recommendation
Not on the map. Why?
Abstract (arXiv)
This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph, existing state-of-the-art methods usually use auxiliary graphs (e.g., user-user or item-item relation graph) to augment the learned representations of users and/or items. These representations are often propagated and aggregated on auxiliary graphs using graph convolutional networks, which can be prohibitively expensive in computation and memory, especially for large graphs. Moreover, existing multi-modal recommendation methods usually leverage randomly sampled negative examples in Bayesian Personalized Ranking (BPR) loss to guide the learning of user/item representations, which increases the computational cost on large graphs and may also bring noisy supervision signals into the training process. To tackle the above issues, we propose a novel self-supervised multi-modal recommendation model, dubbed BM3, which requires neither augmentations from auxiliary graphs nor negative samples. Specifically, BM3 first bootstraps latent contrastive views from the representations of users and items with a simple dropout augmentation. It then jointly optimizes three multi-modal objectives to learn the representations of users and items by reconstructing the user-item interaction graph and aligning modality features under both inter- and intra-modality perspectives. BM3 alleviates both the need for contrasting with negative examples and the complex graph augmentation from an additional target network for contrastive view generation. We show BM3 outperforms prior recommendation models on three datasets with number of nodes ranging from 20K to 200K, while achieving a 2-9X reduction in training time. Our code is available at https://github.com/enoche/BM3.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jul 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 10; 2025: 17; 2026: 22.
55 papers.
Sort:
By area:
- 2023Multimodal Recommender Systems: A Surveycited by 36
- 2023MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendationcited by 30
- 2024DiffMM: Multi-Modal Diffusion Model for Recommendationcited by 21
- 2024AlignRec: Aligning and Training in Multimodal Recommendationscited by 20
- 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Modelscited by 18
- 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendationcited by 8
- 2024GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal Recommendationcited by 8
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minimacited by 6
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2025Structured Spectral Reasoning for Frequency-Adaptive Multimodal Recommendationcited by 6
- 2025MUSE: A Simple Yet Effective Multimodal Search-Based Framework for Lifelong User Interest Modelingcited by 6
- 2022Inductive Graph Transformer for Delivery Time Estimationcited by 5
38 more
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraintscited by 5
- 2024Modality-Balanced Learning for Multimedia Recommendationcited by 5
- 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendationcited by 5
- 2024A Unified Graph Transformer for Overcoming Isolations in Multi-modal Recommendationcited by 4
- 2025Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarioscited by 4
- 2026RecGOAT: Graph Optimal Adaptive Transport for LLM-Enhanced Multimodal Recommendation with Dual Semantic Alignmentcited by 4
- 2023ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendationcited by 3
- 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendationcited by 3
- 2025Dual-Phase Playtime-guided Recommendation: Interest Intensity Exploration and Multimodal Random Walkscited by 3
- 2023COURIER: Contrastive User Intention Reconstruction for Large-Scale Visual Recommendationcited by 2
- 2025Training-free Adjustable Polynomial Graph Filtering for Ultra-fast Multimodal Recommendationcited by 2
- 2025MMHCL: Multi-Modal Hypergraph Contrastive Learning for Recommendationcited by 2
- 2024Federated Vision-Language-Recommendation with Personalized Fusioncited by 1
- 2025A Metric for MLLM Alignment in Large-scale Recommendationcited by 1
- 2025MISS: Multi-Modal Tree Indexing and Searching with Lifelong Sequential Behavior for Retrieval Recommendationcited by 1
- 2025Rejuvenating Cross-Entropy Loss in Knowledge Distillation for Recommender Systemscited by 1
- 2026Benchmarking Multimodal Large Language Models for Missing Modality Completion in Product Cataloguescited by 1
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Modelscited by 1
- 2025MDE: Modality Discrimination Enhancement for Multi-modal Recommendationcited by 0
- 2025EGRA:Toward Enhanced Behavior Graphs and Representation Alignment for Multimodal Recommendationcited by 0
- 2025Causal Inspired Multi Modal Recommendationcited by 0
- 2025Structurally Refined Graph Transformer for Multimodal Recommendationcited by 0
- 2025From Raw Features to Effective Embeddings: A Three-Stage Approach for Multimodal Recipe Recommendationcited by 0
- 2025Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendationcited by 0
- 2026Cross-Modal Attention Network with Dual Graph Learning in Multimodal Recommendationcited by 0
- 2026Multimodal Enhancement of Sequential Recommendationcited by 0
- 2026Sequences as Nodes for Contrastive Multimodal Graph Recommendationcited by 0
- 2026MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendationcited by 0
- 2026Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendationcited by 0
- 2026Trie-Aware Transformers for Generative Recommendationcited by 0
- 2026Anchored Alignment: Preventing Positional Collapse in Multimodal Recommender Systemscited by 0
- 2026User-Aware Conditional Generative Total Correlation Learning for Multi-Modal Recommendationcited by 0
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendationcited by 0
- 2026TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendationcited by 0
- 2026Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attackscited by 0
- 2026GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspectivecited by 0
- 2026TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendationcited by 0
- 2026Content Depth Matters in Short-Video Recommendation: Rethinking the Attention Economycited by 0
50 most cited of 55 All 55 (JSON)
- 2026FairDiff: Mitigating the Self-Reinforcing Matthew Effect in Diffusion Recommender Models29 Sep 2026
- 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systems28 Sep 2026
- 2026MM-VeriRec: Failure-Guided Fusion for Verifiable Agentic Multimodal Recommendation21 Sep 2026
- 2026Latent-Aligned Reasoning for Multimodal Recommendation4 Sep 2026
- 2026Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation2 Sep 2026
- 2026Content Depth Matters in Short-Video Recommendation: Rethinking the Attention Economy14 Aug 2026
- 2026TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation11 Aug 2026
- 2026GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspective15 May 2026
- 2026Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attacks7 May 2026
- 2026TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendation29 Apr 2026
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendation4 Apr 2026
- 2026User-Aware Conditional Generative Total Correlation Learning for Multi-Modal Recommendation3 Apr 2026
38 more
- 2026Anchored Alignment: Preventing Positional Collapse in Multimodal Recommender Systems13 Mar 2026
- 2026Trie-Aware Transformers for Generative Recommendation25 Feb 2026
- 2026Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendation24 Feb 2026
- 2026MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendation11 Feb 2026
- 2026Sequences as Nodes for Contrastive Multimodal Graph Recommendation6 Feb 2026
- 2026Multimodal Enhancement of Sequential Recommendation6 Feb 2026
- 2026RecGOAT: Graph Optimal Adaptive Transport for LLM-Enhanced Multimodal Recommendation with Dual Semantic Alignment31 Jan 2026
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models30 Jan 2026
- 2026Benchmarking Multimodal Large Language Models for Missing Modality Completion in Product Catalogues27 Jan 2026
- 2026Cross-Modal Attention Network with Dual Graph Learning in Multimodal Recommendation16 Jan 2026
- 2025Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation27 Dec 2025
- 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendation18 Dec 2025
- 2025MUSE: A Simple Yet Effective Multimodal Search-Based Framework for Lifelong User Interest Modeling8 Dec 2025
- 2025Structured Spectral Reasoning for Frequency-Adaptive Multimodal Recommendation1 Dec 2025
- 2025From Raw Features to Effective Embeddings: A Three-Stage Approach for Multimodal Recipe Recommendation24 Nov 2025
- 2025Structurally Refined Graph Transformer for Multimodal Recommendation1 Nov 2025
- 2025Causal Inspired Multi Modal Recommendation14 Oct 2025
- 2025Rejuvenating Cross-Entropy Loss in Knowledge Distillation for Recommender Systems25 Sep 2025
- 2025EGRA:Toward Enhanced Behavior Graphs and Representation Alignment for Multimodal Recommendation22 Aug 2025
- 2025MISS: Multi-Modal Tree Indexing and Searching with Lifelong Sequential Behavior for Retrieval Recommendation20 Aug 2025
- 2025Dual-Phase Playtime-guided Recommendation: Interest Intensity Exploration and Multimodal Random Walks9 Aug 2025
- 2025A Metric for MLLM Alignment in Large-scale Recommendation7 Aug 2025
- 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation6 Aug 2025
- 2025MMHCL: Multi-Modal Hypergraph Contrastive Learning for Recommendation23 Apr 2025
- 2025Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios23 Apr 2025
- 2025Training-free Adjustable Polynomial Graph Filtering for Ultra-fast Multimodal Recommendation6 Mar 2025
- 2025MDE: Modality Discrimination Enhancement for Multi-modal Recommendation8 Feb 2025
- 2024Federated Vision-Language-Recommendation with Personalized Fusion11 Oct 2024
- 2024A Unified Graph Transformer for Overcoming Isolations in Multi-modal Recommendation29 Jul 2024
- 2024Modality-Balanced Learning for Multimedia Recommendation26 Jul 2024
- 2024GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal Recommendation17 Jul 2024
- 2024DiffMM: Multi-Modal Diffusion Model for Recommendation17 Jun 2024
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraints24 May 2024
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2024AlignRec: Aligning and Training in Multimodal Recommendations19 Mar 2024
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima17 Feb 2024
- 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models13 Feb 2024
- 2023ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation10 Nov 2023
50 newest of 55 All 55 (JSON)
- 2024DiffMM: Multi-Modal Diffusion Model for Recommendationcited by 21
- 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendationcited by 8
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendationcited by 0
- 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systemscited by 0
- 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systems28 Sep 2026
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendation4 Apr 2026
- 2024DiffMM: Multi-Modal Diffusion Model for Recommendation17 Jun 2024
- 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendation27 Sep 2023
- 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Modelscited by 18
- 2024Federated Vision-Language-Recommendation with Personalized Fusioncited by 1
- 2025A Metric for MLLM Alignment in Large-scale Recommendationcited by 1
- 2026Benchmarking Multimodal Large Language Models for Missing Modality Completion in Product Cataloguescited by 1
- 2026Benchmarking Multimodal Large Language Models for Missing Modality Completion in Product Catalogues27 Jan 2026
- 2025A Metric for MLLM Alignment in Large-scale Recommendation7 Aug 2025
- 2024Federated Vision-Language-Recommendation with Personalized Fusion11 Oct 2024
- 2024Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models13 Feb 2024
- 2026Latent-Aligned Reasoning for Multimodal Recommendationcited by 0
- 2026Latent-Aligned Reasoning for Multimodal Recommendation4 Sep 2026
- 2023Multimodal Recommender Systems: A Surveycited by 36
- 2023MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendationcited by 30
- 2024AlignRec: Aligning and Training in Multimodal Recommendationscited by 20
- 2024GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal Recommendationcited by 8
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minimacited by 6
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2025Structured Spectral Reasoning for Frequency-Adaptive Multimodal Recommendationcited by 6
- 2025MUSE: A Simple Yet Effective Multimodal Search-Based Framework for Lifelong User Interest Modelingcited by 6
- 2022Inductive Graph Transformer for Delivery Time Estimationcited by 5
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraintscited by 5
- 2024Modality-Balanced Learning for Multimedia Recommendationcited by 5
- 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendationcited by 5
12 most cited of 45 All 45 (JSON)
- 2026FairDiff: Mitigating the Self-Reinforcing Matthew Effect in Diffusion Recommender Models29 Sep 2026
- 2026MM-VeriRec: Failure-Guided Fusion for Verifiable Agentic Multimodal Recommendation21 Sep 2026
- 2026Content Depth Matters in Short-Video Recommendation: Rethinking the Attention Economy14 Aug 2026
- 2026TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation11 Aug 2026
- 2026GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspective15 May 2026
- 2026Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attacks7 May 2026
- 2026TimeMM: Time-as-Operator Spectral Filtering for Dynamic Multimodal Recommendation29 Apr 2026
- 2026User-Aware Conditional Generative Total Correlation Learning for Multi-Modal Recommendation3 Apr 2026
- 2026Anchored Alignment: Preventing Positional Collapse in Multimodal Recommender Systems13 Mar 2026
- 2026Trie-Aware Transformers for Generative Recommendation25 Feb 2026
- 2026Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendation24 Feb 2026
- 2026MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendation11 Feb 2026
12 newest of 45 All 45 (JSON)