# Multi-modal clothing recommendation model based on large model and VAE enhancement

arXiv: https://arxiv.org/abs/2410.02219 · HTML: https://mlsanity.com/paper/2410.02219/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 43 references that are in the map.
- First posted on arXiv 3 Oct 2024.

## Builds on (most cited first, 13 of 13)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms](https://mlsanity.com/paper/1708.07747/) (2017)
- [ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks](https://mlsanity.com/paper/1908.02265/) (2019)
- [Grammar Variational Autoencoder](https://mlsanity.com/paper/1703.01925/) (2017)
- [Neural Collaborative Filtering vs. Matrix Factorization Revisited](https://mlsanity.com/paper/2005.09683/) (2020)
- [A Multimodal Fusion Network For Student Emotion Recognition Based on Transformer and Tensor Product](https://mlsanity.com/paper/2403.08511/) (2024)
- [Utilizing the LightGBM Algorithm for Operator User Credit Assessment Research](https://mlsanity.com/paper/2403.14483/) (2024)
- [When Federated Recommendation Meets Cold-Start Problem: Separating Item Attributes and User Interactions](https://mlsanity.com/paper/2305.12650/) (2023)
- [Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment](https://mlsanity.com/paper/2404.12634/) (2024)
- [An Integrative Paradigm for Enhanced Stroke Prediction: Synergizing XGBoost and xDeepFM Algorithms](https://mlsanity.com/paper/2310.16430/) (2023)
- [SocialRec: User Activity Based Post Weighted Dynamic Personalized Post Recommendation System in Social Media](https://mlsanity.com/paper/2407.09747/) (2024)
- [A Depression Detection Method Based on Multi-Modal Feature Fusion Using Cross-Attention](https://mlsanity.com/paper/2407.12825/) (2024)

## Built on by (most cited first, 1 of 1)

- [Research on the Design of a Short Video Recommendation System Based on Multimodal Information and Differential Privacy](https://mlsanity.com/paper/2504.08751/) (2025)

## Abstract (arXiv)

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing description texts and images, utilizing a pre-trained large language model to deeply explore the hidden meanings of users and products. Additionally, a variational encoder is employed to learn the relationship between user information and products to address the cold start problem in recommendation systems. This study also validates the significant performance advantages of this method over various recommendation system methods through extensive ablation experiments, providing crucial practical guidance for the comprehensive optimization of recommendation systems.