Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Pretrained Language Models (PLM) have been greatly successful on a board range of natural language processing (NLP) tasks. However, it has just started being applied to the domain of recommendation systems. Traditional recommendation algorithms failed to incorporate the rich textual information in e-commerce datasets, which hinderss the performance of those models. We present a thorough investigation on the effect of various strategy of incorporating PLMs into traditional recommender algorithms on one of the e-commerce datasets, and we compare the results with vanilla recommender baseline models. We show that the application of PLMs and domain specific fine-tuning lead to an increase on the predictive capability of combined models. These results accentuate the importance of utilizing textual information in the context of e-commerce, and provides insight on how to better apply PLMs alongside traditional recommender system algorithms. The code used in this paper is available on Github: https://github.com/NuofanXu/bert_retail_recommender.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 9 Feb 2023.
Builds on
21 of 36 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2018Deep contextualized word representationscited by 2,285
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
- 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
9 more
- 2014Understanding Random Forests: From Theory to Practicecited by 57
- 2020LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compressioncited by 45
- 2020E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commercecited by 19
- 2018Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysiscited by 17
- 2015Fast and Simple PCA via Convex Optimizationcited by 16
- 2018Regularizing Matrix Factorization with User and Item Embeddings for Recommendationcited by 6
- 2018Personalizing Similar Product Recommendations in Fashion E-commercecited by 3
- 2016Personalized Advertisement Recommendation: A Ranking Approach to Address the Ubiquitous Click Sparsity Problemcited by 1
- 2020Utilizing Human Memory Processes to Model Genre Preferences for Personalized Music Recommendationscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.