UP5: Unbiased Foundation Model for Fairness-aware Recommendation
Not on the map. Why?
Abstract (arXiv)
Recent advances in Foundation Models such as Large Language Models (LLMs) have propelled them to the forefront of Recommender Systems (RS). Despite their utility, there is a growing concern that LLMs might inadvertently perpetuate societal stereotypes, resulting in unfair recommendations. Since fairness is critical for RS as many users take it for decision-making and demand fulfillment, this paper focuses on user-side fairness for LLM-based recommendation where the users may require a recommender system to be fair on specific sensitive features such as gender or age. In this paper, we dive into the extent of unfairness exhibited by LLM-based recommender models based on both T5 and LLaMA backbones, and discuss appropriate methods for promoting equitable treatment of users in LLM-based recommendation models. We introduce a novel Counterfactually-Fair-Prompt (CFP) method towards Unbiased Foundation mOdels (UFO) for fairness-aware LLM-based recommendation. Experiments are conducted on two real-world datasets, MovieLens-1M and Insurance, and compared with both matching-based and sequential-based fairness-aware recommendation models. Results show that CFP achieves better recommendation performance with a high level of fairness. Data and code are open-sourced at https://github.com/agiresearch/UP5.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 36 of its 71 references that are in the map. First posted on arXiv 20 May 2023.
Builds on
36 of 71 references.
References · 36
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
24 more
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2020Autoregressive Entity Retrievalcited by 333
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
- 2019Fairness in Recommendation Ranking through Pairwise Comparisonscited by 127
- 2023Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendationcited by 113
- 2022A Survey on the Fairness of Recommender Systemscited by 102
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2021Towards Long-term Fairness in Recommendationcited by 77
- 2021User-oriented Fairness in Recommendationcited by 75
- 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
- 2021Learning Fair Representations for Recommendation: A Graph-based Perspectivecited by 50
- 2023Pre-train, Prompt and Recommendation: A Comprehensive Survey of Language Modelling Paradigm Adaptations in Recommender Systemscited by 45
- 2020FairRec: Fairness-aware News Recommendation with Decomposed Adversarial Learningcited by 44
- 2021Personalized Counterfactual Fairness in Recommendationcited by 38
- 2020The Connection Between Popularity Bias, Calibration, and Fairness in Recommendationcited by 35
- 2021TFROM: A Two-sided Fairness-Aware Recommendation Model for Both Customers and Providerscited by 31
- 2018User Fairness in Recommender Systemscited by 20
- 2019A Direct Approach to Robust Deep Learning Using Adversarial Networkscited by 18
- 2022Selective Fairness in Recommendation via Promptscited by 16
- 2022Experiments on Generalizability of User-Oriented Fairness in Recommender Systemscited by 13
- 2021Fairness and Transparency in Recommendation: The Users' Perspectivecited by 10
Built on by
Citing papers per year: 2023: 10; 2024: 16; 2025: 6; 2026: 6.
38 papers.
Sort:
By area:
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 141
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
- 2024TrustAgent: Towards Safe and Trustworthy LLM-based Agentscited by 62
- 2023VIP5: Towards Multimodal Foundation Models for Recommendationcited by 45
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challengescited by 30
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
26 more
- 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
- 2023Fairness of ChatGPTcited by 19
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigmscited by 17
- 2024Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendationcited by 16
- 2024A Survey of Generative Search and Recommendation in the Era of Large Language Modelscited by 14
- 2024Uncertainty is Fragile: Manipulating Uncertainty in Large Language Modelscited by 13
- 2023FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Predictioncited by 11
- 2023A Survey on Large Language Models for Personalized and Explainable Recommendationscited by 11
- 2024Fairness Definitions in Language Models Explainedcited by 10
- 2023HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shiftscited by 8
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systemscited by 7
- 2024RA-Rec: An Efficient ID Representation Alignment Framework for LLM-based Recommendationcited by 7
- 2024Large Language Models Make Sample-Efficient Recommender Systemscited by 3
- 2024Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendationcited by 3
- 2024Break the ID-Language Barrier: An Adaption Framework for LLM-based Sequential Recommendationcited by 3
- 2024DisCo: Towards Harmonious Disentanglement and Collaboration between Tabular and Semantic Space for Recommendationcited by 2
- 2025Fairness Evaluation and Inference Level Mitigation in LLMscited by 2
- 2026Bridging Semantic Understanding and Popularity Bias with LLMscited by 1
- 2026Lightweight Fairness for LLM-Based Recommendations via Kernelized Projection and Gated Adapterscited by 1
- 2026DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generationcited by 1
- 2026Personalized Recommendation Tool Learning via Autonomous Language Agentscited by 1
- 2025Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 0
- 2025Bias vs Bias -- Dawn of Justice: A Fair Fight in Recommendation Systemscited by 0
- 2025PBiLoss: Popularity-Aware Regularization to Improve Fairness in Graph-Based Recommender Systemscited by 0
- 2026Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repaircited by 0
- 2026Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenderscited by 0
- 2026Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenders8 Aug 2026
- 2026Personalized Recommendation Tool Learning via Autonomous Language Agents22 Jul 2026
- 2026Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repair26 Jun 2026
- 2026DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation15 May 2026
- 2026Lightweight Fairness for LLM-Based Recommendations via Kernelized Projection and Gated Adapters24 Mar 2026
- 2026Bridging Semantic Understanding and Popularity Bias with LLMs14 Jan 2026
- 2025Fairness Evaluation and Inference Level Mitigation in LLMs21 Oct 2025
- 2025PBiLoss: Popularity-Aware Regularization to Improve Fairness in Graph-Based Recommender Systems25 Jul 2025
- 2025Bias vs Bias -- Dawn of Justice: A Fair Fight in Recommendation Systems23 Jun 2025
- 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms23 Apr 2025
- 2025LLMs for Explainable AI: A Comprehensive Survey31 Mar 2025
- 2025Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation23 Jan 2025
26 more
- 2024Break the ID-Language Barrier: An Adaption Framework for LLM-based Sequential Recommendation27 Nov 2024
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendation21 Aug 2024
- 2024Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendation7 Aug 2024
- 2024Fairness Definitions in Language Models Explained26 Jul 2024
- 2024Uncertainty is Fragile: Manipulating Uncertainty in Large Language Models15 Jul 2024
- 2024Large Language Models Make Sample-Efficient Recommender Systems4 Jun 2024
- 2024DisCo: Towards Harmonious Disentanglement and Collaboration between Tabular and Semantic Space for Recommendation20 May 2024
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directions14 May 2024
- 2024A Survey of Generative Search and Recommendation in the Era of Large Language Models25 Apr 2024
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)23 Apr 2024
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era17 Apr 2024
- 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challenges5 Mar 2024
- 2024RA-Rec: An Efficient ID Representation Alignment Framework for LLM-based Recommendation7 Feb 2024
- 2024TrustAgent: Towards Safe and Trustworthy LLM-based Agents2 Feb 2024
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systems8 Jan 2024
- 2023A Survey on Large Language Models for Personalized and Explainable Recommendations21 Nov 2023
- 2023FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction30 Oct 2023
- 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction13 Oct 2023
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussions3 Sep 2023
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation22 Aug 2023
- 2023Recommender Systems in the Era of Large Language Models (LLMs)5 Jul 2023
- 2023How Can Recommender Systems Benefit from Large Language Models: A Survey9 Jun 2023
- 2023HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shifts28 May 2023
- 2023VIP5: Towards Multimodal Foundation Models for Recommendation23 May 2023
- 2023Fairness of ChatGPT22 May 2023
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 141
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
- 2023VIP5: Towards Multimodal Foundation Models for Recommendationcited by 45
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
- 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
- 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challengescited by 30
- 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
- 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
12 most cited of 30 All 30 (JSON)
- 2026Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenders8 Aug 2026
- 2026Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repair26 Jun 2026
- 2026Bridging Semantic Understanding and Popularity Bias with LLMs14 Jan 2026
- 2025PBiLoss: Popularity-Aware Regularization to Improve Fairness in Graph-Based Recommender Systems25 Jul 2025
- 2025Bias vs Bias -- Dawn of Justice: A Fair Fight in Recommendation Systems23 Jun 2025
- 2025LLMs for Explainable AI: A Comprehensive Survey31 Mar 2025
- 2025Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation23 Jan 2025
- 2024Break the ID-Language Barrier: An Adaption Framework for LLM-based Sequential Recommendation27 Nov 2024
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendation21 Aug 2024
- 2024Fairness Definitions in Language Models Explained26 Jul 2024
- 2024Large Language Models Make Sample-Efficient Recommender Systems4 Jun 2024
12 newest of 30 All 30 (JSON)