PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?
Not on the map. Why?
Abstract (arXiv)
The integration of Large Language Models (LLMs) into recommender systems has enabled zero-shot, personality-based personalization through prompt-based interactions, offering a new paradigm for user-centric recommendations. However, incorporating user personality traits via the OCEAN model highlights a critical tension between achieving psychological alignment and ensuring demographic fairness. To address this, we propose PerFairX, a unified evaluation framework designed to quantify the trade-offs between personalization and demographic equity in LLM-generated recommendations. Using neutral and personality-sensitive prompts across diverse user profiles, we benchmark two state-of-the-art LLMs, ChatGPT and DeepSeek, on movie (MovieLens 10M) and music (Last.fm 360K) datasets. Our results reveal that personality-aware prompting significantly improves alignment with individual traits but can exacerbate fairness disparities across demographic groups. Specifically, DeepSeek achieves stronger psychological fit but exhibits higher sensitivity to prompt variations, while ChatGPT delivers stable yet less personalized outputs. PerFairX provides a principled benchmark to guide the development of LLM-based recommender systems that are both equitable and psychologically informed, contributing to the creation of inclusive, user-centric AI applications in continual learning contexts.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
28 of 49 references.
References · 28
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
- 2019Fairness in Recommendation Ranking through Pairwise Comparisonscited by 127
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2023Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendationcited by 114
- 2022A Survey on the Fairness of Recommender Systemscited by 102
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 98
- 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
- 2017Multisided Fairness for Recommendationcited by 70
- 2021Personalized Counterfactual Fairness in Recommendationcited by 38
16 more
- 2022Fairness in Recommender Systems: Research Landscape and Future Directionscited by 30
- 2023Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Communitycited by 29
- 2023Ensuring User-side Fairness in Dynamic Recommender Systemscited by 27
- 2020FairLens: Auditing Black-box Clinical Decision Support Systemscited by 23
- 2022Joint Multisided Exposure Fairness for Recommendationcited by 22
- 2024Item-side Fairness of Large Language Model-based Recommendation Systemcited by 21
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2024CFaiRLLM: Consumer Fairness Evaluation in Large-Language Model Recommender Systemcited by 18
- 2024Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommender Systemscited by 11
- 2023Counterfactual Explanation for Fairness in Recommendationcited by 9
- 2024Towards Empathetic Conversational Recommender Systemscited by 9
- 2025FairEval: Evaluating Fairness in LLM-Based Recommendations with Personality Awarenesscited by 8
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systemscited by 7
- 2022A Stakeholder-Centered View on Fairness in Music Recommender Systemscited by 5
- 2024Leveraging Opposite Gender Interaction Ratio as a Path towards Fairness in Online Dating Recommendations Based on User Sexual Orientationcited by 2
- 2024It's Not You, It's Me: The Impact of Choice Models and Ranking Strategies on Gender Imbalance in Music Recommendationcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Conv-FinRe: A Conversational and Longitudinal Benchmark for Utility-Grounded Financial Recommendationcited by 4
- 2026Uncertainty and Fairness Awareness in LLM-Based Recommendation Systemscited by 1
- 2026From Beats to Breaches:How Offensive AI Infers Sensitive User Information from Playlistscited by 0
- 2026From Beats to Breaches:How Offensive AI Infers Sensitive User Information from Playlists6 May 2026
- 2026Conv-FinRe: A Conversational and Longitudinal Benchmark for Utility-Grounded Financial Recommendation19 Feb 2026
- 2026Uncertainty and Fairness Awareness in LLM-Based Recommendation Systems31 Jan 2026