A Preliminary Study of ChatGPT on News Recommendation: Personalization, Provider Fairness, Fake News
Not on the map. Why?
Abstract (arXiv)
Online news platforms commonly employ personalized news recommendation methods to assist users in discovering interesting articles, and many previous works have utilized language model techniques to capture user interests and understand news content. With the emergence of large language models like GPT-3 and T-5, a new recommendation paradigm has emerged, leveraging pre-trained language models for making recommendations. ChatGPT, with its user-friendly interface and growing popularity, has become a prominent choice for text-based tasks. Considering the growing reliance on ChatGPT for language tasks, the importance of news recommendation in addressing social issues, and the trend of using language models in recommendations, this study conducts an initial investigation of ChatGPT's performance in news recommendations, focusing on three perspectives: personalized news recommendation, news provider fairness, and fake news detection. ChatGPT has the limitation that its output is sensitive to the input phrasing. We therefore aim to explore the constraints present in the generated responses of ChatGPT for each perspective. Additionally, we investigate whether specific prompt formats can alleviate these constraints or if these limitations require further attention from researchers in the future. We also surpass fixed evaluations by developing a webpage to monitor ChatGPT's performance on weekly basis on the tasks and prompts we investigated. Our aim is to contribute to and encourage more researchers to engage in the study of enhancing news recommendation performance through the utilization of large language models such as ChatGPT.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 6; 2024: 8; 2025: 3; 2026: 2.
19 papers.
Sort:
By area:
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
- 2024Understanding Biases in ChatGPT-based Recommender Systems: Provider Fairness, Temporal Stability, and Recencycited by 27
- 2024Enhancing Recommendation Diversity by Re-ranking with Large Language Modelscited by 19
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2023Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Studycited by 12
- 2023On the Generalization of Training-based ChatGPT Detection Methodscited by 9
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systemscited by 7
- 2024Cognitive Biases in Large Language Models for News Recommendationcited by 6
7 more
- 2024An Evaluation of Large Language Models in Bioinformatics Researchcited by 5
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalizationcited by 5
- 2024Navigating User Experience of ChatGPT-based Conversational Recommender Systems: The Effects of Prompt Guidance and Recommendation Domaincited by 3
- 2024RAG-based Crowdsourcing Task Decomposition via Masked Contrastive Learning with Promptscited by 2
- 2025Iterative Critique-Refine Framework for Enhancing LLM Personalizationcited by 1
- 2025CogRec: A Cognitive Recommender Agent Fusing Large Language Models and Soar for Explainable Recommendationcited by 1
- 2026Polarization by Default: Auditing Recommendation Bias in LLM-Based Content Curationcited by 1
- 2026Polarization by Default: Auditing Recommendation Bias in LLM-Based Content Curation17 Apr 2026
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalization16 Feb 2026
- 2025CogRec: A Cognitive Recommender Agent Fusing Large Language Models and Soar for Explainable Recommendation30 Dec 2025
- 2025Iterative Critique-Refine Framework for Enhancing LLM Personalization28 Oct 2025
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications21 Mar 2025
- 2024Cognitive Biases in Large Language Models for News Recommendation3 Oct 2024
- 2024RAG-based Crowdsourcing Task Decomposition via Masked Contrastive Learning with Prompts4 Jun 2024
- 2024Navigating User Experience of ChatGPT-based Conversational Recommender Systems: The Effects of Prompt Guidance and Recommendation Domain22 May 2024
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era17 Apr 2024
- 2024An Evaluation of Large Language Models in Bioinformatics Research21 Feb 2024
- 2024Enhancing Recommendation Diversity by Re-ranking with Large Language Models21 Jan 2024
- 2024Understanding Biases in ChatGPT-based Recommender Systems: Provider Fairness, Temporal Stability, and Recency19 Jan 2024
7 more
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systems8 Jan 2024
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directions11 Dec 2023
- 2023Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Study7 Nov 2023
- 2023On the Generalization of Training-based ChatGPT Detection Methods2 Oct 2023
- 2023Can LLM-Generated Misinformation Be Detected?25 Sep 2023
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussions3 Sep 2023
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities31 Jul 2023
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
- 2024Understanding Biases in ChatGPT-based Recommender Systems: Provider Fairness, Temporal Stability, and Recencycited by 27
- 2024Enhancing Recommendation Diversity by Re-ranking with Large Language Modelscited by 19
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2023On the Generalization of Training-based ChatGPT Detection Methodscited by 9
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systemscited by 7
- 2024Cognitive Biases in Large Language Models for News Recommendationcited by 6
- 2024An Evaluation of Large Language Models in Bioinformatics Researchcited by 5
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalizationcited by 5
12 most cited of 16 All 16 (JSON)
- 2026Polarization by Default: Auditing Recommendation Bias in LLM-Based Content Curation17 Apr 2026
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalization16 Feb 2026
- 2025Iterative Critique-Refine Framework for Enhancing LLM Personalization28 Oct 2025
- 2024Cognitive Biases in Large Language Models for News Recommendation3 Oct 2024
- 2024RAG-based Crowdsourcing Task Decomposition via Masked Contrastive Learning with Prompts4 Jun 2024
- 2024Navigating User Experience of ChatGPT-based Conversational Recommender Systems: The Effects of Prompt Guidance and Recommendation Domain22 May 2024
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era17 Apr 2024
- 2024An Evaluation of Large Language Models in Bioinformatics Research21 Feb 2024
- 2024Enhancing Recommendation Diversity by Re-ranking with Large Language Models21 Jan 2024
- 2024Understanding Biases in ChatGPT-based Recommender Systems: Provider Fairness, Temporal Stability, and Recency19 Jan 2024
- 2024Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systems8 Jan 2024
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directions11 Dec 2023
12 newest of 16 All 16 (JSON)