Good/Evil Reputation Judgment of Celebrities by LLMs via Retrieval Augmented Generation
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
The purpose of this paper is to examine whether large language models (LLMs) can understand what is good and evil with respect to judging good/evil reputation of celebrities. Specifically, we first apply a large language model (namely, ChatGPT) to the task of collecting sentences that mention the target celebrity from articles about celebrities on Web pages. Next, the collected sentences are categorized based on their contents by ChatGPT, where ChatGPT assigns a category name to each of those categories. Those assigned category names are referred to as "aspects" of each celebrity. Then, by applying the framework of retrieval augmented generation (RAG), we show that the large language model is quite effective in the task of judging good/evil reputation of aspects and descriptions of each celebrity. Finally, also in terms of proving the advantages of the proposed method over existing services incorporating RAG functions, we show that the proposed method of judging good/evil of aspects/descriptions of each celebrity significantly outperform an existing service incorporating RAG functions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 2 of its 12 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
2 of 12 references.
References · 2
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Survey
- 2025TrustRAG: Enhancing Robustness and Trustworthiness in Retrieval-Augmented Generation
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems
- 2025Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Survey
- 2024Supporting Human Raters with the Detection of Harmful Content using Large Language Models
- 2025Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey
- 2024Face the Facts! Evaluating RAG-based Pipelines for Professional Fact-Checking
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models