Stars, Stripes, and Silicon: Unravelling the ChatGPT's All-American, Monochrome, Cis-centric Bias
Not on the map. Why?
Abstract (arXiv)
This paper investigates the challenges associated with bias, toxicity, unreliability, and lack of robustness in large language models (LLMs) such as ChatGPT. It emphasizes that these issues primarily stem from the quality and diversity of data on which LLMs are trained, rather than the model architectures themselves. As LLMs are increasingly integrated into various real-world applications, their potential to negatively impact society by amplifying existing biases and generating harmful content becomes a pressing concern. The paper calls for interdisciplinary efforts to address these challenges. Additionally, it highlights the need for collaboration between researchers, practitioners, and stakeholders to establish governance frameworks, oversight, and accountability mechanisms to mitigate the harmful consequences of biased LLMs. By proactively addressing these challenges, the AI community can harness the enormous potential of LLMs for the betterment of society without perpetuating harmful biases or exacerbating existing inequalities.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 2 Oct 2024.
Builds on
27 of 54 references.
References · 27
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
15 more
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2019Measuring Bias in Contextualized Word Representationscited by 276
- 2023A Categorical Archive of ChatGPT Failurescited by 168
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2022Capturing Failures of Large Language Models via Human Cognitive Biasescited by 98
- 2019Evaluating the Underlying Gender Bias in Contextualized Word Embeddingscited by 94
- 2023How Secure is Code Generated by ChatGPT?cited by 81
- 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
- 2023ChatGPT: A Meta-Analysis after 2.5 Monthscited by 51
- 2017A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turkcited by 39
- 2023Dissociating language and thought in large language modelscited by 29
- 2023An Overview on Language Models: Recent Developments and Outlookcited by 22
- 2023Challenging the appearance of machine intelligence: Cognitive bias in LLMs and Best Practices for Adoptioncited by 21
- 2023A "Perspectival" Mirror of the Elephant: Investigating Language Bias on Google, ChatGPT, YouTube, and Wikipediacited by 8
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 26
- 2026The Moltbook Files: A Harmless Slopocalypse or Humanity's Last Experimentcited by 1
- 2025Fair Play in the Newsroom: Actor-Based Filtering Gender Discrimination in Text Corporacited by 0
- 2025Fine Tuning Methods for Low-resource Languagescited by 0
- 2026The Moltbook Files: A Harmless Slopocalypse or Humanity's Last Experiment8 May 2026
- 2025Fine Tuning Methods for Low-resource Languages5 Oct 2025
- 2025Fair Play in the Newsroom: Actor-Based Filtering Gender Discrimination in Text Corpora7 Aug 2025
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs6 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Testing and Evaluation of Large Language Models: Correctness, Non-Toxicity, and Fairness
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Models
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicity
- 2024A Multi-LLM Debiasing Framework
- 2023Learning from Red Teaming: Gender Bias Provocation and Mitigation in Large Language Models
- 2024BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs
- 2025Bias Testing and Mitigation in Black Box LLMs using Metamorphic Relations
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference