Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations
Not on the map. Why?
Abstract (arXiv)
Safety evaluations for large language models rely on surface-form classifiers that report declining harm scores across model generations. We provide evidence that this methodology is systematically incomplete: explicit discriminatory content is transformed rather than removed. We call this harm laundering. Analysing 450,000 gender-directed completions across 15 models spanning GPT-2 through to GPT-5 (OpenAI GPT lineage; three demographic conditions), we show that sexual violence clusters prevalent in GPT-2 women-directed output disappear by GPT-4, while men-directed completions gain positive representational territory (caregiving, emotional range, ally identity) that women-directed completions do not. The pattern is most visible at GPT-5: Topic~5 (1,997~documents) frames breast cancer as a men's rights debate, while zero equivalent clusters appear in women-directed output. Three independent classifiers score this content as non-toxic. Sentiment scores invert at GPT-4: early models demean women; later models over-correct. Topic diversity in women-directed completions falls 36% relative to men at the GPT-4 alignment boundary (W/M~= 0.58, from 0.91 at GPT-2). REGARD representational harm disparity correlates with release date (ρ = +0.55, p = .034) while Detoxify does not (ρ = -0.23, p = .42): toxicity scores fall as representational harm grows. We formalise harm laundering as a three-criteria test and provide a three-stage detection protocol applicable to any generative model. Within the OpenAI GPT lineage, toxicity score reduction is not a sufficient proxy for harm reduction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
19 of 47 references.
References · 19
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
7 more
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2021Detoxifying Language Models Risks Marginalizing Minority Voicescited by 106
- 2021A Survey on Gender Bias in Natural Language Processingcited by 89
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2022Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Biascited by 33
Built on by
Not cited yet.