# Large scale analysis of gender bias and sexism in song lyrics

arXiv: https://arxiv.org/abs/2208.02052 · HTML: https://mlsanity.com/paper/2208.02052/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 61 references that are in the map.
- First posted on arXiv 3 Aug 2022.

## Builds on (most cited first, 16 of 16)

- [Efficient Estimation of Word Representations in Vector Space](https://mlsanity.com/paper/1301.3781/) (2013)
- [Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings](https://mlsanity.com/paper/1607.06520/) (2016)
- [StereoSet: Measuring stereotypical bias in pretrained language models](https://mlsanity.com/paper/2004.09456/) (2020)
- [Semantics derived automatically from language corpora contain human-like biases](https://mlsanity.com/paper/1608.07187/) (2016)
- [Mitigating Gender Bias in Natural Language Processing: Literature Review](https://mlsanity.com/paper/1906.08976/) (2019)
- [Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes](https://mlsanity.com/paper/1711.08412/) (2017)
- [Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases](https://mlsanity.com/paper/2006.03955/) (2020)
- [Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview](https://mlsanity.com/paper/1912.11078/) (2019)
- [A Survey on Gender Bias in Natural Language Processing](https://mlsanity.com/paper/2112.14168/) (2021)
- [Understanding Undesirable Word Embedding Associations](https://mlsanity.com/paper/1908.06361/) (2019)
- ["Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samples](https://mlsanity.com/paper/2004.12764/) (2020)
- [A Quantum Natural Language Processing Approach to Musical Intelligence](https://mlsanity.com/paper/2111.06741/) (2021)
- [SWEAT: Scoring Polarization of Topics across Different Corpora](https://mlsanity.com/paper/2109.07231/) (2021)
- [It's Only Words And Words Are All I Have](https://mlsanity.com/paper/1901.05227/) (2019)
- [Decoding the Style and Bias of Song Lyrics](https://mlsanity.com/paper/1907.07818/) (2019)
- [Quantifying Gender Bias in Consumer Culture](https://mlsanity.com/paper/2201.03173/) (2022)

## Built on by (most cited first, 4 of 4)

- [ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science](https://mlsanity.com/paper/2408.01966/) (2024)
- [Computational lexical analysis of Flamenco genres](https://mlsanity.com/paper/2405.05723/) (2024)
- [Tuning Into Bias: A Computational Study of Gender Bias in Song Lyrics](https://mlsanity.com/paper/2409.15949/) (2024)
- [Language Models That Walk the Talk: A Framework for Formal Fairness Certificates](https://mlsanity.com/paper/2505.12767/) (2025)

## Abstract (arXiv)

We employ Natural Language Processing techniques to analyse 377808 English song lyrics from the "Two Million Song Database" corpus, focusing on the expression of sexism across five decades (1960-2010) and the measurement of gender biases. Using a sexism classifier, we identify sexist lyrics at a larger scale than previous studies using small samples of manually annotated popular songs. Furthermore, we reveal gender biases by measuring associations in word embeddings learned on song lyrics. We find sexist content to increase across time, especially from male artists and for popular songs appearing in Billboard charts. Songs are also shown to contain different language biases depending on the gender of the performer, with male solo artist songs containing more and stronger biases. This is the first large scale analysis of this type, giving insights into language usage in such an influential part of popular culture.
