Sex Trouble: Common pitfalls in incorporating sex/gender in medical machine learning and how to avoid them
Not on the map. Why?
Abstract (arXiv)
False assumptions about sex and gender are deeply embedded in the medical system, including that they are binary, static, and concordant. Machine learning researchers must understand the nature of these assumptions in order to avoid perpetuating them. In this perspectives piece, we identify three common mistakes that researchers make when dealing with sex/gender data: "sex confusion", the failure to identity what sex in a dataset does or doesn't mean; "sex obsession", the belief that sex, specifically sex assigned at birth, is the relevant variable for most applications; and "sex/gender slippage", the conflation of sex and gender even in contexts where only one or the other is known. We then discuss how these pitfalls show up in machine learning studies based on electronic health record data, which is commonly used for everything from retrospective analysis of patient outcomes to the development of algorithms to predict risk and administer care. Finally, we offer a series of recommendations about how machine learning researchers can produce both research and algorithms that more carefully engage with questions of sex/gender, better serving all patients, including transgender people.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 4 of its 135 references that are in the map. First posted on arXiv 15 Mar 2022.
Builds on
4 of 135 references.
References · 4
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
- 2020Ethical Machine Learning in Health Carecited by 113
- 2018A Review of Challenges and Opportunities in Machine Learning for Healthcited by 68
- 2021"This Whole Thing Smacks of Gender": Algorithmic Exclusion in Bioimpedance-based Body Composition Analysiscited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Data Feminism for AIcited by 6
- 2024Data Feminism for AI2 May 2024