Fairness for Unobserved Characteristics: Insights from Technological Impacts on Queer Communities
Not on the map. Why?
Abstract (arXiv)
Advances in algorithmic fairness have largely omitted sexual orientation and gender identity. We explore queer concerns in privacy, censorship, language, online safety, health, and employment to study the positive and negative effects of artificial intelligence on queer communities. These issues underscore the need for new directions in fairness research that take into account a multiplicity of considerations, from privacy preservation, context sensitivity and process fairness, to an awareness of sociotechnical impact and the increasingly important role of inclusive and participatory research processes. Most current approaches for algorithmic fairness assume that the target characteristics for fairness--frequently, race and legal gender--can be observed or recorded. Sexual orientation and gender identity are prototypical instances of unobserved characteristics, which are frequently missing, unknown or fundamentally unmeasurable. This paper highlights the importance of developing new approaches for algorithmic fairness that break away from the prevailing assumption of observed characteristics.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 38 of its 176 references that are in the map. First posted on arXiv 3 Feb 2021.
Builds on
38 of 176 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2017Counterfactual Fairnesscited by 802
- 2020Aligning AI With Shared Human Valuescited by 706
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2019Measurement and Fairnesscited by 299
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2018Machine Learning with Membership Privacy using Adversarial Regularizationcited by 177
- 2018Reducing Gender Bias in Abusive Language Detectioncited by 152
26 more
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2019Towards a Critical Race Methodology in Algorithmic Fairnesscited by 124
- 2020Towards Controllable Biases in Language Generationcited by 112
- 2020On the Privacy Risks of Algorithmic Fairnesscited by 82
- 2018Privacy Preserving Machine Learning: Threats and Solutionscited by 78
- 2018Differentially Private Fair Learningcited by 76
- 2020Demoting Racial Bias in Hate Speech Detectioncited by 62
- 2019Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learningcited by 57
- 2020"What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairnesscited by 56
- 2018Fairness Through Computationally-Bounded Awarenesscited by 55
- 2016A Reinforcement Learning System to Encourage Physical Activity in Diabetes Patientscited by 38
- 2020Explainability for fair machine learningcited by 33
- 2020Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamicscited by 31
- 2020Can I Trust My Fairness Metric? Assessing Fairness with Unlabeled Data and Bayesian Inferencecited by 31
- 2018Proxy Fairnesscited by 29
- 2019Fairness in representation: quantifying stereotyping as a representational harmcited by 26
- 2019Awareness in Practice: Tensions in Access to Sensitive Attribute Data for Antidiscriminationcited by 23
- 2019Privacy-Preserving Adversarial Representation Learning in ASR: Reality or Illusion?cited by 22
- 2019An Algorithmic Framework for Fairness Elicitationcited by 15
- 2020Cyberbullying Detection with Fairness Constraintscited by 15
- 2020Adversarial Learning for Counterfactual Fairnesscited by 14
- 2020Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Boundscited by 13
- 2020Adversarial Privacy-preserving Filtercited by 13
- 2019A large-scale crowdsourced analysis of abuse against women journalists and politicians on Twittercited by 6
- 2019HateMonitors: Language Agnostic Abuse Detection in Social Mediacited by 5
- 2019Contrastive Fairness in Machine Learningcited by 3
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 13; 2024: 7; 2025: 4; 2026: 3.
40 papers.
Sort:
By area:
- 2023PaLM 2 Technical Reportcited by 1,154
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2021Challenges in Detoxifying Language Modelscited by 169
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applicationscited by 53
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
- 2023WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Modelscited by 42
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2025Value Profiles for Encoding Human Variationcited by 29
- 2021Fairness without the sensitive attribute via Causal Variational Autoencodercited by 21
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actionscited by 21
28 more
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2023Challenges of Large Language Models for Mental Health Counselingcited by 16
- 2022Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairnesscited by 13
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 11
- 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harmscited by 10
- 2022Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Modelscited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2023Are demographically invariant models and representations in medical imaging fair?cited by 6
- 2022Fast online ranking with fairness of exposurecited by 5
- 2023Towards Reliable Assessments of Demographic Disparities in Multi-Label Image Classifierscited by 5
- 2023On the Origins of Bias in NLP through the Lens of the Jim Codecited by 5
- 2024What is Fair? Defining Fairness in Machine Learning for Healthcited by 5
- 2024Beyond the binary: Limitations and possibilities of gender-related speech technology researchcited by 5
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learningcited by 5
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2022The Linguistic Blind Spot of Value-Aligned Agency, Natural and Artificialcited by 1
- 2024(Unfair) Norms in Fairness Research: A Meta-Analysiscited by 1
- 2022Towards Algorithmic Fairness in Space-Time: Filling in Black Holescited by 0
- 2023Deep Learning and Ethicscited by 0
- 2023Should they? Mobile Biometrics and Technopolicy meet Queer Community Considerationscited by 0
- 2024Recourse for reclamation: Chatting with generative language modelscited by 0
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canadacited by 0
- 2025Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Modelscited by 0
- 2025Cluster Paths: Navigating Interpretability in Neural Networkscited by 0
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identitiescited by 0
- 2026Queer inclusion in speech datasets: An audit and taxonomy of practical tensionscited by 0
- 2026Towards participatory speech dataset curation: A queer case study and conceptual frameworkcited by 0
- 2026Towards participatory speech dataset curation: A queer case study and conceptual framework21 Sep 2026
- 2026Queer inclusion in speech datasets: An audit and taxonomy of practical tensions21 Sep 2026
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities2 Sep 2026
- 2025Cluster Paths: Navigating Interpretability in Neural Networks8 Oct 2025
- 2025Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models18 Jun 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2025Value Profiles for Encoding Human Variation19 Mar 2025
- 2024Beyond the binary: Limitations and possibilities of gender-related speech technology research20 Sep 2024
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada15 Jul 2024
- 2024(Unfair) Norms in Fairness Research: A Meta-Analysis17 Jun 2024
- 2024What is Fair? Defining Fairness in Machine Learning for Health13 Jun 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
28 more
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Recourse for reclamation: Chatting with generative language models21 Mar 2024
- 2023Challenges of Large Language Models for Mental Health Counseling23 Nov 2023
- 2023AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications14 Nov 2023
- 2023Should they? Mobile Biometrics and Technopolicy meet Queer Community Considerations6 Oct 2023
- 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms15 Jul 2023
- 2023WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models26 Jun 2023
- 2023Deep Learning and Ethics24 May 2023
- 2023PaLM 2 Technical Report17 May 2023
- 2023On the Origins of Bias in NLP through the Lens of the Jim Code16 May 2023
- 2023Are demographically invariant models and representations in medical imaging fair?2 May 2023
- 2023Generative models improve fairness of medical classifiers under distribution shifts18 Apr 2023
- 2023Queer In AI: A Case Study in Community-Led Participatory AI29 Mar 2023
- 2023Towards Reliable Assessments of Demographic Disparities in Multi-Label Image Classifiers16 Feb 2023
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventions27 Jan 2023
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022Towards Algorithmic Fairness in Space-Time: Filling in Black Holes8 Nov 2022
- 2022Improving alignment of dialogue agents via targeted human judgements28 Sep 2022
- 2022Fast online ranking with fairness of exposure13 Sep 2022
- 2022The Linguistic Blind Spot of Value-Aligned Agency, Natural and Artificial2 Jul 2022
- 2022Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models23 Jun 2022
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models16 Jun 2022
- 2022Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairness18 Apr 2022
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethics11 Apr 2022
- 2021Ethical and social risks of harm from Language Models8 Dec 2021
- 2021Challenges in Detoxifying Language Models15 Sep 2021
- 2021Fairness without the sensitive attribute via Causal Variational Autoencoder10 Sep 2021
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions20 Jul 2021
- 2025Value Profiles for Encoding Human Variationcited by 29
- 2025Value Profiles for Encoding Human Variation19 Mar 2025
- 2023PaLM 2 Technical Reportcited by 1,154
- 2023PaLM 2 Technical Report17 May 2023
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2021Challenges in Detoxifying Language Modelscited by 169
- 2023Generative models improve fairness of medical classifiers under distribution shiftscited by 90
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
- 2023WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Modelscited by 42
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2021Fairness without the sensitive attribute via Causal Variational Autoencodercited by 21
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actionscited by 21
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2023Challenges of Large Language Models for Mental Health Counselingcited by 16
- 2022Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairnesscited by 13
- 2022Metaethical Perspectives on 'Benchmarking' AI Ethicscited by 11
12 most cited of 36 All 36 (JSON)
- 2026Towards participatory speech dataset curation: A queer case study and conceptual framework21 Sep 2026
- 2026Queer inclusion in speech datasets: An audit and taxonomy of practical tensions21 Sep 2026
- 2026WinoQueer-NL: Assessing Bias in Dutch Language Models toward LGBTQ+ Identities2 Sep 2026
- 2025Cluster Paths: Navigating Interpretability in Neural Networks8 Oct 2025
- 2025Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models18 Jun 2025
- 2025Identities are not Interchangeable: The Problem of Overgeneralization in Fair Machine Learning7 May 2025
- 2024Beyond the binary: Limitations and possibilities of gender-related speech technology research20 Sep 2024
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada15 Jul 2024
- 2024(Unfair) Norms in Fairness Research: A Meta-Analysis17 Jun 2024
- 2024What is Fair? Defining Fairness in Machine Learning for Health13 Jun 2024
- 2024LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions13 Jun 2024
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
12 newest of 36 All 36 (JSON)