Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation
Not on the map. Why?
Abstract (arXiv)
Fairness evaluation concerns not only what a model produces, but also what its outputs ought to be compared against. When a model generates "a CEO in the United States," the prompt leaves demographic realization to the model. Existing group fairness definitions assume that sensitive attributes are given on the input side. Generative audits instead examine output-side demographic composition, yet the targets they compare it against are typically supplied rather than justified. The upstream question is what the target distribution should be. We formalize this missing-target problem for demographic-value-unspecified generation and decompose target construction into four commitments: the evaluative object, prior admissibility, allocation, and operationalization. In this framework, we admit the geographic prior under a geographic-membership interpretation for the declared public-world use. The occupational prior, under an incumbency interpretation, requires an independently defended objective such as workforce-composition fidelity. Instantiating this construction in AP-Bench, we find substantial distribution divergence from geography-derived targets, ranging from 0.508 to 0.606 on a 0-to-1 scale. Replacing each geography-derived target with an equal-category comparator, while holding generations and measurement fixed, produces model-specific mean absolute cell-level JSD2 changes ranging from 0.279 to 0.355. Target construction is therefore not a preliminary to fairness evaluation but a component of it. What we supply is not a universal target, but a framework that makes explicit the justification required before a distribution can serve as a fairness standard.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 54 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
22 of 54 references.
References · 22
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
- 2017Counterfactual Fairnesscited by 804
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
- 2019Measurement and Fairnesscited by 308
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 162
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 149
- 2019Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Searchcited by 138
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2019Problem Formulation and Fairnesscited by 85
- 2023Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Votingcited by 46
- 2020On the Moral Justification of Statistical Paritycited by 30
10 more
- 2022Causally Testing Gender Bias in LLMs: A Case Study on Occupational Biascited by 28
- 2021Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systemscited by 27
- 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
- 2017On conditional parity as a notion of non-discrimination in machine learningcited by 10
- 2025A Tale of Two Identities: An Ethical Audit of Human and AI-Crafted Personascited by 8
- 2025Bias Association Discovery Framework for Open-Ended LLM Generationscited by 4
- 2025Generating the Modal Worker: A Cross-Model Audit of Race and Gender in LLM-Generated Personas Across 41 Occupationscited by 3
- 2025Toward Valid Measurement Of (Un)fairness For Generative AI: A Proposal For Systematization Through The Lens Of Fair Equality of Chancescited by 2
- 2026Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuningcited by 2
- 2026Who Defines Fairness? Target-Based Prompting for Demographic Representation in Generative Modelscited by 1
Built on by
Not cited yet.