mlsanityData to 7 Oct 2026

Defining and Evaluating Fair Natural Language Generation

arXiv 2008.01548 ↗First posted 28 Jul 2020cs.CL cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Our work focuses on the biases that emerge in the natural language generation (NLG) task of sentence completion. In this paper, we introduce a framework of fairness for NLG followed by an evaluation of gender biases in two state-of-the-art language models. Our analysis provides a theoretical formulation for biases in NLG and empirical evidence that existing language generation models embed gender bias.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 6; 2023: 5; 2024: 2; 2025: 1.

17 papers.

Sort:

  1. 2021Societal Biases in Language Generation: Progress and Challengescited by 201
  2. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  3. 2021Trustworthy AI: A Computational Perspectivecited by 93
  4. 2022Theories of "Gender" in NLP Bias Researchcited by 62
  5. 2023Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theorycited by 41
  6. 2023Stereotypes and Smut: The (Mis)representation of Non-cisgender Identities by Text-to-Image Modelscited by 26
  7. 2023CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Modelscited by 25
  8. 2022Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Modelscited by 22
  9. 2023Learning to Generate Equitable Text in Dialogue from Biased Training Datacited by 12
  10. 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographiescited by 7
  11. 2022An Analysis of the Effects of Decoding Algorithms on Fairness in Open-Ended Language Generationcited by 7
  12. 2022Towards Robust NLG Bias Evaluation with Syntactically-diverse Promptscited by 7
5 more
  1. 2024FairPair: A Robust Evaluation of Biases in Language Models through Paired Perturbationscited by 3
  2. 2023Entity-Based Evaluation of Political Bias in Automatic Summarizationcited by 2
  3. 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Textcited by 2
  4. 2024A Note on Bias to Completecited by 1
  5. 2022Democratizing Ethical Assessment of Natural Language Generation Modelscited by 0