mlsanityData to 14 Oct 2026

Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language

arXiv 2507.16557 ↗First posted 22 Jul 2025cs.CL cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied to other languages. This work aims to contribute to this research strand by presenting five German datasets for gender bias evaluation in LLMs. The datasets are grounded in well-established concepts of gender bias and are accessible through multiple methodologies. Our findings, reported for eight multilingual LLM models, reveal unique challenges associated with gender bias in German, including the ambiguous interpretation of male occupational terms and the influence of seemingly neutral nouns on gender perception. This work contributes to the understanding of gender bias in LLMs across languages and underscores the necessity for tailored evaluation frameworks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 34 of its 64 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

34 of 64 references.

References · 34

  1. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  2. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  3. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  4. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
  5. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  6. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  7. 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
  8. 2018Gender Bias in Coreference Resolutioncited by 442
  9. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  10. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  11. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  12. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
22 more
  1. 2019Gender Bias in Contextualized Word Embeddingscited by 203
  2. 2020Social Biases in NLP Models as Barriers for Persons with Disabilitiescited by 182
  3. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  4. 2019Reducing Sentiment Bias in Language Models via Counterfactual Evaluationcited by 148
  5. 2020Intrinsic Bias Metrics Do Not Correlate with Application Biascited by 148
  6. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 147
  7. 2019Assessing Social and Intersectional Biases in Contextualized Word Representationscited by 135
  8. 2020UnQovering Stereotyping Biases via Underspecified Questionscited by 126
  9. 2019Evaluating the Underlying Gender Bias in Contextualized Word Embeddingscited by 94
  10. 2024Large Language Models are Geographically Biasedcited by 93
  11. 2020Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Biascited by 82
  12. 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
  13. 2020"Call me sexist, but...": Revisiting Sexism Detection Using Psychological Scales and Adversarial Samplescited by 48
  14. 2022Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Taskscited by 48
  15. 2023On Evaluating and Mitigating Gender Biases in Multilingual Settingscited by 31
  16. 2023On the Independence of Association Bias and Empirical Fairness in Language Modelscited by 29
  17. 2022Challenges in Measuring Bias via Open-Ended Language Generationcited by 24
  18. 2024Large Language Models Still Exhibit Bias in Long Textcited by 16
  19. 2023Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistancecited by 15
  20. 2023How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responsescited by 5
  21. 2024Leveraging Large Language Models to Measure Gender Representation Bias in Gendered Language Corporacited by 5
  22. 2024With a Grain of SALT: Are LLMs Fair Across Social Dimensions?cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Failure of contextual invariance in large language modelscited by 3
  2. 2026MOSAIC: Unveiling the Moral, Social and Individual Dimensions of Large Language Modelscited by 2
  3. 2026Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMscited by 0