mlsanityData to 14 Oct 2026

Contaminated Collaboration: Measuring Gender Bias Transfer in LLM-Assisted Student Writing

arXiv 2606.15914 ↗First posted 14 Jun 2026cs.CL cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Gender bias in LLMs has been studied extensively in model outputs, with biased prompts shown to amplify stereotyped generations. Whether such bias propagates into text produced by humans who use these systems, however, remains underexplored. We investigate whether gender bias in an LLM writing assistant transfers into career plan essays written by students. We first verify that a gender-biased prompt induces gender-differentiated language in LLM-generated essays, while a neutral prompt does not. We then recruited participants (N = 123) in a controlled environment to write career plan essays for paired biographical profiles differing only in gender under three conditions: no AI assistance, neutral LLM assistance, or gender-biased LLM assistance. Students in the biased condition produced essays with a significantly larger agentic gap and more gender-stereotypic occupation suggestions than those in the control and neutral conditions. Our results also reveal that this bias transfer is asymmetric: agency is suppressed in female-target essays while male-target writing remains largely unaffected. Our findings highlight the risk of bias propagation in AI-assisted writing, calling for fairness-aware design in educational AI tools.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

20 of 40 references.

References · 20

  1. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  2. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
  3. 2018Gender Bias in Coreference Resolutioncited by 442
  4. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  5. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 199
  6. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  7. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 148
  8. 2024Cognitive Bias in Decision-Making with LLMscited by 106
  9. 2024Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Modelscited by 33
  10. 2023Unveiling Gender Bias in Terms of Profession Across LLMs: Analyzing and Addressing Sociological Implicationscited by 29
  11. 2026How LLMs Distort Our Written Languagecited by 21
  12. 2023Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistancecited by 15
8 more
  1. 2024Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflictscited by 15
  2. 2024The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?cited by 14
  3. 2024The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMscited by 12
  4. 2024Gender Bias in LLM-generated Interview Responsescited by 10
  5. 2025No Thoughts Just AI: Biased LLM Hiring Recommendations Alter Human Decision Making and Limit Human Autonomycited by 8
  6. 2025Quantifying Cognitive Bias Induction in LLM-Generated Contentcited by 7
  7. 2024When Stereotypes GTG: The Impact of Predictive Text Suggestions on Gender Bias in Human-AI Co-Writingcited by 2
  8. 2025Exploring and Mitigating Gender Bias in Encoder-Based Transformer Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025More Women, Same Stereotypes: Unpacking the Gender Bias Paradox in Large Language Models
  2. 2024Disclosure and Mitigation of Gender Bias in LLMs
  3. 2024How far can bias go? Tracing bias from pretraining data to alignment
  4. 2023Gender bias and stereotypes in Large Language Models
  5. 2025Benchmarking Educational LLMs with Analytics: A Case Study on Gender Bias in Feedback
  6. 2024White Men Lead, Black Women Help? Benchmarking and Mitigating Language Agency Social Biases in LLMs
  7. 2022Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal
  8. 2025GenderBench: Evaluation Suite for Gender Biases in LLMs