mlsanityData to 7 Oct 2026

WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles

arXiv 2411.06194 ↗First posted 9 Nov 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We assess the difficulty of gender resolution in literary-style dialogue settings and the influence of gender stereotypes. Instances of the test suite contain spoken dialogue interleaved with external meta-context about the characters and the manner of speaking. We find that character and manner stereotypes outside of the dialogue significantly impact the gender agreement of referents within the dialogue.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 10 references that are in the map. First posted on arXiv 9 Nov 2024.

Builds on

8 of 10 references.

References · 8

  1. 2019Evaluating Gender Bias in Machine Translationcited by 247
  2. 2021Gender Bias in Machine Translationcited by 116
  3. 2020Gender Coreference and Bias Evaluation at WMT 2020cited by 21
  4. 2023Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpuscited by 20
  5. 2023What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronounscited by 19
  6. 2024A Prompt Response to the Demand for Automatic Gender-Neutral Translationcited by 12
  7. 2023Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INEScited by 6
  8. 2024Investigating Markers and Drivers of Gender Bias in Machine Translationscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Gender-Neutral Machine Translation Strategies in Practicecited by 3