Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening
Not on the map. Why?
Abstract (arXiv)
Organizations increasingly route employee feedback to leaders through large language model (LLM) summaries, an unaudited layer that silences already-spoken voice. We introduce a Voice Retention / Representation Ratio metric for representational bias in summarization and apply it to a bilingual (English/German) corpus of 2,586 free-text responses from a global professional service company. First, employees supply criticism more reliably than praise (withholding praise is 82 times more common). Second, across 45 leader-summaries the pipeline filters by popularity, not sentiment: criticism survives, yet a concern voiced once is dropped 86% of the time, with short and German-only content lost on the same axis (theme retention 0.14 vs 0.74; German directional). Controlling for frequency, sentiment has no independent effect; the harm is prevalence-driven, which sentiment-only audits miss. A targeted prompt recovers only named themes. We contribute the metric, field evidence, and a disaggregated voice-retention card.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 9 of its 29 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
9 of 29 references.
References · 9
- 2018Datasheets for Datasetscited by 1,377
- 2018Model Cards for Model Reportingcited by 1,076
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 898
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 857
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 792
- 2023Benchmarking Large Language Models for News Summarizationcited by 444
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2020Dialect Diversity in Text Summarization on Twittercited by 17
Built on by
Not cited yet.