mlsanityData to 14 Oct 2026

"Not in My Backyard": LLMs Uncover Online and Offline Social Biases Against Homelessness

arXiv 2508.13187 ↗First posted 14 Aug 2025cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Homelessness is a persistent social challenge, impacting millions worldwide. Over 876,000 people experiencing homelessness (PEH) were recorded in the U.S. in 2025. Social bias is a significant barrier to alleviating homelessness, shaping public perception and influencing policymaking. Because online textual media and offline city council discourse both reflect and influence public opinion, they provide valuable signals for identifying and tracking social biases against PEH. We release the first multi-domain PEH bias corpus with a 16-category multi-label taxonomy: a 1,698-item stratified gold-standard set annotated by partner-trained raters, plus 48,389 GPT-4.1-labeled texts, drawn from Reddit, X (formerly Twitter), news, and council meeting transcripts across ten U.S. cities (2015-2025). We benchmark six prompted LLMs on the gold-standard set and complement F1 with prevalence-gap audits. Moderate F1 coexists with large miscalibration: every model over-tags "not in my backyard" (NIMBY) (+11.5 pp) and under-detects factual claims (-30.5 pp). Error analysis on consensus false positives reveals that models treat housing vocabulary and question form as opposition proxies, producing NIMBY false positives on pro-service text. The corpus and audit protocol support municipal PEH stigma monitoring without treating teacher labels as ground truth.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

13 of 40 references.

References · 13

  1. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  2. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  3. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  4. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  5. 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 314
  6. 2020With Little Power Comes Great Responsibilitycited by 142
  7. 2025A Survey on Large Language Models with some Insights on their Capabilities and Limitationscited by 42
  8. 2024Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targetscited by 31
  9. 2021The Limits of Global Inclusion in AI Developmentcited by 14
  10. 2024Reddit-Impacts: A Named Entity Recognition Dataset for Analyzing Clinical and Social Effects of Substance Use Derived from Social Mediacited by 9
  11. 2025Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Taskscited by 9
  12. 2024OATH-Frames: Characterizing Online Attitudes Towards Homelessness with LLM Assistantscited by 7
1 more
  1. 2023The crime of being poorcited by 4

Built on by

Not cited yet.