Hope vs. Hate: Understanding User Interactions with LGBTQ+ News Content in Mainstream US News Media through the Lens of Hope Speech
Not on the map. Why?
Abstract (arXiv)
This paper makes three contributions. First, via a substantial corpus of 1,419,047 comments posted on 3,161 YouTube news videos of major US cable news outlets, we analyze how users engage with LGBTQ+ news content. Our analyses focus both on positive and negative content. In particular, we construct a fine-grained hope speech classifier that detects positive (hope speech), negative, neutral, and irrelevant content. Second, in consultation with a public health expert specializing on LGBTQ+ health, we conduct an annotation study with a balanced and diverse political representation and release a dataset of 3,750 instances with fine-grained labels and detailed annotator demographic information. Finally, beyond providing a vital resource for the LGBTQ+ community, our annotation study and subsequent in-the-wild assessments reveal (1) strong association between rater political beliefs and how they rate content relevant to a marginalized community; (2) models trained on individual political beliefs exhibit considerable in-the-wild disagreement; and (3) zero-shot large language models (LLMs) align more with liberal raters.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 102 references that are in the map. First posted on arXiv 13 Feb 2025.
Builds on
37 of 102 references.
References · 37
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2023Mistral 7Bcited by 3,065
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 71
- 2019Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootingscited by 67
25 more
- 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 67
- 2018Thou shalt not hate: Countering Online Hate Speechcited by 64
- 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
- 2020A Framework for the Computational Linguistic Analysis of Dehumanizationcited by 31
- 2022CounterGeDi: A controllable approach to generate polite, detoxified and emotional counterspeechcited by 28
- 2021Pre-train or Annotate? Domain Adaptation with a Constrained Budgetcited by 27
- 2020We Don't Speak the Same Language: Interpreting Polarization through Machine Translationcited by 23
- 2024An Investigation of Large Language Models for Real-World Hate Speech Detectioncited by 20
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violencecited by 19
- 2024A Survey of Multimodal Sarcasm Detectioncited by 19
- 2023Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensivecited by 16
- 2023GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectivescited by 16
- 2019Hope Speech Detection: A Computational Analysis of the Voice of Peacecited by 15
- 2023Counterspeeches up my sleeve! Intent Distribution Learning and Persistent Fusion for Intent-Conditioned Counterspeech Generationcited by 13
- 2024Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIFcited by 13
- 2024Locating Information Gaps and Narrative Inconsistencies Across Languages: A Case Study of LGBT People Portrayals on Wikipediacited by 10
- 2019Voice for the Voiceless: Active Sampling to Detect Comments Supporting the Rohingyascited by 8
- 2021Fringe News Networks: Dynamics of US News Viewership following the 2020 Presidential Electioncited by 8
- 2024Rater Cohesion and Quality from a Vicarious Perspectivecited by 8
- 2024ARTICLE: Annotator Reliability Through In-Context Learningcited by 6
- 2024CrowdCounter: A benchmark type-specific multi-target counterspeech datasetcited by 5
- 2021Empathy and Hope: Resource Transfer to Model Inter-country Social Media Dynamicscited by 4
- 2024Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Responsecited by 4
- 2023Auditing and Robustifying COVID-19 Misinformation Datasets via Anticontent Samplingcited by 3
- 2023For Women, Life, Freedom: A Participatory AI-Based Social Web Analysis of a Watershed Moment in Iran's Gender Strugglescited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.