Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Comments
Not on the map. Why?
Abstract (arXiv)
The increased proliferation of abusive content on social media platforms has a negative impact on online users. The dread, dislike, discomfort, or mistrust of lesbian, gay, transgender or bisexual persons is defined as homophobia/transphobia. Homophobic/transphobic speech is a type of offensive language that may be summarized as hate speech directed toward LGBT+ people, and it has been a growing concern in recent years. Online homophobia/transphobia is a severe societal problem that can make online platforms poisonous and unwelcome to LGBT+ people while also attempting to eliminate equality, diversity, and inclusion. We provide a new hierarchical taxonomy for online homophobia and transphobia, as well as an expert-labelled dataset that will allow homophobic/transphobic content to be automatically identified. We educated annotators and supplied them with comprehensive annotation rules because this is a sensitive issue, and we previously discovered that untrained crowdsourcing annotators struggle with diagnosing homophobia due to cultural and other prejudices. The dataset comprises 15,141 annotated multilingual comments. This paper describes the process of building the dataset, qualitative analysis of data, and inter-annotator agreement. In addition, we create baseline models for the dataset. To the best of our knowledge, our dataset is the first such dataset created. Warning: This paper contains explicit statements of homophobia, transphobia, stereotypes which may be distressing to some readers.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 21 of its 77 references that are in the map. First posted on arXiv 1 Sep 2021.
Builds on
21 of 77 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2018Learning Word Vectors for 157 Languagescited by 279
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
- 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
- 2018Assessing Gender Bias in Machine Translation -- A Case Study with Google Translatecited by 121
- 2019Getting Gender Right in Neural Machine Translationcited by 98
- 2020Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English Textcited by 67
9 more
- 2020Generating Counter Narratives against Online Hate Speech: Data and Strategiescited by 58
- 2019Offensive Language and Hate Speech Detection for Danishcited by 48
- 2019Topic-Aware Neural Keyphrase Generation for Social Media Languagecited by 33
- 2020Developing a Multilingual Annotated Corpus of Misogyny and Aggressioncited by 31
- 2020Countering hate on social media: Large scale classification of hate and counter speechcited by 22
- 2019Multi-label Categorization of Accounts of Sexism using a Neural Frameworkcited by 19
- 2021Let-Mi: An Arabic Levantine Twitter Dataset for Misogynistic Languagecited by 15
- 2017Mining fine-grained opinions on closed captions of YouTube videos with an attention-RNNcited by 3
- 2019Affective Behaviour Analysis of On-line User Interactions: Are On-line Support Groups more Therapeutic than Twitter?cited by 2
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 2; 2024: 7; 2025: 3; 2026: 2.
20 papers.
Sort:
By area:
- 2022Detecting Harmful Online Conversational Content towards LGBTQIA+ Individualscited by 8
- 2024QueerBench: Quantifying Discrimination in Language Models Toward Queer Identitiescited by 5
- 2022bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Commentscited by 3
- 2023cantnlp@LT-EDI-2023: Homophobia/Transphobia Detection in Social Media Comments using Spatio-Temporally Retrained Language Modelscited by 3
- 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Commentscited by 2
- 2024MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Commentscited by 2
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videoscited by 2
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languagescited by 2
- 2021Pretrained Transformers for Offensive Language Identification in Tanglishcited by 1
- 2024Detecting LGBTQ+ Instances of Cyberbullyingcited by 1
- 2025Characterizing Network Structure of Anti-Trans Actors on TikTokcited by 1
- 2026QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Taskscited by 1
8 more
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Textcited by 0
- 2022Optimize_Prime@DravidianLangTech-ACL2022: Emotion Analysis in Tamilcited by 0
- 2023Detection of Homophobia & Transphobia in Dravidian Languages: Exploring Deep Learning Methodscited by 0
- 2024cantnlp@LT-EDI-2024: Automatic Detection of Anti-LGBTQ+ Hate Speech in Under-resourced Languagescited by 0
- 2024Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Mediacited by 0
- 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detectioncited by 0
- 2024"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detectioncited by 0
- 2026MAAM: Anchor-Preserving Compression and Contextual Calibration for Chinese Discriminatory Language Detectioncited by 0
- 2026MAAM: Anchor-Preserving Compression and Contextual Calibration for Chinese Discriminatory Language Detection8 Jun 2026
- 2026QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Tasks28 Jan 2026
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages18 Sep 2025
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videos15 Apr 2025
- 2025Characterizing Network Structure of Anti-Trans Actors on TikTok27 Jan 2025
- 2024"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection15 Oct 2024
- 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detection10 Oct 2024
- 2024Detecting LGBTQ+ Instances of Cyberbullying18 Sep 2024
- 2024Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Media1 Jul 2024
- 2024QueerBench: Quantifying Discrimination in Language Models Toward Queer Identities18 Jun 2024
- 2024cantnlp@LT-EDI-2024: Automatic Detection of Anti-LGBTQ+ Hate Speech in Under-resourced Languages28 Jan 2024
- 2024MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Comments26 Jan 2024
8 more
- 2023cantnlp@LT-EDI-2023: Homophobia/Transphobia Detection in Social Media Comments using Spatio-Temporally Retrained Language Models20 Aug 2023
- 2023Detection of Homophobia & Transphobia in Dravidian Languages: Exploring Deep Learning Methods3 Apr 2023
- 2022Detecting Harmful Online Conversational Content towards LGBTQIA+ Individuals15 Jun 2022
- 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Comments12 May 2022
- 2022Optimize_Prime@DravidianLangTech-ACL2022: Emotion Analysis in Tamil19 Apr 2022
- 2022bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Comments27 Mar 2022
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Text18 Nov 2021
- 2021Pretrained Transformers for Offensive Language Identification in Tanglish6 Oct 2021
- 2022Detecting Harmful Online Conversational Content towards LGBTQIA+ Individualscited by 8
- 2024QueerBench: Quantifying Discrimination in Language Models Toward Queer Identitiescited by 5
- 2022bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Commentscited by 3
- 2023cantnlp@LT-EDI-2023: Homophobia/Transphobia Detection in Social Media Comments using Spatio-Temporally Retrained Language Modelscited by 3
- 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Commentscited by 2
- 2024MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Commentscited by 2
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videoscited by 2
- 2021Pretrained Transformers for Offensive Language Identification in Tanglishcited by 1
- 2024Detecting LGBTQ+ Instances of Cyberbullyingcited by 1
- 2025Characterizing Network Structure of Anti-Trans Actors on TikTokcited by 1
- 2026QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Taskscited by 1
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Textcited by 0
12 most cited of 19 All 19 (JSON)
- 2026MAAM: Anchor-Preserving Compression and Contextual Calibration for Chinese Discriminatory Language Detection8 Jun 2026
- 2026QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Tasks28 Jan 2026
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videos15 Apr 2025
- 2025Characterizing Network Structure of Anti-Trans Actors on TikTok27 Jan 2025
- 2024"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection15 Oct 2024
- 2024A Target-Aware Analysis of Data Augmentation for Hate Speech Detection10 Oct 2024
- 2024Detecting LGBTQ+ Instances of Cyberbullying18 Sep 2024
- 2024Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Media1 Jul 2024
- 2024QueerBench: Quantifying Discrimination in Language Models Toward Queer Identities18 Jun 2024
- 2024cantnlp@LT-EDI-2024: Automatic Detection of Anti-LGBTQ+ Hate Speech in Under-resourced Languages28 Jan 2024
- 2024MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Comments26 Jan 2024
- 2023cantnlp@LT-EDI-2023: Homophobia/Transphobia Detection in Social Media Comments using Spatio-Temporally Retrained Language Models20 Aug 2023
12 newest of 19 All 19 (JSON)