mlsanityData to 14 Oct 2026

Cordyceps@LT-EDI: Patching Language-Specific Homophobia/Transphobia Classifiers with a Multilingual Understanding

arXiv 2309.13561 ↗First posted 24 Sep 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Detecting transphobia, homophobia, and various other forms of hate speech is difficult. Signals can vary depending on factors such as language, culture, geographical region, and the particular online platform. Here, we present a joint multilingual (M-L) and language-specific (L-S) approach to homophobia and transphobic hate speech detection (HSD). M-L models are needed to catch words, phrases, and concepts that are less common or missing in a particular language and subsequently overlooked by L-S models. Nonetheless, L-S models are better situated to understand the cultural and linguistic context of the users who typically write in a particular language. Here we construct a simple and successful way to merge the M-L and L-S approaches through simple weight interpolation in such a way that is interpretable and data-driven. We demonstrate our system on task A of the 'Shared Task on Homophobia/Transphobia Detection in social media comments' dataset for homophobia and transphobic HSD. Our system achieves the best results in three of five languages and achieves a 0.997 macro average F1-score on Malayalam texts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 24 Sep 2023.

Builds on

17 of 31 references.

References · 17

  1. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  2. 2021Robust fine-tuning of zero-shot modelscited by 797
  3. 2022Patching open-vocabulary models by interpolating weightscited by 190
  4. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  5. 2022Fusing finetuned models for better pretrainingcited by 110
  6. 2023Knowledge is a Region in Weight Space for Fine-tuned Language Modelscited by 58
  7. 2022ColD Fusion: Collaborative Descent for Distributed Multitask Finetuningcited by 52
  8. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  9. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  10. 2020What the [MASK]? Making Sense of Language-Specific BERT Modelscited by 44
  11. 2020AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languagescited by 44
  12. 2023From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Modelscited by 26
5 more
  1. 2021mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Modelscited by 19
  2. 2018Universal Dependency Parsing for Hindi-English Code-switchingcited by 18
  3. 2017Detecting the Hate Code on Social Mediacited by 16
  4. 2020Code-switching patterns can be an effective route to improve performance of downstream NLP applications: A case study of humour, sarcasm and hate speech detectioncited by 12
  5. 2021Leveraging Transformers for Hate Speech Detection in Conversational Code-Mixed Tweetscited by 3

Built on by

Not cited yet.