mlsanityData to 7 Oct 2026

Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features

arXiv 2310.06458 ↗First posted 10 Oct 2023cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

The increasing ubiquity of language technology necessitates a shift towards considering cultural diversity in the machine learning realm, particularly for subjective tasks that rely heavily on cultural nuances, such as Offensive Language Detection (OLD). Current understanding underscores that these tasks are substantially influenced by cultural values, however, a notable gap exists in determining if cultural features can accurately predict the success of cross-cultural transfer learning for such subjective tasks. Addressing this, our study delves into the intersection of cultural features and transfer learning effectiveness. The findings reveal that cultural value surveys indeed possess a predictive power for cross-cultural transfer learning success in OLD tasks and that it can be further improved using offensive word distance. Based on these results, we advocate for the integration of cultural information into datasets. Additionally, we recommend leveraging data sources rich in cultural information, such as surveys, to enhance cultural adaptability. Our research signifies a step forward in the quest for more inclusive, culturally sensitive language technologies.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

34 of 69 references.

References · 34

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  2. 2019How multilingual is Multilingual BERT?cited by 642
  3. 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
  4. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  5. 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
  6. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
  7. 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 180
  8. 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
  9. 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
  10. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  11. 2018Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterioncited by 69
  12. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
22 more
  1. 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
  2. 2017Learning Language Representations for Typology Predictioncited by 40
  3. 2021Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languagescited by 38
  4. 2022MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognitioncited by 38
  5. 2021Detecting Cross-Geographic Biases in Toxicity Modeling on Social Mediacited by 31
  6. 2020Arabic Offensive Language on Twitter: Analysis and Experimentscited by 28
  7. 2022Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languagescited by 25
  8. 2021Predicting the Performance of Multilingual NLP Modelscited by 24
  9. 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
  10. 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Modelscited by 20
  11. 2018Unsupervised Hyperalignment for Multilingual Word Embeddingscited by 17
  12. 2019Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representationscited by 17
  13. 2019Towards Realistic Practices In Low-Resource Natural Language Processing: The Development Setcited by 16
  14. 2021Analysing The Impact Of Linguistic Features On Cross-Lingual Transfercited by 16
  15. 2022KOLD: Korean Offensive Language Datasetcited by 14
  16. 2018Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Taggingcited by 8
  17. 2022Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detectioncited by 8
  18. 2022EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in Englishcited by 7
  19. 2022"It's Not Just Hate'': A Multi-Dimensional Perspective on Detecting Harmful Speech Onlinecited by 7
  20. 2022Measuring Geographic Performance Disparities of Offensive Language Classifierscited by 5
  21. 2023Classification of Cross-cultural News Eventscited by 2
  22. 2022Leveraging Dependency Grammar for Fine-Grained Offensive Language Detection using Graph Convolutional Networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 8; 2026: 3.

18 papers.

Sort:

By area:

  1. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
  2. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  3. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  4. 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
  5. 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
  6. 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?cited by 14
  7. 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
  8. 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
  9. 2023Cultural Adaptation of Recipescited by 6
  10. 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
  11. 2026Self-Explaining Hate Speech Detection with Moral Rationalescited by 5
  12. 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collectionscited by 2
6 more
  1. 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktalescited by 2
  2. 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generationcited by 1
  3. 2025Culture Matters in Toxic Language Detection in Persiancited by 1
  4. 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebookcited by 1
  5. 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generationcited by 0
  6. 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0