Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features
Not on the map. Why?
Abstract (arXiv)
The increasing ubiquity of language technology necessitates a shift towards considering cultural diversity in the machine learning realm, particularly for subjective tasks that rely heavily on cultural nuances, such as Offensive Language Detection (OLD). Current understanding underscores that these tasks are substantially influenced by cultural values, however, a notable gap exists in determining if cultural features can accurately predict the success of cross-cultural transfer learning for such subjective tasks. Addressing this, our study delves into the intersection of cultural features and transfer learning effectiveness. The findings reveal that cultural value surveys indeed possess a predictive power for cross-cultural transfer learning success in OLD tasks and that it can be further improved using offensive word distance. Based on these results, we advocate for the integration of cultural information into datasets. Additionally, we recommend leveraging data sources rich in cultural information, such as surveys, to enhance cultural adaptability. Our research signifies a step forward in the quest for more inclusive, culturally sensitive language technologies.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 10 Oct 2023.
Builds on
34 of 69 references.
References · 34
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2019How multilingual is Multilingual BERT?cited by 642
- 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 180
- 2019Choosing Transfer Languages for Cross-Lingual Learningcited by 143
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2018Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterioncited by 69
- 2019Offensive Language and Hate Speech Detection for Danishcited by 48
22 more
- 2022Handling and Presenting Harmful Text in NLP Researchcited by 43
- 2017Learning Language Representations for Typology Predictioncited by 40
- 2021Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languagescited by 38
- 2022MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognitioncited by 38
- 2021Detecting Cross-Geographic Biases in Toxicity Modeling on Social Mediacited by 31
- 2020Arabic Offensive Language on Twitter: Analysis and Experimentscited by 28
- 2022Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languagescited by 25
- 2021Predicting the Performance of Multilingual NLP Modelscited by 24
- 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
- 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Modelscited by 20
- 2018Unsupervised Hyperalignment for Multilingual Word Embeddingscited by 17
- 2019Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representationscited by 17
- 2019Towards Realistic Practices In Low-Resource Natural Language Processing: The Development Setcited by 16
- 2021Analysing The Impact Of Linguistic Features On Cross-Lingual Transfercited by 16
- 2022KOLD: Korean Offensive Language Datasetcited by 14
- 2018Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Taggingcited by 8
- 2022Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detectioncited by 8
- 2022EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in Englishcited by 7
- 2022"It's Not Just Hate'': A Multi-Dimensional Perspective on Detecting Harmful Speech Onlinecited by 7
- 2022Measuring Geographic Performance Disparities of Offensive Language Classifierscited by 5
- 2023Classification of Cross-cultural News Eventscited by 2
- 2022Leveraging Dependency Grammar for Fine-Grained Offensive Language Detection using Graph Convolutional Networkscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 8; 2026: 3.
18 papers.
Sort:
By area:
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
- 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?cited by 14
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
- 2023Cultural Adaptation of Recipescited by 6
- 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
- 2026Self-Explaining Hate Speech Detection with Moral Rationalescited by 5
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collectionscited by 2
6 more
- 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktalescited by 2
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generationcited by 1
- 2025Culture Matters in Toxic Language Detection in Persiancited by 1
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebookcited by 1
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generationcited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook16 Mar 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
- 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challenges15 Sep 2025
- 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktales4 Jun 2025
- 2025Culture Matters in Toxic Language Detection in Persian3 Jun 2025
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections30 May 2025
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation7 May 2025
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLP17 Feb 2025
- 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?13 Feb 2025
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation11 Feb 2025
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.S21 Oct 2024
6 more
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?24 Jun 2024
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting17 Jun 2024
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Models17 Jun 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Survey5 Mar 2024
- 2023Cultural Adaptation of Recipes26 Oct 2023
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
- 2023Cultural Adaptation of Recipescited by 6
- 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
- 2026Self-Explaining Hate Speech Detection with Moral Rationalescited by 5
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collectionscited by 2
- 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktalescited by 2
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook16 Mar 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
- 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challenges15 Sep 2025
- 2025Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktales4 Jun 2025
- 2025Culture Matters in Toxic Language Detection in Persian3 Jun 2025
- 2025Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections30 May 2025
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation7 May 2025
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLP17 Feb 2025
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation11 Feb 2025
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.S21 Oct 2024
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting17 Jun 2024
12 newest of 16 All 16 (JSON)