The Cross-Domain Generalization Cost of Offensive Language Detection
Not on the map. Why?
Abstract (arXiv)
Offensive language detection models generally suffer performance degradation when deployed across datasets and across languages, yet most existing studies stop at reporting this phenomenon and lack a systematic methodology for decomposing the causes of degradation into attributable components and quantifying the cost of remediation. This paper proposes a diagnosis and optimization framework composed of three coordinated technical components. First, a zero-shot transfer loss decomposition that separates the performance degradation from OLID to MLMA into two independently measurable components, namely dataset effect and language effect. Second, a controlled fine-tuning protocol that quantifies both adaptation efficiency and the hidden damage inflicted on the source task by comparing few shot learning curves under continued fine-tuning and cold-start starting points. Third, three joint training strategies incorpo rating temperature sampling and experience replay, which offer a controllable Pareto trade-off between improving multilingual capability and preserving source-task performance. Experiments built on this framework show that the dataset effect dominates the zero-shot transfer loss and substantially outweighs the language effect. Few-shot adaptation without a replay mechanism, though data-efficient, inflicts source task damage 4 to 9 times greater than that of the joint training strategies, and its damage magnitude is highly unstable. The three joint training strategies trade 3.2 to 4.1 percentage points of source-task performance for 8.1 to 42.6 percentage points of multilingual capability gain, forming a clear and controllable Pareto trade-off.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
16 of 26 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018Experience Replay for Continual Learningcited by 1,095
- 2019How multilingual is Multilingual BERT?cited by 645
- 2019How to Fine-Tune BERT for Text Classification?cited by 411
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 271
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 76
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
- 2024Language Models for Text Classification: Is In-Context Learning Enough?cited by 40
- 2020On Cross-Dataset Generalization in Automatic Detection of Online Abusecited by 20
4 more
- 2024An Investigation of Large Language Models for Real-World Hate Speech Detectioncited by 20
- 2022Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languagescited by 7
- 2026NLP-Based Review for Toxic Comment Detection Tailored to the Chinese Cyberspacecited by 3
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Datacited by 2
Built on by
Not cited yet.