mlsanityData to 7 Oct 2026

System Report for CCL25-Eval Task 10: Prompt-Driven Large Language Model Merge for Fine-Grained Chinese Hate Speech Detection

arXiv 2512.09563 ↗First posted 10 Dec 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of hate speech on Chinese social media poses urgent societal risks, yet traditional systems struggle to decode context-dependent rhetorical strategies and evolving slang. To bridge this gap, we propose a novel three-stage LLM-based framework: Prompt Engineering, Supervised Fine-tuning, and LLM Merging. First, context-aware prompts are designed to guide LLMs in extracting implicit hate patterns. Next, task-specific features are integrated during supervised fine-tuning to enhance domain adaptation. Finally, merging fine-tuned LLMs improves robustness against out-of-distribution cases. Evaluations on the STATE-ToxiCN benchmark validate the framework's effectiveness, demonstrating superior performance over baseline methods in detecting fine-grained hate speech.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

14 of 20 references.

References · 14

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  4. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  5. 2021Merging Models with Fisher-Weighted Averagingcited by 613
  6. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
  7. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
  8. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
  9. 2023Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Maskscited by 130
  10. 2020Toxicity Detection: Does Context Really Matter?cited by 93
  11. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  12. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
2 more
  1. 2018Leveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech Detectioncited by 25
  2. 2025STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detectioncited by 9

Built on by

Not cited yet.