mlsanityData to 7 Oct 2026

Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement

arXiv 2507.07640 ↗First posted 10 Jul 2025cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Phonetic Cloaking Replacement (PCR), defined as the deliberate use of homophonic or near-homophonic variants to hide toxic intent, has become a major obstacle to Chinese content moderation. While this problem is well-recognized, existing evaluations predominantly rely on rule-based, synthetic perturbations that ignore the creativity of real users. We organize PCR into a four-way surface-form taxonomy and compile ours, a dataset of 500 naturally occurring, phonetically cloaked offensive posts gathered from the RedNote platform. Benchmarking state-of-the-art LLMs on this dataset exposes a serious weakness: the best model reaches only an F1-score of 0.672, and zero-shot chain-of-thought prompting pushes performance even lower. Guided by error analysis, we revisit a Pinyin-based prompting strategy that earlier studies judged ineffective and show that it recovers much of the lost accuracy. This study offers the first comprehensive taxonomy of Chinese PCR, a realistic benchmark that reveals current detectors' limits, and a lightweight mitigation technique that advances research on robust toxicity detection.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 10 Jul 2025.

Builds on

15 of 45 references.

References · 15

  1. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  2. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
  3. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  4. 2023Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarkscited by 45
  5. 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
  6. 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
  7. 2024ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbationscited by 30
  8. 2023Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuningcited by 28
  9. 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
  10. 2024Detecting Conversational Mental Manipulation with Intent-Aware Promptingcited by 16
  11. 2022Automated Content Moderation Increases Adherence to Community Guidelinescited by 10
  12. 2025Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findingscited by 10
3 more
  1. 2025STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detectioncited by 9
  2. 2024Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detectioncited by 5
  3. 2025Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexiconcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 9.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Chinese Toxic Language Mitigation via Sentiment Polarity Consistent Rewrites
  2. 2026Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese
  3. 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
  4. 2026VARM-Bench: Benchmarking Verifiable Structured Reasoning in Chinese Abusive Speech Moderation
  5. 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models
  6. 2025Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek
  7. 2026SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning
  8. 2025MMBERT: Scaled Mixture-of-Experts Multimodal BERT for Robust Chinese Hate Speech Detection under Cloaking Perturbations