Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement
Not on the map. Why?
Abstract (arXiv)
Phonetic Cloaking Replacement (PCR), defined as the deliberate use of homophonic or near-homophonic variants to hide toxic intent, has become a major obstacle to Chinese content moderation. While this problem is well-recognized, existing evaluations predominantly rely on rule-based, synthetic perturbations that ignore the creativity of real users. We organize PCR into a four-way surface-form taxonomy and compile ours, a dataset of 500 naturally occurring, phonetically cloaked offensive posts gathered from the RedNote platform. Benchmarking state-of-the-art LLMs on this dataset exposes a serious weakness: the best model reaches only an F1-score of 0.672, and zero-shot chain-of-thought prompting pushes performance even lower. Guided by error analysis, we revisit a Pinyin-based prompting strategy that earlier studies judged ineffective and show that it recovers much of the lost accuracy. This study offers the first comprehensive taxonomy of Chinese PCR, a realistic benchmark that reveals current detectors' limits, and a lightweight mitigation technique that advances research on robust toxicity detection.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
15 of 45 references.
References · 15
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2023Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarkscited by 45
- 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
- 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
- 2024ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbationscited by 30
- 2023Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuningcited by 28
- 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
- 2024Detecting Conversational Mental Manipulation with Intent-Aware Promptingcited by 16
- 2022Automated Content Moderation Increases Adherence to Community Guidelinescited by 10
- 2025Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findingscited by 10
3 more
- 2025STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detectioncited by 9
- 2024Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detectioncited by 5
- 2025Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexiconcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2026CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patternscited by 5
- 2025ToxiFrench: Benchmarking and Enhancing Language Models via CoT Fine-Tuning for French Toxicity Detectioncited by 3
- 2026Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Languagecited by 2
- 2026Harder to Defend: Towards Chinese Toxicity Attacks via Implicit Enhancement and Obfuscation Rewritingcited by 0
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasioncited by 0
- 2026SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialoguecited by 0
- 2026ReCAST: Restoration-aware Cascaded Stage-wise Training for Obfuscated SMS Risk Classificationcited by 0
- 2026SinoGlyphBench: A Diagnostic Benchmark for Chinese Glyph-Level Obfuscation in Language-Model Moderationcited by 0
- 2026RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigationcited by 0
- 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessmentcited by 0
- 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment17 Sep 2026
- 2026RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation15 Sep 2026
- 2026SinoGlyphBench: A Diagnostic Benchmark for Chinese Glyph-Level Obfuscation in Language-Model Moderation5 Sep 2026
- 2026ReCAST: Restoration-aware Cascaded Stage-wise Training for Obfuscated SMS Risk Classification4 Sep 2026
- 2026SDARE-Bench: Evaluating Large Language Models on Conversational Stigma Detection and Response in Dyadic and Group Dialogue1 Sep 2026
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion28 Aug 2026
- 2026Harder to Defend: Towards Chinese Toxicity Attacks via Implicit Enhancement and Obfuscation Rewriting21 May 2026
- 2026Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Language17 Apr 2026
- 2026CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns2 Jan 2026
- 2025ToxiFrench: Benchmarking and Enhancing Language Models via CoT Fine-Tuning for French Toxicity Detection15 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Chinese Toxic Language Mitigation via Sentiment Polarity Consistent Rewrites
- 2026Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
- 2026VARM-Bench: Benchmarking Verifiable Structured Reasoning in Chinese Abusive Speech Moderation
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models
- 2025Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek
- 2026SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning
- 2025MMBERT: Scaled Mixture-of-Experts Multimodal BERT for Robust Chinese Hate Speech Detection under Cloaking Perturbations