Text Detoxification as Style Transfer in English and Hindi
Not on the map. Why?
Abstract (arXiv)
This paper focuses on text detoxification, i.e., automatically converting toxic text into non-toxic text. This task contributes to safer and more respectful online communication and can be considered a Text Style Transfer (TST) task, where the text style changes while its content is preserved. We present three approaches: knowledge transfer from a similar task, multi-task learning approach, combining sequence-to-sequence modeling with various toxicity classification tasks, and delete and reconstruct approach. To support our research, we utilize a dataset provided by Dementieva et al.(2021), which contains multiple versions of detoxified texts corresponding to toxic texts. In our experiments, we selected the best variants through expert human annotators, creating a dataset where each toxic sentence is paired with a single, appropriate detoxified version. Additionally, we introduced a small Hindi parallel dataset, aligning with a part of the English dataset, suitable for evaluation purposes. Our results demonstrate that our approach effectively balances text detoxication while preserving the actual content and maintaining fluency.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 21 of its 50 references that are in the map. First posted on arXiv 12 Feb 2024.
Builds on
21 of 50 references.
References · 21
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2020Language-agnostic BERT Sentence Embeddingcited by 621
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2017Toward Controlled Generation of Textcited by 271
- 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
- 2017Why We Need New Evaluation Metrics for NLGcited by 232
- 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
- 2017Style Transfer in Text: Exploration and Evaluationcited by 145
9 more
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2018Style Transfer Through Back-Translationcited by 124
- 2019Evaluating Style Transfer for Textcited by 59
- 2017Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Modelscited by 57
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2023SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)cited by 52
- 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
- 2021The ComMA Dataset V0.2: Annotating Aggression and Bias in Multilingual Social Media Discoursecited by 4
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 2.
11 papers.
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfercited by 24
- 2024Are Large Language Models Actually Good at Text Style Transfer?cited by 13
- 2024Multilingual Text Style Transfer: Datasets & Models for Indian Languagescited by 9
- 2024Text Style Transfer: An Introductory Overviewcited by 5
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfercited by 5
- 2025Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics?cited by 4
- 2025Breaking mBad! Supervised Fine-tuning for Cross-Lingual Detoxificationcited by 3
- 2025Evaluating Text Style Transfer: A Nine-Language Benchmark for Text Detoxificationcited by 2
- 2025BanglaNirTox: A Large-scale Parallel Corpus for Explainable AI in Bengali Text Detoxificationcited by 1
- 2026Text Detoxification in isiXhosa and Yor`ub'a: A Cross-Lingual Machine Learning Approach for Low-Resource African Languagescited by 0
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Modelscited by 0
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models24 Jun 2026
- 2026Text Detoxification in isiXhosa and Yor`ub'a: A Cross-Lingual Machine Learning Approach for Low-Resource African Languages9 Jan 2026
- 2025BanglaNirTox: A Large-scale Parallel Corpus for Explainable AI in Bengali Text Detoxification3 Nov 2025
- 2025Evaluating Text Style Transfer: A Nine-Language Benchmark for Text Detoxification21 Jul 2025
- 2025Breaking mBad! Supervised Fine-tuning for Cross-Lingual Detoxification22 May 2025
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfer1 May 2025
- 2025Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics?7 Feb 2025
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfer1 Oct 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024Are Large Language Models Actually Good at Text Style Transfer?9 Jun 2024
- 2024Multilingual Text Style Transfer: Datasets & Models for Indian Languages31 May 2024