mlsanityData to 7 Oct 2026

Cleansing the Artificial Mind: A Self-Reflective Detoxification Framework for Large Language Models

arXiv 2601.11776 ↗First posted 16 Jan 2026cs.CL cs.AIcited by 1

On the map: Synthetic data and self-improvement for LLMs → Self-rewarding alignment and self-training

Abstract (arXiv)

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely exploit these built-in abilities; instead, they rely on external modules, labor-intensive data annotation, or human intervention --factors that hinder scalability and consistency. In this paper, we introduce a fully self-reflective detoxification framework that harnesses the inherent capacities of LLMs to detect, correct toxic content, and refine LLMs without external modules and data annotation. Specifically, we propose a Toxic Signal Detector --an internal self-identification mechanism, coupled with a systematic intervention process to transform toxic text into its non-toxic counterpart. This iterative procedure yields a contrastive detoxification dataset used to fine-tune the model, enhancing its ability for safe and coherent text generation. Experiments on benchmark datasets such as DetoxLLM and ParaDetox show that our method achieves better detoxification performance than state-of-the-art methods while preserving semantic fidelity. By obviating the need for human intervention or external components, this paper reveals the intrinsic self-detoxification ability of LLMs, offering a consistent and effective approach for mitigating harmful content generation. Ultimately, our findings underscore the potential for truly self-regulated language models, paving the way for more responsible and ethically guided text generation systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Self-rewarding alignment and self-training, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 32 of its 43 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

32 of 43 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Self-Evolved Reward Learning for LLMs1 Nov
  2. 2024Self-Rewarding Language Models18 Jan

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2024A Survey on LLM-as-a-Judgecited by 1,384
  8. 2018Neural Network Acceptability Judgmentscited by 952
  9. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  10. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  11. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
  12. 2024A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicitycited by 179
18 more
  1. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  2. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  3. 2024Detoxifying Large Language Models via Knowledge Editingcited by 86
  4. 2019Beyond BLEU: Training Neural Machine Translation with Semantic Similaritycited by 84
  5. 2023Large Language Model-Aware In-Context Learning for Code Generationcited by 42
  6. 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 37
  7. 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
  8. 2024NLP for Counterspeech against Hate: A Survey and How-To Guidecited by 21
  9. 2024MedSyn: LLM-based Synthetic Medical Text Generation Frameworkcited by 19
  10. 2024Parameter-Efficient Detoxification with Contrastive Decodingcited by 18
  11. 2024Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIFcited by 13
  12. 2024DetoxLLM: A Framework for Detoxification with Explanationscited by 10
  13. 2024The Dark Side of Human Feedback: Poisoning Large Language Models via User Inputscited by 10
  14. 2024DESTEIN: Navigating Detoxification of Language Models via Universal Steering Pairs and Head-wise Activation Fusioncited by 9
  15. 2024A Survey On Enhancing Reinforcement Learning in Complex Environments: Insights from Human and LLM Feedbackcited by 9
  16. 2024Large Language Models can be Strong Self-Detoxifierscited by 7
  17. 2023CMD: a framework for Context-aware Model self-Detoxificationcited by 6
  18. 2024SeRA: Self-Reviewing and Alignment of Large Language Models using Implicit Reward Marginscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025<think> So let's replace this phrase with insult... </think> Lessons learned from generation of toxic texts with LLMs
  2. 2025Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization
  3. 2025Detoxifying Large Language Models via Autoregressive Reward Guided Representation Editing
  4. 2025GemDetox at TextDetox CLEF 2025: Enhancing a Massively Multilingual Model for Text Detoxification on Low-resource Languages
  5. 2022Reward Modeling for Mitigating Toxicity in Transformer-based Language Models
  6. 2023DiffuDetox: A Mixed Diffusion Model for Text Detoxification
  7. 2026Characterising Toxicity in Generative Large Language Models
  8. 2025BanglaNirTox: A Large-scale Parallel Corpus for Explainable AI in Bengali Text Detoxification