mlsanityData to 14 Oct 2026

Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directions

arXiv 2509.25539 ↗First posted 29 Sep 2025cs.CY cs.AI cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

The evolution of digital communication systems and the designs of online platforms have inadvertently facilitated the subconscious propagation of toxic behavior. Giving rise to reactive responses to toxic behavior. Toxicity in online content and Artificial Intelligence Systems has become a serious challenge to individual and collective well-being around the world. It is more detrimental to society than we realize. Toxicity, expressed in language, image, and video, can be interpreted in various ways depending on the context of usage. Therefore, a comprehensive taxonomy is crucial to detect and mitigate toxicity in online content, Artificial Intelligence systems, and/or Large Language Models in a proactive manner. A comprehensive understanding of toxicity is likely to facilitate the design of practical solutions for toxicity detection and mitigation. The classification in published literature has focused on only a limited number of aspects of this very complex issue, with a pattern of reactive strategies in response to toxicity. This survey attempts to generate a comprehensive taxonomy of toxicity from various perspectives. It presents a holistic approach to explain the toxicity by understanding the context and environment that society is facing in the Artificial Intelligence era. This survey summarizes the toxicity-related datasets and research on toxicity detection and mitigation for Large Language Models, social media platforms, and other online platforms, detailing their attributes in textual mode, focused on the English language. Finally, we suggest the research gaps in toxicity mitigation based on datasets, mitigation strategies, Large Language Models, adaptability, explainability, and evaluation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 112 of its 243 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

112 of 243 references.

References · 112

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  7. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  8. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  9. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  10. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  11. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  12. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
38 more
  1. 2019Defending Against Neural Fake Newscited by 559
  2. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  3. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 422
  4. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  5. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  6. 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
  7. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  8. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
  9. 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
  10. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
  11. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
  12. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
  13. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  14. 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
  15. 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 194
  16. 2023Personality Traits in Large Language Modelscited by 169
  17. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 162
  18. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  19. 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 148
  20. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
  21. 2023Hallucinations in Large Multilingual Translation Modelscited by 129
  22. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Modelscited by 106
  23. 2023The science of fake newscited by 97
  24. 2024Detoxifying Large Language Models via Knowledge Editingcited by 87
  25. 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 82
  26. 2023Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detectioncited by 72
  27. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 70
  28. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
  29. 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 56
  30. 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
  31. 2023Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Modelscited by 56
  32. 2023Self-Guard: Empower the LLM to Safeguard Itselfcited by 54
  33. 2023Unveiling the Implicit Toxicity in Large Language Modelscited by 51
  34. 2024Measuring Implicit Bias in Explicitly Unbiased Large Language Modelscited by 51
  35. 2021Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hatecited by 50
  36. 2025T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generationcited by 48
  37. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  38. 2020Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspectivecited by 43

50 most cited of 112 All 112 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.