mlsanityData to 7 Oct 2026

ToVo: Toxicity Taxonomy via Voting

arXiv 2406.14835 ↗First posted 21 Jun 2024cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing toxic detection models face significant limitations, such as lack of transparency, customization, and reproducibility. These challenges stem from the closed-source nature of their training data and the paucity of explanations for their evaluation mechanism. To address these issues, we propose a dataset creation mechanism that integrates voting and chain-of-thought processes, producing a high-quality open-source dataset for toxic content detection. Our methodology ensures diverse classification metrics for each sample and includes both classification scores and explanatory reasoning for the classifications. We utilize the dataset created through our proposed mechanism to train our model, which is then compared against existing widely-used detectors. Our approach not only enhances transparency and customizability but also facilitates better fine-tuning for specific use cases. This work contributes a robust framework for developing toxic content detection models, emphasizing openness and adaptability, thus paving the way for more effective and user-specific content moderation solutions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 21 Jun 2024.

Builds on

12 of 25 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  4. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  5. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  7. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  8. 2024Yi: Open Foundation Models by 01.AIcited by 706
  9. 2023Zephyr: Direct Distillation of LM Alignmentcited by 498
  10. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  11. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 206
  12. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ToxiREX: A Dataset on Toxic REasoning in ConteXt
  2. 2025Something Just Like TRuST : Toxicity Recognition of Span and Target
  3. 2025STEMTOX: From Collaborative Tags to Fine-Grained Toxic Meme Detection via Entropy-Guided Multi-Task Learning
  4. 2025SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models
  5. 2026Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed
  6. 2023Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models
  7. 2025Rethinking Toxicity Evaluation in Large Language Models: A Multi-Label Perspective
  8. 2025ShieldVLM: Safeguarding the Multimodal Implicit Toxicity via Deliberative Reasoning with LVLMs