mlsanityData to 14 Oct 2026

SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models

arXiv 2509.15174 ↗First posted 18 Sep 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation using Large Language Models (LLMs). In Stage 1, we leverage LLMs' own outputs to generate synthetic explanations for both correct and incorrect labels, enabling alignment via preference optimization with minimal human supervision. In Stage 2, we refine explanation quality through cross-model training, allowing weaker models to align stylistically and semantically with stronger ones. Experiments on three benchmark tasks -- HateXplain, Latent Hate, and Implicit Hate -- demonstrate that SMARTER enables LLMs to achieve up to a 13% macro-F1 improvement over standard few-shot baselines while using only a fraction of the full training data. Our framework offers a scalable strategy for low-resource settings by harnessing LLMs' self-improving capabilities for both classification and explanation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 78 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

43 of 78 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  10. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  11. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  12. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
31 more
  1. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  2. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  3. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  4. 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 264
  5. 2023Large Language Model Alignment: A Surveycited by 243
  6. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  7. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
  8. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
  9. 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 108
  10. 2025Self-Adapting Language Modelscited by 84
  11. 2024LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Modelscited by 70
  12. 2022Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderationcited by 67
  13. 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 62
  14. 2023Probing LLMs for hate speech detection: strengths and vulnerabilitiescited by 52
  15. 2024Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Modelscited by 45
  16. 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 41
  17. 2021FBERT: A Neural Transformer for Identifying Offensive Contentcited by 30
  18. 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
  19. 2024Linear Probe Penalties Reduce LLM Sycophancycited by 28
  20. 2024Hate Personified: Investigating the role of LLMs in content moderationcited by 25
  21. 2024An Investigation of Large Language Models for Real-World Hate Speech Detectioncited by 20
  22. 2024Towards Building a Robust Toxicity Predictorcited by 14
  23. 2025Refining Input Guardrails: Enhancing LLM-as-a-Judge Efficiency Through Chain-of-Thought Fine-Tuning and Alignmentcited by 14
  24. 2023Toxicity Detection is NOT all you Need: Measuring the Gaps to Supporting Volunteer Content Moderatorscited by 10
  25. 2024"Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definitioncited by 7
  26. 2024A Comprehensive Study on NLP Data Augmentation for Hate Speech Detection: Legacy Methods, BERT, and LLMscited by 7
  27. 2024Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Fastercited by 7
  28. 2023Towards Conceptualization of "Fair Explanation": Disparate Impacts of anti-Asian Hate Speech Explanations on Content Moderatorscited by 6
  29. 2024HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Modelscited by 5
  30. 2024Label-aware Hard Negative Sampling Strategies with Momentum Contrastive Learning for Implicit Hate Speech Detectioncited by 4
  31. 2025MorphNLI: A Stepwise Approach to Natural Language Inference Using Text Morphingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LLM-based Semantic Augmentation for Harmful Content Detection
  2. 2025Something Just Like TRuST : Toxicity Recognition of Span and Target
  3. 2025Rethinking Toxicity Evaluation in Large Language Models: A Multi-Label Perspective
  4. 2025Towards Safer Pretraining: Analyzing and Filtering Harmful Content in Webscale datasets for Responsible LLMs
  5. 2024Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes
  6. 2025MemeArena: Automating Context-Aware Unbiased Evaluation of Harmfulness Understanding for Multimodal Large Language Models
  7. 2025Beyond One-Size-Fits-All: Personalized Harmful Content Detection with In-Context Learning
  8. 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information