DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderation
Not on the map. Why?
Abstract (arXiv)
Automated toxicity moderation systems operate in dynamic online environments where harmful behavior evolves through coded language, shifting targets, and strategic adaptation to enforcement. Existing drift detection methods often focus on global distributional change, but such signals may miss safety-relevant shifts that emerge in localized harm subspaces or high-risk model-error regions. This paper introduces DriftGuard, a safety-aware adaptive moderation framework that combines multi-monitor drift detection with selective model updating. The framework tracks global text drift, identity-harm drift, model uncertainty, toxic-risk drift, and false-negative-risk drift. When safety-relevant change is detected, the model is updated using a hard-mix adaptation set that prioritizes likely false negatives, identity-related high-risk examples, false-positive-risk examples, and uncertain boundary cases. Experiments on Civil Comments temporal shift and Jigsaw-to-DynaHate cross-dataset shift show that safety-aware monitors detect risks missed by global drift alone. Hard-mix adaptation improves toxic recall and accuracy over no-update and random-balanced baselines, raising toxic recall to 0.8777 on Civil Comments and from 0.7107 to 0.8523 on DynaHate. Bootstrap analysis further shows stable DynaHate safety gains, with toxic recall increasing by 0.1418 and false-negative prevalence decreasing by 0.0781. Overall, DriftGuard links safety-aware drift detection to targeted, lightweight model updating for more robust adaptive toxicity moderation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 41 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
33 of 41 references.
References · 33
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
- 2019Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classificationcited by 404
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 366
- 2018Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shiftcited by 243
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 209
- 2026TIP: Token Importance in On-Policy Distillationcited by 104
21 more
- 2020Toxicity Detection: Does Context Really Matter?cited by 93
- 2022From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectorscited by 83
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 54
- 2022A Survey of Active Learning for Natural Language Processingcited by 40
- 2025DRP: Distilled Reasoning Pruning with Skill-aware Step Decomposition for Efficient Large Reasoning Modelscited by 30
- 2026PACED: Distillation and On-Policy Self-Distillation at the Frontier of Student Competencecited by 28
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 27
- 2025GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuningcited by 21
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 17
- 2026Does RAG Know When Retrieval Is Wrong? Diagnosing Context Compliance under Knowledge Conflictcited by 15
- 2026Relevant Is Not Warranted: Evidence-Force Calibration for Cited RAGcited by 14
- 2024Beyond Math: Stories as a Testbed for Memorization-Constrained Reasoning in LLMscited by 12
- 2026Reflect-Guard: Enhancing LLM Safeguards against Adversarial Prompts via Logical Self-Reflectioncited by 12
- 2022A unified framework for dataset shift diagnosticscited by 7
- 2025FinSentLLM: Multi-LLM and Structured Semantic Signals for Enhanced Financial Sentiment Forecastingcited by 7
- 2022A monitoring framework for deployed machine learning models with supply chain examplescited by 5
- 2025MedEqualizer: A Framework Investigating Bias in Synthetic Medical Data and Mitigation via Augmentationcited by 3
- 2025NetSenseML: Network-Adaptive Compression for Efficient Distributed Machine Learningcited by 2
- 2026MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretrainingcited by 2
- 2026Perturbation Sensitivity of Maximum-Likelihood Pairwise Ranking in Computational Decision Systemscited by 2
- 2026Beyond Helpfulness: A Teaching-over-Solving Diagnostic for Measuring Educational Impact in LLM Tutorscited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Evidence-Unit Fairness and the Limits of Query-Adaptive Sparse-Dense Fusion in Financial Document Retrievalcited by 1
- 2026OptiAgent: End-to-End Optimization Modeling via Multi-Agent Iterative Refinementcited by 0
- 2026Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifierscited by 0
- 2026Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classificationcited by 0
- 2026Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification18 Aug 2026
- 2026Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifiers14 Aug 2026
- 2026Evidence-Unit Fairness and the Limits of Query-Adaptive Sparse-Dense Fusion in Financial Document Retrieval31 Jul 2026
- 2026OptiAgent: End-to-End Optimization Modeling via Multi-Agent Iterative Refinement6 Jul 2026