FlexGuard: Continuous Risk Scoring for Strictness-Adaptive LLM Content Moderation
Not on the map. Why?
Abstract (arXiv)
Ensuring the safety of LLM-generated content is essential for real-world deployment. Most existing guardrail models formulate moderation as a fixed binary classification task, implicitly assuming a fixed definition of harmfulness. In practice, enforcement strictness - how conservatively harmfulness is defined and enforced - varies across platforms and evolves over time, making binary moderators brittle under shifting requirements. We first introduce FlexBench, a strictness-adaptive LLM moderation benchmark that enables controlled evaluation under multiple strictness regimes. Experiments on FlexBench reveal substantial cross-strictness inconsistency in existing moderators: models that perform well under one regime can degrade substantially under others, limiting their practical usability. To address this, we propose FlexGuard, an LLM-based moderator that outputs a calibrated continuous risk score reflecting risk severity and supports strictness-specific decisions via thresholding. We train FlexGuard via risk-alignment optimization to improve score-severity consistency and provide practical threshold selection strategies to adapt to target strictness at deployment. Experiments on FlexBench and public benchmarks demonstrate that FlexGuard achieves higher moderation accuracy and substantially improved robustness under varying strictness. We release the source code and data to support reproducibility.
Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 16 of its 113 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
16 of 113 references.
References · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,274
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,003
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 853
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 482
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 354
- 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 230
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 128
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 128
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 96
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
4 more
- 2025ShieldGemma 2: Robust and Tractable Image Content Moderationcited by 28
- 2025EvoLM: In Search of Lost Language Model Training Dynamicscited by 16
- 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 15
- 2025Safety Through Reasoning: An Empirical Study of Reasoning Guardrail Modelscited by 15
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026SafePyramid: A Hierarchical Benchmark for In-context Policy Guardrailingcited by 1
- 2026What Do Compliance Detectors Read? An Audit of Activation Probes and Guard Modelscited by 1
- 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agentscited by 0
- 2026Operational Evidence Gaps for LLMs in Fraud Detection and Trust-and-Safety Workflowscited by 0
- 2026No One Model Catches Every Harm: Benchmarking Content Moderation Across Safety Scenarioscited by 0
- 2026Evaluating Criterion-Conditioned Behaviour of Large Language Models in Content Moderationcited by 0
- 2026Beyond Accuracy and Surface Fluency: Risk-Sensitive Evaluation of LLMs for Legal Clause Generationcited by 0
- 2026Evaluating Criterion-Conditioned Behaviour of Large Language Models in Content Moderation3 Sep 2026
- 2026Beyond Accuracy and Surface Fluency: Risk-Sensitive Evaluation of LLMs for Legal Clause Generation22 Aug 2026
- 2026No One Model Catches Every Harm: Benchmarking Content Moderation Across Safety Scenarios22 Aug 2026
- 2026What Do Compliance Detectors Read? An Audit of Activation Probes and Guard Models17 Aug 2026
- 2026Operational Evidence Gaps for LLMs in Fraud Detection and Trust-and-Safety Workflows12 Jul 2026
- 2026SafePyramid: A Hierarchical Benchmark for In-context Policy Guardrailing29 Jun 2026
- 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agents10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Predict, Don't React: Value-Based Safety Forecasting for LLM Streaming
- 2026ProbGuard: Calibrated Safety Risk Estimation from LLM Output Distributions
- 2025Protect: Towards Robust Guardrailing Stack for Trustworthy Enterprise LLM Systems
- 2025Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets
- 2025Poly-Guard: Massive Multi-Domain Safety Policy-Grounded Guardrail Dataset
- 2026Triaging Threats to Specialized Guardrails
- 2026ExpGuard: LLM Content Moderation in Specialized Domains
- 2024On Calibration of LLM-based Guard Models for Reliable Content Moderation