Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderator
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
Safety moderation for deployed AI applications is moving beyond text-only prompts: systems increasingly need to judge images, documents, screenshots, and generated responses under policies that vary across domains. Existing guardrails usually cover only part of this setting, making it difficult to combine broad coverage, custom policy control, and low compute cost. We present Nemotron 3.5 Content Safety Moderator, also referred to as Nemotron 3.5 CS in this paper for brevity, a compact 4B vision-language safety moderator that jointly classifies user prompts, images, and assistant responses across 12 languages. Nemotron 3.5 CS returns safety labels for latency-sensitive moderation and can additionally produce concise reasoning traces that apply supplied custom policies and identify violated categories when reasoning is requested. We also release a multimodal and multilingual safety dataset for guard training, spanning human-labeled real-image moderation, benign vision-language and document tasks, synthetic rare-risk and jailbreak cases, and custom-policy examples. Across evaluations spanning multimodal safety, text moderation, multilingual robustness, custom-policy following, benign false positives, and latency, Nemotron 3.5 CS demonstrates a practical coverage tradeoff: it adds image-conditioned and policy-conditioned moderation while remaining broadly competitive with specialized guard models. These results suggest that compact vision-language moderators can serve as deployable front-line safety components, with reasoning used selectively for audit and policy review.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 15 of its 34 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
15 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
- 2025Qwen3Guard Technical Reportcited by 155
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 70
- 2023All Languages Matter: On the Multilingual Safety of Large Language Modelscited by 53
- 2024Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirementscited by 36
- 2025DynaGuard: A Dynamic Guardian Model With User-Defined Policiescited by 19
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization
- 2026ShieldCLIP: Selective Safety Alignment for Harmful Content Mitigation in Multimodal Foundation Models
- 2025VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safety
- 2025ProGuard: Towards Proactive Multimodal Safeguard
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemma
- 2025OmniGuard: Unified Omni-Modal Guardrails with Deliberate Reasoning
- 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safety
- 2026Benchmarking Open-Source Safety Guard Models: A Comprehensive Evaluation