mlsanityData to 7 Oct 2026

OmniGuard: Unified Omni-Modal Guardrails with Deliberate Reasoning

arXiv 2512.02306 ↗First posted 2 Dec 2025cs.AI cs.CL cs.CRcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Omni-modal Large Language Models (OLLMs) that process text, images, videos, and audio introduce new challenges for safety and value guardrails in human-AI interaction. Prior guardrail research largely targets unimodal settings and typically frames safeguarding as binary classification, which limits robustness across diverse modalities and tasks. To address this gap, we propose OmniGuard, the first family of omni-modal guardrails that performs safeguarding across all modalities with deliberate reasoning ability. To support the training of OMNIGUARD, we curate a large, comprehensive omni-modal safety dataset comprising over 210K diverse samples, with inputs that cover all modalities through both unimodal and cross-modal samples. Each sample is annotated with structured safety labels and carefully curated safety critiques from expert models through targeted distillation. Extensive experiments on 15 benchmarks show that OmniGuard achieves strong effectiveness and generalization across a wide range of multimodal safety scenarios. Importantly, OmniGuard provides a unified framework that enforces policies and mitigates risks in omni-modalities, paving the way toward building more robust and capable omnimodal safeguarding systems.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 31 of its 78 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

31 of 78 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable1 Mar

Other references · 30

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024Qwen2.5 Technical Reportcited by 4,713
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  12. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
18 more
  1. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  2. 2025Qwen2.5-Omni Technical Reportcited by 704
  3. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  4. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  5. 2024Qwen2-Audio Technical Reportcited by 543
  6. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  7. 2025Kimi-Audio Technical Reportcited by 210
  8. 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
  9. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
  10. 2025Ola: Pushing the Frontiers of Omni-Modal Language Modelcited by 79
  11. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  12. 2024UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Imagescited by 52
  13. 2024Fish-Speech: Leveraging Large Language Models for Advanced Multilingual Text-to-Speech Synthesiscited by 45
  14. 2024Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Modelscited by 28
  15. 2025Video-SafetyBench: A Benchmark for Safety Evaluation of Video LVLMscited by 25
  16. 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 19
  17. 2025The Man Behind the Sound: Demystifying Audio Private Attribute Profiling via Multimodal Large Language Model Agentscited by 5
  18. 2025Is Extending Modality The Right Path Towards Omni-Modality?cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MCBench: A Multicontext Safety Assessment Benchmark for Omni Large Language Models
  2. 2026Do Safety Guardrails Need to Reason? LeanGuard: A Fast and Light Approach for Robust Moderation
  3. 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanations
  4. 2026Nemotron 3.5 Content Safety Moderator: A Compact Multimodal, Multilingual, and Reasoning Enabled Content Safety Moderator
  5. 2026SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning
  6. 2025OMNIGUARD: An Efficient Approach for AI Safety Moderation Across Languages and Modalities
  7. 2026Omni-Safety under Cross-Modality Conflict: Vulnerabilities, Dynamics Mechanisms and Efficient Alignment
  8. 2026Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures