ConceptGuard: Proactive Safety in Text-and-Image-to-Video Generation through Multimodal Risk Detection
Not on the map. Why?
Abstract (arXiv)
Recent progress in video generative models has enabled the creation of high-quality videos from multimodal prompts that combine text and images. While these systems offer enhanced controllability, they also introduce new safety risks, as harmful content can emerge from individual modalities or their interaction. Existing safety methods are often text-only, require prior knowledge of the risk category, or operate as post-generation auditors, struggling to proactively mitigate such compositional, multimodal risks. To address this challenge, we present ConceptGuard, a unified safeguard framework for proactively detecting and mitigating unsafe semantics in multimodal video generation. ConceptGuard operates in two stages: First, a contrastive detection module identifies latent safety risks by projecting fused image-text inputs into a structured concept space; Second, a semantic suppression mechanism steers the generative process away from unsafe concepts by intervening in the prompt's multimodal conditioning. To support the development and rigorous evaluation of this framework, we introduce two novel benchmarks: ConceptRisk, a large-scale dataset for training on multimodal risks, and T2VSafetyBench-TI2V, the first benchmark adapted from T2VSafetyBench for the Text-and-Image-to-Video (TI2V) safety setting. Comprehensive experiments on both benchmarks show that ConceptGuard consistently outperforms existing baselines, achieving state-of-the-art results in both risk detection and safe video generation. Our code is available at https://github.com/Ruize-Ma/ConceptGuard.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Modelscited by 7
- 2026VPA-Guard: Defending and Benchmarking Image-to-Video Generation Against Visual Prompt Attackscited by 1
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generationcited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalitiescited by 0
- 2026Motion Concept Unlearning in Video Diffusion Modelscited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026Motion Concept Unlearning in Video Diffusion Models29 Sep 2026
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generation27 Aug 2026
- 2026VPA-Guard: Defending and Benchmarking Image-to-Video Generation Against Visual Prompt Attacks24 Jun 2026
- 2026VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models24 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025ProGuard: Towards Proactive Multimodal Safeguard
- 2025From Evaluation to Defense: Advancing Safety in Video Large Language Models
- 2026SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation
- 2026When Safe Concepts Become Unsafe: Multi-Concept Compositional Vulnerabilities in Text-to-Image Models
- 2026When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm
- 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models
- 2026SafeCtrl: Region-Aware Safety Control for Text-to-Image Diffusion via Detect-Then-Suppress
- 2025RedDiffuser: Auditing Multimodal Safety Failures in Vision-Language Models via Reinforced Diffusion