mlsanityData to 14 Oct 2026

Value-Aligned Prompt Moderation via Zero-Shot Agentic Rewriting for Safe Image Generation

arXiv 2511.11693 ↗First posted 12 Nov 2025cs.AI cs.CR cs.CVcited by 2

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

also in 3 more
Abstract (arXiv)

Generative vision-language models like Stable Diffusion demonstrate remarkable capabilities in creative media synthesis, but they also pose substantial risks of producing unsafe, offensive, or culturally inappropriate content when prompted adversarially. Current defenses struggle to align outputs with human values without sacrificing generation quality or incurring high costs. To address these challenges, we introduce VALOR (Value-Aligned LLM-Overseen Rewriter), a modular, zero-shot agentic framework for safer and more helpful text-to-image generation. VALOR integrates layered prompt analysis with human-aligned value reasoning: a multi-level NSFW detector filters lexical and semantic risks; a cultural value alignment module identifies violations of social norms, legality, and representational ethics; and an intention disambiguator detects subtle or indirect unsafe implications. When unsafe content is detected, prompts are selectively rewritten by a large language model under dynamic, role-specific instructions designed to preserve user intent while enforcing alignment. If the generated image still fails a safety check, VALOR optionally performs a stylistic regeneration to steer the output toward a safer visual domain without altering core semantics. Experiments across adversarial, ambiguous, and value-sensitive prompts show that VALOR significantly reduces unsafe outputs by up to 100.00% while preserving prompt usefulness and creativity. These results highlight VALOR as a scalable and effective approach for deploying safe, aligned, and helpful image generation systems in open-world settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 34 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

20 of 34 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  8. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  9. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
  10. 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?cited by 250
  11. 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 194
  12. 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 189
8 more
  1. 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 184
  2. 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 155
  3. 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 133
  4. 2023Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Eraserscited by 120
  5. 2024Jailbreaking Prompt Attack: A Controllable Adversarial Attack against Diffusion Modelscited by 72
  6. 2024GuardT2I: Defending Text-to-Image Models from Adversarial Promptscited by 62
  7. 2024ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruningcited by 55
  8. 2024On the Multi-modal Vulnerability of Diffusion Modelscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Embedding an Ethical Mind: Aligning Text-to-Image Synthesis via Lightweight Value Optimization
  2. 2025YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
  3. 2025CritiFusion: Semantic Critique and Spectral Alignment for Faithful Text-to-Image Generation
  4. 2025PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models
  5. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting
  6. 2025Personalized Safety Alignment for Text-to-Image Diffusion Models
  7. 2025Prompt-Based Safety Guidance Is Ineffective for Unlearned Text-to-Image Diffusion Models
  8. 2025Guiding What Not to Generate: Automated Negative Prompting for Text-Image Alignment