The Path to Reconciling Quality and Safety in Text-to-Image Generation: Dataset, Method, and Evaluation
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
also in 1 more
Abstract (arXiv)
Content safety is a fundamental challenge for text-to-image (T2I) models, yet prevailing methods enforce a debilitating trade-off between safety and generation quality. We argue that mitigating this trade-off hinges on addressing systemic challenges in current T2I safety alignment across data, methods, and evaluation protocols. To this end, we introduce a unified framework for synergistic safety alignment. First, to overcome the flawed data paradigm that provides biased optimization signals, we develop LibraAlign-100K, the first large-scale dataset with dual annotations for safety and quality. Second, to address the myopic optimization of existing methods focus solely on safety reward, we propose Synergistic Preference Optimization (T2I-SPO), a novel alignment algorithm that extends the DPO paradigm with a composite reward function that integrates generation safety and quality to holistically model user preferences. Finally, to overcome the limitations of quality-agnostic and binary evaluation in current protocols, we introduce the Unified Alignment Score, a holistic, fine-grained metric that fairly quantifies the balance between safety and generative capability. Extensive experiments demonstrate that T2I-SPO achieves state-of-the-art safety alignment against a wide range of NSFW concepts, while better maintaining the model's generation quality and general capability
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. First posted on arXiv 19 Apr 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024AlignGuard: Scalable Safety Alignment for Text-to-Image Generation
- 2025T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generation
- 2025YINYANG-ALIGN: Benchmarking Contradictory Objectives and Proposing Multi-Objective Optimization based DPO for Text-to-Image Alignment
- 2025SPQR: A Multi-Dimensional Benchmark for Safety Alignment under Benign Model Adaptation
- 2024Universal Prompt Optimizer for Safe Text-to-Image Generation
- 2026SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization
- 2025Personalized Safety Alignment for Text-to-Image Diffusion Models
- 2025Iterative Prompt Refinement for Safer Text-to-Image Generation