SafeGen: Embedding Ethical Safeguards in Text-to-Image Generation
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Generative Artificial Intelligence (AI) has created unprecedented opportunities for creative expression, education, and research. Text-to-image systems such as DALL.E, Stable Diffusion, and Midjourney can now convert ideas into visuals within seconds, but they also present a dual-use dilemma, raising critical ethical concerns: amplifying societal biases, producing high-fidelity disinformation, and violating intellectual property. This paper introduces SafeGen, a framework that embeds ethical safeguards directly into the text-to-image generation pipeline, grounding its design in established principles for Trustworthy AI. SafeGen integrates two complementary components: BGE-M3, a fine-tuned text classifier that filters harmful or misleading prompts, and Hyper-SD, an optimized diffusion model that produces high fidelity, semantically aligned images. Built on a curated multilingual (English- Vietnamese) dataset and a fairness-aware training process, SafeGen demonstrates that creative freedom and ethical responsibility can be reconciled within a single workflow. Quantitative evaluations confirm its effectiveness, with Hyper-SD achieving IS = 3.52, FID = 22.08, and SSIM = 0.79, while BGE-M3 reaches an F1-Score of 0.81. An ablation study further validates the importance of domain-specific fine-tuning for both modules. Case studies illustrate SafeGen's practical impact in blocking unsafe prompts, generating inclusive teaching materials, and reinforcing academic integrity.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 16 of its 27 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
16 of 27 references.
Closest ancestors · 2
Same direction, newest first
- 2024SafeGen: Mitigating Sexually Explicit Content Generation in Text-to-Image Models10 Apr
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov
Other references · 14
- 2017Attention Is All You Needcited by 60,106
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,916
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,910
- 2018Datasheets for Datasetscited by 1,377
- 2018Model Cards for Model Reportingcited by 1,076
- 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 177
- 2023Typology of Risks of Generative Text-to-Image Modelscited by 55
- 2022A Trade-off-centered Framework of Content Moderationcited by 11
- 2025Imagining the Far East: Exploring Perceived Biases in AI-Generated Images of East Asian Womencited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?
- 2024Safe Text-to-Image Generation: Simply Sanitize the Prompt Embedding
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review
- 2025PurifyGen: A Risk-Discrimination and Semantic-Purification Model for Safe Text-to-Image Generation
- 2026SafeGen-Bench: Benchmarking Safety in Image-Conditioned Text-to-Video Generation
- 2025Detect-and-Guide: Self-regulation of Diffusion Models for Safe Text-to-Image Generation via Guideline Token Optimization
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?
- 2024Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models