Safety-Guided Flow (SGF): A Unified Framework for Negative Guidance in Safe Generation
Not on the map. Why?
Abstract (arXiv)
Safety mechanisms for diffusion and flow models have recently been developed along two distinct paths. In robot planning, control barrier functions are employed to guide generative trajectories away from obstacles at every denoising step by explicitly imposing geometric constraints. In parallel, recent data-driven, negative guidance approaches have been shown to suppress harmful content and promote diversity in generated samples. However, they rely on heuristics without clearly stating when safety guidance is actually necessary. In this paper, we first introduce a unified probabilistic framework using a Maximum Mean Discrepancy (MMD) potential for image generation tasks that recasts both Shielded Diffusion and Safe Denoiser as instances of our energy-based negative guidance against unsafe data samples. Furthermore, we leverage control-barrier functions analysis to justify the existence of a critical time window in which negative guidance must be strong; outside of this window, the guidance should decay to zero to ensure safe and high-quality generation. We evaluate our unified framework on several realistic safe generation scenarios, confirming that negative guidance should be applied in the early stages of the denoising process for successful safe generation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
32 of 42 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2023Erasing Concepts from Diffusion Modelscited by 530
20 more
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2024Flow Matching Guide and Codecited by 291
- 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?cited by 239
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
- 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 184
- 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
- 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmaskingcited by 128
- 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 125
- 2024Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Modelscited by 123
- 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 115
- 2023SafeDiffuser: Safe Planning with Diffusion Probabilistic Modelscited by 69
- 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 65
- 2025KLASS: KL-Guided Fast Inference in Masked Diffusion Modelscited by 44
- 2025Plan for Speed: Dilated Scheduling for Masked Diffusion Language Modelscited by 34
- 2024Shielded Diffusion: Generating Novel and Diverse Images using Sparse Repellencycited by 21
- 2025Training-Free Safe Denoisers for Safe Use of Diffusion Modelscited by 19
- 2025Greed is Good: A Unifying Perspective on Guided Generationcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Motion Concept Unlearning in Video Diffusion Models29 Sep 2026
- 2026Safe Few-Step Generation via Velocity Editing22 Jun 2026
- 2026The Safety-Aware Denoiser for Text Diffusion Models28 Apr 2026
- 2026Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models2 Apr 2026