SD3.5-Flash: Distribution-Guided Distillation of Generative Flows
Not on the map. Why?
Abstract (arXiv)
We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated distribution matching objective tailored specifically for few-step generation. We introduce two key innovations: "timestep sharing" to reduce gradient noise and "split-timestep fine-tuning" to improve prompt alignment. Combined with comprehensive pipeline optimizations like text encoder restructuring and specialized quantization, our system enables both rapid generation and memory-efficient deployment across different hardware configurations. This democratizes access across the full spectrum of devices, from mobile phones to desktop computers. Through extensive evaluation including large-scale user studies, we demonstrate that SD3.5-Flash consistently outperforms existing few-step methods, making advanced generative AI truly accessible for practical deployment.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 49 of its 55 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
49 of 55 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
37 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Consistency Modelscited by 1,822
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Adversarial Diffusion Distillationcited by 759
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 141
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 87
- 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teachercited by 45
- 2024LinFusion: 1 GPU, 1 Minute, 16K Imagecited by 43
- 2023MobileDiffusion: Instant Text-to-Image Generation on Mobile Devicescited by 42
- 2024Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillationcited by 37
- 2024NitroFusion: High-Fidelity Single-Step Diffusion through Dynamic Adversarial Trainingcited by 17
- 2023Squeezing Large-Scale Diffusion Models for Mobilecited by 11
- 2024Diffusion Model Patching via Mixture-of-Promptscited by 11
- 2025Scale-wise Distillation of Diffusion Modelscited by 11
Built on by
Citing papers per year: 2025: 2; 2026: 9.
11 papers.
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 10
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
- 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillationcited by 4
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devicescited by 3
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Imagescited by 2
- 2026Cross-Resolution Distribution Matching for Diffusion Distillationcited by 1
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generationcited by 1
- 2025Q-REAL: Towards Realism and Plausibility Evaluation for AI-Generated Contentcited by 0
- 2026Few-Shot Distribution-Aligned Flow Matching for Data Synthesis in Medical Image Segmentationcited by 0
- 2026ProgressNet: Sketching and Prompting with a Frozen Text-to-Image Modelcited by 0
- 2026ProgressNet: Sketching and Prompting with a Frozen Text-to-Image Model2 Oct 2026
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation13 Aug 2026
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generation29 Apr 2026
- 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillation5 Apr 2026
- 2026Few-Shot Distribution-Aligned Flow Matching for Data Synthesis in Medical Image Segmentation3 Apr 2026
- 2026Cross-Resolution Distribution Matching for Diffusion Distillation6 Mar 2026
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Acceleration3 Mar 2026
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Images27 Feb 2026
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devices13 Jan 2026
- 2025Q-REAL: Towards Realism and Plausibility Evaluation for AI-Generated Content21 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Flash-DMD: Towards High-Fidelity Few-Step Image Generation with Efficient Distillation and Joint Reinforcement Learning
- 2026DanceOPD: On-Policy Generative Field Distillation
- 2024EdgeFusion: On-Device Text-to-Image Generation
- 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing
- 2025BLIP3o-NEXT: Next Frontier of Native Image Generation
- 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation
- 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
- 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications