Few-Step Distillation for Text-to-Image Generation: A Practical Guide
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion distillation has dramatically accelerated class-conditional image synthesis, but its applicability to open-ended text-to-image (T2I) generation is still unclear. We present the first systematic study that adapts and compares state-of-the-art distillation techniques on a strong T2I teacher model, FLUX.1-lite. By casting existing methods into a unified framework, we identify the key obstacles that arise when moving from discrete class labels to free-form language prompts. Beyond a thorough methodological analysis, we offer practical guidelines on input scaling, network architecture, and hyperparameters, accompanied by an open-source implementation and pretrained student models. Our findings establish a solid foundation for deploying fast, high-fidelity, and resource-efficient diffusion generators in real-world T2I applications. Code is available on github.com/alibaba-damo-academy/T2I-Distill.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 17 of its 21 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
17 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation12 Mar
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
Other references · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023Consistency Modelscited by 1,778
- 2025Qwen-Image Technical Reportcited by 973
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
2 more
- 2025Inductive Moment Matchingcited by 107
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 23
- 2026Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Compositioncited by 3
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 2
- 2026K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modelingcited by 1
- 2026Safe Few-Step Generation via Velocity Editingcited by 0
- 2026Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition1 Jul 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
- 2026Safe Few-Step Generation via Velocity Editing22 Jun 2026
- 2026K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling9 Jun 2026
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigm4 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Few-Step Diffusion via Score identity Distillation
- 2025DiT-Air: Revisiting the Efficiency of Diffusion Model Architecture Design in Text to Image Generation
- 2023KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
- 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generation
- 2023DiffBlender: Composable and Versatile Multimodal Text-to-Image Diffusion Models
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation