Qwen-Image-Flash: Rethinking the Training Recipe for Few-Step Distillation
Not on the map. Why?
Abstract (arXiv)
Few-step distillation has emerged as a critical component in the development of advanced visual generative foundation models, substantially reducing inference overhead while enabling real-time generation and cost-efficient deployment across a broad range of practical scenarios. However, prior work has predominantly focused on advancing training objectives, while comparatively overlooking the training recipe, which has become increasingly critical in the era of large-scale foundation models. In this work, we systematically revisit the training recipe under the well-established distribution matching distillation (DMD) framework for both text-to-image generation and image editing, focusing on three key dimensions: training data composition, teacher guidance within DMD, and task mixture. Our empirical analysis reveals several non-obvious and counterintuitive phenomena, ultimately motivating the development of Qwen-Image-Flash. These findings highlight that effective few-step distillation depends not only on carefully designed objectives, but also on a principled training recipe.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
32 of 37 references.
References · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023Consistency Modelscited by 1,822
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
20 more
- 2023Adversarial Diffusion Distillationcited by 759
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2026MiMo-V2-Flash Technical Reportcited by 191
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 45
- 2023MobileDiffusion: Instant Text-to-Image Generation on Mobile Devicescited by 42
- 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 40
- 2026Qwen-Image-2.0 Technical Reportcited by 36
- 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 34
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 22
- 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesiscited by 20
- 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligencecited by 16
- 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editingcited by 14
- 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generationcited by 12
- 2026Optimizing Few-Step Generation with Adaptive Matching Distillationcited by 11
- 2026TDM-R1: Reinforcing Few-Step Diffusion Models with Non-Differentiable Rewardcited by 7
- 2026ERNIE-Image Technical Reportcited by 6
Built on by
Not cited yet.