TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flows
Not on the map. Why?
Abstract (arXiv)
Recent advances in large multi-modal generative models have demonstrated impressive capabilities in multi-modal generation, including image and video generation. These models are typically built upon multi-step frameworks like diffusion and flow matching, which inherently limits their inference efficiency (requiring 40-100 Number of Function Evaluations (NFEs)). While various few-step methods aim to accelerate the inference, existing solutions have clear limitations. Prominent distillation-based methods, such as progressive and consistency distillation, either require an iterative distillation procedure or show significant degradation at very few steps (< 4-NFE). Meanwhile, integrating adversarial training into distillation (e.g., DMD/DMD2 and SANA-Sprint) to enhance performance introduces training instability, added complexity, and high GPU memory overhead due to the auxiliary trained models. To this end, we propose TwinFlow, a simple yet effective framework for training 1-step generative models that bypasses the need of fixed pretrained teacher models and avoids standard adversarial networks during training, making it ideal for building large-scale, efficient models. On text-to-image tasks, our method achieves a GenEval score of 0.83 in 1-NFE, outperforming strong baselines like SANA-Sprint (a GAN loss-based framework) and RCGM (a consistency-based framework). Notably, we demonstrate the scalability of TwinFlow by full-parameter training on Qwen-Image-20B and transform it into an efficient few-step generator. With just 1-NFE, our approach matches the performance of the original 100-NFE model on both the GenEval and DPG-Bench benchmarks, reducing computational cost by 100× with minor quality degradation. Project page is available at https://zhenglin-cheng.com/twinflow.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 60 of its 70 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
60 of 70 references.
References · 60
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Video Diffusion Modelscited by 2,280
- 2023Consistency Modelscited by 1,778
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
38 more
- 2025Qwen-Image Technical Reportcited by 973
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023Adversarial Diffusion Distillationcited by 741
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
- 2023Improved Techniques for Training Consistency Modelscited by 430
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 23
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 17
- 2026Elastic Diffusion Transformercited by 7
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 7
- 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillationcited by 4
- 2026Distribution Matching Distillation without Fake Score Networkcited by 4
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusioncited by 3
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 2
- 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
- 2026Budget-Constrained Step-Level Diffusion Cachingcited by 2
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generationcited by 1
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolutioncited by 1
5 more
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flowscited by 0
- 2026ReFPO: Reflow Regularization for Flow Matching Policy Gradientscited by 0
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generationcited by 0
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Modelscited by 0
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models28 Sep 2026
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul 2026
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation10 Jul 2026
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusion7 Jul 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
- 2026ReFPO: Reflow Regularization for Flow Matching Policy Gradients19 Jun 2026
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution15 Jun 2026
- 2026Budget-Constrained Step-Level Diffusion Caching11 Jun 2026
- 2026Distribution Matching Distillation without Fake Score Network19 May 2026
- 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillation7 May 2026
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models6 May 2026
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generation29 Apr 2026
5 more
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows21 Apr 2026
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigm4 Feb 2026
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 17
- 2026Elastic Diffusion Transformercited by 7
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 7
- 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillationcited by 4
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusioncited by 3
- 2026Budget-Constrained Step-Level Diffusion Cachingcited by 2
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generationcited by 1
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolutioncited by 1
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flowscited by 0
- 2026ReFPO: Reflow Regularization for Flow Matching Policy Gradientscited by 0
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul 2026
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusion7 Jul 2026
- 2026ReFPO: Reflow Regularization for Flow Matching Policy Gradients19 Jun 2026
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution15 Jun 2026
- 2026Budget-Constrained Step-Level Diffusion Caching11 Jun 2026
- 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillation7 May 2026
- 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models6 May 2026
- 2026AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generation29 Apr 2026
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows21 Apr 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026Distribution Matching Distillation without Fake Score Networkcited by 4
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigmcited by 2
- 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generationcited by 0
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Modelscited by 0
- 2026CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models28 Sep 2026
- 2026IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation10 Jul 2026
- 2026Distribution Matching Distillation without Fake Score Network19 May 2026
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2026Duality Models: An Embarrassingly Simple One-step Generation Paradigm4 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation
- 2025SoFlow: Solution Flow Models for One-Step Generative Modeling
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation
- 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis
- 2026Setting-Matched and Semantics-Scaled Benchmarking of One-Step Generative Models Against Multistep Diffusion and Flow Models
- 2026XYZFlow:Scaling Multi dimensional Shortcut Flows for Efficient Generative Modeling
- 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow
- 2025Phased One-Step Adversarial Equilibrium for Video Diffusion Models