IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
While large-scale text-to-image generative models have achieved unprecedented visual performance, their inherent reliance on multi-step iterative solvers incurs severe inference latency. Few-step distillation targeting the Classifier-Free Guidance (CFG) trajectory has emerged as the prevalent dual-dimensional compression paradigm. However, existing frameworks remain subjugated by a coarse-grained blind injection paradigm that perpetually enforces a globally static guidance strength while indiscriminately sampling the supervisor timestep. This state-agnostic design completely disregards the intrinsic nature of image generation as a dynamic evolutionary process characterized by progressive entropy reduction, which not only restricts the performance boundary of few-step compression but also precipitates severe CFG over-conditioning artifacts. To transcend these limitations, we re-examine the distillation procedure through the theoretical lens of Information Theory, formally modeling it as a dynamic mutual information game constrained by the Information Bottleneck (IB) principle. Specifically, we dismantle traditional blind assumptions via a dual-track adaptive framework. To determine the injection target, we propose an instance-aware selection mechanism that transmutes the intractable KL divergence constraint into a zero-overhead closed-form solution predicated on the local vector field norm. To regulate the injection strength, we introduce an entropy-aware schedule that dynamically decays alongside the SNR, applying maximal thrust for initial structural anchoring before smoothly reverting to the natural manifold to refine micro-details. Extensive empirical evaluations corroborate that our framework fundamentally eradicates over-conditioning artifacts, shattering the performance ceiling to achieve SOTA generative fidelity under extremely stringent 2-step configurations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
34 of 41 references.
References · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Video Diffusion Modelscited by 2,280
- 2023Consistency Modelscited by 1,778
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Qwen-Image Technical Reportcited by 973
22 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Adversarial Diffusion Distillationcited by 741
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2024Phased Consistency Modelscited by 83
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
- 2024Simple ReFlow: Improved Techniques for Fast Flow Modelscited by 34
- 2025STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesiscited by 31
- 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flowcited by 30
- 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 29
- 2025pi-Flow: Policy-Based Few-Step Generation via Imitation Distillationcited by 25
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
- 2026ArcFlow: Unleashing 2-Step Text-to-Image Generation via High-Precision Non-Linear Flow Distillationcited by 5
- 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
Built on by
Not cited yet.