mlsanityData to 7 Oct 2026

IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation

arXiv 2607.09133 ↗First posted 10 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

While large-scale text-to-image generative models have achieved unprecedented visual performance, their inherent reliance on multi-step iterative solvers incurs severe inference latency. Few-step distillation targeting the Classifier-Free Guidance (CFG) trajectory has emerged as the prevalent dual-dimensional compression paradigm. However, existing frameworks remain subjugated by a coarse-grained blind injection paradigm that perpetually enforces a globally static guidance strength while indiscriminately sampling the supervisor timestep. This state-agnostic design completely disregards the intrinsic nature of image generation as a dynamic evolutionary process characterized by progressive entropy reduction, which not only restricts the performance boundary of few-step compression but also precipitates severe CFG over-conditioning artifacts. To transcend these limitations, we re-examine the distillation procedure through the theoretical lens of Information Theory, formally modeling it as a dynamic mutual information game constrained by the Information Bottleneck (IB) principle. Specifically, we dismantle traditional blind assumptions via a dual-track adaptive framework. To determine the injection target, we propose an instance-aware selection mechanism that transmutes the intractable KL divergence constraint into a zero-overhead closed-form solution predicated on the local vector field norm. To regulate the injection strength, we introduce an entropy-aware schedule that dynamically decays alongside the SNR, applying maximal thrust for initial structural anchoring before smoothly reverting to the natural manifold to refine micro-details. Extensive empirical evaluations corroborate that our framework fundamentally eradicates over-conditioning artifacts, shattering the performance ceiling to achieve SOTA generative fidelity under extremely stringent 2-step configurations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

34 of 41 references.

References · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2022Video Diffusion Modelscited by 2,280
  10. 2023Consistency Modelscited by 1,778
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  12. 2025Qwen-Image Technical Reportcited by 973
22 more
  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  2. 2023Adversarial Diffusion Distillationcited by 741
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  4. 2025Mean Flows for One-step Generative Modelingcited by 524
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  6. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  7. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 344
  8. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  9. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  10. 2024Phased Consistency Modelscited by 83
  11. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
  12. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
  13. 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
  14. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
  15. 2024Simple ReFlow: Improved Techniques for Fast Flow Modelscited by 34
  16. 2025STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesiscited by 31
  17. 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flowcited by 30
  18. 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 29
  19. 2025pi-Flow: Policy-Based Few-Step Generation via Imitation Distillationcited by 25
  20. 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
  21. 2026ArcFlow: Unleashing 2-Step Text-to-Image Generation via High-Precision Non-Linear Flow Distillationcited by 5
  22. 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2

Built on by

Not cited yet.