mlsanityData to 14 Oct 2026

A Lightweight Velocity Correction Framework for Improving Instruction Following in Few-Step Text-to-Image Generation

arXiv 2610.12899 ↗First posted 9 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-step text-to-image generators produce high-quality images with few network forward passes, yet struggle with complex prompts involving multiple subjects, interactions, spatial relations, counting, and attribute binding. Can these errors be reduced without changing the generator's parameters or increasing its forward-pass count? We propose a lightweight correction framework for a frozen 6B-parameter generator. The generator predicts velocities that determine how its intermediate image representation is updated; a corrector with fewer than 20M parameters learns residual adjustments at selected sampling steps. Because earlier corrections change the states encountered at later steps, our On-Trajectory Flow-Bridge Supervision derives residual targets at the states actually reached during corrected generation. A single corrector is shared across selected steps and runs in parallel with the generator. Only the corrector is trained, requiring neither reward optimization nor re-distillation. To our knowledge, this is the first framework for lightweight velocity-residual adaptation of fully frozen few-step text-to-image generators that preserves their original sampling schedule and forward-pass count. On our target complex-scene distribution, the framework achieves a +17.60-percentage-point NetWin over frozen Z-Image-Turbo in pairwise instruction-following evaluation, with only 26.9 ms (0.84%) additional end-to-end latency per image and no increase in backbone evaluations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

38 of 46 references.

References · 38

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  6. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  7. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  8. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  9. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  10. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  11. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  12. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
26 more
  1. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
  2. 2023Universal Guidance for Diffusion Modelscited by 437
  3. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  4. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  5. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
  6. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
  7. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
  8. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
  9. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
  10. 2021Simple multi-dataset detectioncited by 127
  11. 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 122
  12. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 91
  13. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
  14. 2024MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?cited by 66
  15. 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matchingcited by 61
  16. 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
  17. 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
  18. 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generationcited by 39
  19. 2024Diffusion-RPO: Aligning Diffusion Models through Relative Preference Optimizationcited by 32
  20. 2025TreeGRPO: Tree-Advantage GRPO for Online RL Post-Training of Diffusion Modelscited by 31
  21. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
  22. 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 22
  23. 2026On-Policy Self-Distillation in Diffusion Modelscited by 7
  24. 2026CRAFT: Aligning Diffusion Models with Fine-Tuning Is Easier Than You Thinkcited by 4
  25. 2026Diffusion Controller: Framework, Algorithms and Parameterizationcited by 2
  26. 2026Safe Few-Step Generation via Velocity Editingcited by 1

Built on by

Not cited yet.