mlsanityData to 14 Oct 2026

Training-Free Hidden-State Refinement for Flow-Matching Image Generators

arXiv 2608.29160 ↗First posted 29 Aug 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

We aim to improve frozen flow-matching image generators by adding inference computation inside the denoiser, without changing model weights or the outer sampler. Existing generators usually spend extra test-time computation by increasing the number of sampling steps, which repeatedly evaluates the entire denoiser and couples quality gains to sampler cost. A key challenge is how to use extra computation inside a frozen transformer denoiser: the method must decide which tokens, layers, and sampling times receive repeated updates while preserving the original generation pipeline. We introduce a training-free looping framework that repeatedly applies selected transformer layers inside each denoising call. Dense and Sparse Token Loop vary the token scope; Sampling-Progress Gating and the loop layer range specify when and where looping is active; loop count and strength control the repeated updates; and Loop Guidance combines ordinary and looped vector-field predictions. Across two Scale-RAE model scales, loop variants improve primary and auxiliary quality metrics with competitive quality--efficiency trade-offs. Loop Guidance further improves both primary metrics across all three tested models; on Scale-RAE DiT2.4B, it raises GenEval from 0.4471 to 0.5691 and DPG-Bench from 0.7656 to 0.8053. Code will be released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 17 of its 29 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

17 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 16

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  3. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  4. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  5. 2018Universal Transformerscited by 647
  6. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  7. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  8. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
  9. 2023Token Merging for Fast Stable Diffusioncited by 224
  10. 2022mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connectionscited by 187
  11. 2023Looped Transformers are Better at Learning Learning Algorithmscited by 149
  12. 2023Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Latercited by 55
4 more
  1. 2023Latent Space Editing in Transformer-Based Flow Matchingcited by 32
  2. 2023Denoising Task Routing for Diffusion Modelscited by 28
  3. 2025TREAD: Token Routing for Efficient Architecture-agnostic Diffusion Trainingcited by 21
  4. 2026DiffusionBench: On Holistic Evaluation of Diffusion Transformerscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
  2. 2026FlowBudget: Training-Free Sampling-Budget Estimation for Flow Matching Models
  3. 2026Training Flow Matching: The Role of Weighting and Parameterization
  4. 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling
  5. 2025The Generation Phases of Flow Matching: a Denoising Perspective
  6. 2025Efficiency vs. Fidelity: A Comparative Analysis of Diffusion Probabilistic Models and Flow Matching on Low-Resource Hardware
  7. 2026The Coupling Within: Flow Matching via Distilled Normalizing Flows
  8. 2026Beyond Fixed Inference: Quantitative Flow Matching for Adaptive Image Denoising