Training-Free Hidden-State Refinement for Flow-Matching Image Generators
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
We aim to improve frozen flow-matching image generators by adding inference computation inside the denoiser, without changing model weights or the outer sampler. Existing generators usually spend extra test-time computation by increasing the number of sampling steps, which repeatedly evaluates the entire denoiser and couples quality gains to sampler cost. A key challenge is how to use extra computation inside a frozen transformer denoiser: the method must decide which tokens, layers, and sampling times receive repeated updates while preserving the original generation pipeline. We introduce a training-free looping framework that repeatedly applies selected transformer layers inside each denoising call. Dense and Sparse Token Loop vary the token scope; Sampling-Progress Gating and the loop layer range specify when and where looping is active; loop count and strength control the repeated updates; and Loop Guidance combines ordinary and looped vector-field predictions. Across two Scale-RAE model scales, loop variants improve primary and auxiliary quality metrics with competitive quality--efficiency trade-offs. Loop Guidance further improves both primary metrics across all three tested models; on Scale-RAE DiT2.4B, it raises GenEval from 0.4471 to 0.5691 and DPG-Bench from 0.7656 to 0.8053. Code will be released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 17 of its 29 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
17 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2018Universal Transformerscited by 647
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
- 2023Token Merging for Fast Stable Diffusioncited by 224
- 2022mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connectionscited by 187
- 2023Looped Transformers are Better at Learning Learning Algorithmscited by 149
- 2023Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Latercited by 55
4 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
- 2026FlowBudget: Training-Free Sampling-Budget Estimation for Flow Matching Models
- 2026Training Flow Matching: The Role of Weighting and Parameterization
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling
- 2025The Generation Phases of Flow Matching: a Denoising Perspective
- 2025Efficiency vs. Fidelity: A Comparative Analysis of Diffusion Probabilistic Models and Flow Matching on Low-Resource Hardware
- 2026The Coupling Within: Flow Matching via Distilled Normalizing Flows
- 2026Beyond Fixed Inference: Quantitative Flow Matching for Adaptive Image Denoising