LiFT: Loop Flow Transformers
On the map: Diffusion models → Flow matching, time series and science also fits: Image generation, text-to-image and editing
Abstract (arXiv)
We introduce Loop Flow Transformers (LiFT), a family of looped generative models that scales computation by repeatedly applying a shared Diffusion Transformer (DiT) core, with only light changes to the standard architecture. Rather than asking every recurrent step for the final prediction, LiFT trains each step with a single regression target: a point on a straight path from the model's initial estimate to the flow-matching target. Because we index these targets by a continuous depth coordinate, a trained model can loop far beyond its training depth with no retraining, early exits, or other modifications. In our experiments, these longer rollouts improve generation, so inference computation can grow without adding parameters. On ImageNet at 256x256, LiFT-L/2 achieves an FID 3.34 points lower than our dense DiT-XL/2 baseline while using approximately 60% fewer parameters, 32% fewer training FLOPs, and 52% fewer inference FLOPs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. First posted on arXiv 4 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Looped Transformers as Optimizers
- 2026Looped Diffusion Transformer
- 2026Training-Free Looped Transformers
- 2026One Step Forward and K Steps Back: Better Reasoning with Denoising Recursion Models
- 2026FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates
- 2026SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers
- 2026Training-Free Hidden-State Refinement for Flow-Matching Image Generators
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers