WaiT for the Signal: Simple Frequency-Aware Flow-Matching
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
As image generation models scale to ever higher resolutions, global coherence, local detail, and texture fidelity become critical axes for generation quality. However, standard flow matching treats all spatial frequencies uniformly, ignoring the natural frequency hierarchy where high-frequency bands become indistinguishable from pure noise far earlier than coarse structures. We introduce WaiT, a Wavelet-aware image Transformer that decomposes generation into coarse and fine bands via lossless wavelets. True to its name, the high-frequency bands wait for the signal: staying pure noise until coarse structure has emerged, then joining the flow for joint refinement. Since standard FID discards fine-grained detail through aggressive downsampling, we introduce a more stringent three-axis evaluation protocol to assess quality at native resolution. On ImageNet 512x512, WaiT achieves a pixel-space FID of 1.43 and is Pareto-optimal across all three axes, reducing sampling compute by up to 50%. With our largest 2B model, we set a new state-of-the-art FID of 1.3 for pixel-space models on ImageNet 512 resolution. Our formulation outperforms even the strongest latent-space models on texture fidelity, and scales seamlessly to high-resolution OpenImages and to video generation, achieving a state-of-the-art FVD of 0.84 on Kinetics-600 with no algorithmic modifications.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 41 of its 50 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
41 of 50 references.
Closest ancestors · 3
Same direction, newest first
- 2026Frequency-Aware Flow Matching for High-Quality Image Generation16 Apr
- 2026Laplacian Multi-scale Flow Matching for Generative Modeling23 Feb
- 2022Flow Matching for Generative Modeling6 Oct
Other references · 38
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Segment Anythingcited by 8,158
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
26 more
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2020First Order Motion Model for Image Animationcited by 698
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 413
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2018A Short Note about Kinetics-600cited by 331
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2023Demystifying CLIP Datacited by 265
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2025DDT: Decoupled Diffusion Transformercited by 100
- 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
- 2025PixNerd: Pixel Neural Field Diffusioncited by 75
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 75
- 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusioncited by 74
- 2022Wavelet Score-Based Generative Modelingcited by 61
- 2025A Fourier Space Perspective on Diffusion Modelscited by 48
- 2024JetFormer: An Autoregressive Generative Model of Raw Images and Textcited by 44
- 2025DiP: Taming Diffusion Models in Pixel Spacecited by 42
- 2024DCTdiff: Intriguing Properties of Image Generative Modeling in the DCT Spacecited by 32
- 2026Unified Latents (UL): How to train your latentscited by 19
- 2023Fr'echet Wavelet Distance: A Domain-Agnostic Metric for Image Generationcited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Frequency-Forcing: From Scaling-as-Time to Soft Frequency Guidance
- 2026FREPix: Frequency-Heterogeneous Flow Matching for Pixel-Space Image Generation
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation
- 2025Improving Progressive Generation with Decomposable Flow Matching
- 2026Energy-Guided Flow Matching
- 2026SpectralDiT: Timestep-Conditioned Spectral Residual Correction for Flow-Matching DiTs
- 2026Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling