FREPix: Frequency-Heterogeneous Flow Matching for Pixel-Space Image Generation
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Pixel-space diffusion has re-emerged as a promising alternative to latent-space generation because it avoids the representation bottleneck introduced by VAEs. Yet most existing methods still treat image generation as a frequency-homogeneous process, overlooking the distinct roles and learning dynamics of low- and high-frequency components. To address this, we propose FREPix, a FREquency-heterogeneous flow matching framework for Pixel-space image generation. FREPix explicitly decomposes generation into low- and high-frequency components, assigns them separate transport paths, predicts them with a factorized network, and trains them with a frequency-aware objective. In this way, coarse-to-fine generation becomes an explicit design principle rather than an implicit behavior. On ImageNet class-to-image generation, FREPix achieves competitive results among pixel-space generation models, reaching 1.91 FID at 256×256 and 2.38 FID at 512×512, with particularly strong performance in the early stages of training and in the low-NFE regime.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 40 of its 52 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
40 of 52 references.
Closest ancestors · 3
Same direction, newest first
- 2025CAR-Flow: Condition-Aware Reparameterization Aligns Source and Target for Better Flow Matching23 Sep
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2016Improved Techniques for Training GANscited by 2,938
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
25 more
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 240
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2019Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolutioncited by 140
- 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 116
- 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
- 2025Latent Diffusion Model without Variational Autoencodercited by 83
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesiscited by 78
- 2025PixNerd: Pixel Neural Field Diffusioncited by 75
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 75
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generationcited by 55
- 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 49
- 2025A Fourier Space Perspective on Diffusion Modelscited by 48
- 2024JetFormer: An Autoregressive Generative Model of Raw Images and Textcited by 44
- 2025Fractal Generative Modelscited by 44
- 2025Learnings from Scaling Visual Tokenizers for Reconstruction and Generationcited by 31
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Pixel-Space Diffusion via Observation Operatorscited by 1
- 2026Energy-Guided Flow Matchingcited by 0
- 2026Pixel-Space Diffusion via Observation Operators22 Aug 2026
- 2026Energy-Guided Flow Matching6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Frequency-Aware Flow Matching for High-Quality Image Generation
- 2026Balancing Frequencies and Pixels in Flow Matching
- 2026WaiT for the Signal: Simple Frequency-Aware Flow-Matching
- 2023Flow Matching in Latent Space
- 2025Graph Flow Matching: Enhancing Image Generation with Neighbor-Aware Flow Fields
- 2023Straighter Flow Matching via a Diffusion-Based Coupling Prior
- 2026CrossFlow: One-Step Generation Across Latent and Pixel Spaces
- 2026SpectralDiT: Timestep-Conditioned Spectral Residual Correction for Flow-Matching DiTs