PixelGen: Improving Pixel Diffusion with Perceptual Supervision
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Pixel diffusion generates images directly in pixel space, avoiding the VAE artifacts and representational bottlenecks of two-stage latent diffusion. Recent JiT further simplifies pixel diffusion with x-prediction, where the model predicts clean images rather than velocity. However, the standard pixel-wise diffusion loss treats all pixels equally, spending model capacity to perceptually insignificant signals and often leading to blurry samples. We propose PixelGen, an end-to-end pixel diffusion framework that augments x-prediction with perceptual supervision. Specifically, PixelGen introduces two complementary perceptual losses on top of x-prediction: an LPIPS loss for local textures and a P-DINO loss for global semantics. To preserve sample coverage, PixelGen further proposes a noise-gating strategy that applies these losses only at lower-noise timesteps. On ImageNet-256 without classifier-free guidance, PixelGen achieves an FID of 5.11 in 80 training epochs, surpassing the latent diffusion baselines. Moreover, PixelGen scales efficiently to text-to-image generation, reaching a GenEval score of 0.79 with only 6 days of training on 8xH800 GPUs. These results show that perceptual supervision substantially narrows the gap between pixel and latent diffusion while preserving a simple one-stage pipeline. Codes are available at https://github.com/Zehong-Ma/PixelGen.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 59 of its 67 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
59 of 67 references.
Closest ancestors · 33
Same direction, newest first
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generation25 Nov
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation24 Nov
- 2025DiP: Taming Diffusion Models in Pixel Space24 Nov
- 2025There is No VAE: End-to-End Pixel-Space Generative Modeling via Self-Supervised Pre-training14 Oct
- 2025Diffusion Transformers with Representation Autoencoders13 Oct
- 2025PixNerd: Pixel Neural Field Diffusion31 Jul
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Think2 Jul
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformers14 Apr
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models2 Jan
- 2024Boosting Latent Diffusion with Perceptual Objectives6 Nov
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models14 Oct
- 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modification14 Oct
21 more
- 2024Diffusion Models Need Visual Priors for Image Generation11 Oct
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
- 2024Distilling Diffusion Models into Conditional GANs9 May
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models11 Apr
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
- 2023Diffusion Model with Perceptual Loss30 Dec
- 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation1 Mar
- 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022All are Worth Words: A ViT Backbone for Diffusion Models25 Sep
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 26
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
14 more
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
- 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
- 2024Normalizing Flows are Capable Generative Modelscited by 89
- 2024DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesiscited by 72
- 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
- 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 49
- 2025Fractal Generative Modelscited by 44
- 2025FARMER: Flow AutoRegressive Transformer over Pixelscited by 17
- 2025Native-Resolution Image Synthesiscited by 13
- 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
- 2025DMM: Building a Versatile Image Generation Model via Distillation-Based Model Mergingcited by 5
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Spectral Progressive Diffusion for Efficient Image and Video Generationcited by 3
- 2026V-Co: A Closer Look at Visual Representation Alignment via Co-Denoisingcited by 2
- 2026SeeClear: Reliable Transparent Object Depth Estimation via Generative Opacificationcited by 2
- 2026Three-Body Scattering for Generative Modelingcited by 2
- 2026Pixel-Space Diffusion via Observation Operatorscited by 1
- 2026One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generationcited by 0
- 2026Structure-Adaptive Sparse Diffusion in Voxel Space for 3D Medical Image Enhancementcited by 0
- 2026PhysReflect: Geometry and Perception Guided Diffusion for Physically-Plausible Mirror Reflectionscited by 0
- 2026Adversarial Training for Pixel Diffusioncited by 0
- 2026Do Generative Priors Align with Human Naturalness Perception?cited by 0
- 2026Do Generative Priors Align with Human Naturalness Perception?7 Oct 2026
- 2026Adversarial Training for Pixel Diffusion29 Sep 2026
- 2026PhysReflect: Geometry and Perception Guided Diffusion for Physically-Plausible Mirror Reflections20 Sep 2026
- 2026Pixel-Space Diffusion via Observation Operators22 Aug 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Spectral Progressive Diffusion for Efficient Image and Video Generation18 May 2026
- 2026Structure-Adaptive Sparse Diffusion in Voxel Space for 3D Medical Image Enhancement20 Apr 2026
- 2026One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generation24 Mar 2026
- 2026SeeClear: Reliable Transparent Object Depth Estimation via Generative Opacification20 Mar 2026
- 2026V-Co: A Closer Look at Visual Representation Alignment via Co-Denoising17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
- 2026A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples
- 2024Pixel-Space Post-Training of Latent Diffusion Models
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models
- 2026Pixel-Space Diffusion Transformers
- 2026DiffusionBench: On Holistic Evaluation of Diffusion Transformers
- 2026Improving Controllable Generation: Faster Training and Better Performance via x0-Supervision
- 2026L2P: Unlocking Latent Potential for Pixel Generation