mlsanityData to 7 Oct 2026

PixelGen: Improving Pixel Diffusion with Perceptual Supervision

arXiv 2602.02493 ↗First posted 2 Feb 2026cs.CV cs.AIcited by 10

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Pixel diffusion generates images directly in pixel space, avoiding the VAE artifacts and representational bottlenecks of two-stage latent diffusion. Recent JiT further simplifies pixel diffusion with x-prediction, where the model predicts clean images rather than velocity. However, the standard pixel-wise diffusion loss treats all pixels equally, spending model capacity to perceptually insignificant signals and often leading to blurry samples. We propose PixelGen, an end-to-end pixel diffusion framework that augments x-prediction with perceptual supervision. Specifically, PixelGen introduces two complementary perceptual losses on top of x-prediction: an LPIPS loss for local textures and a P-DINO loss for global semantics. To preserve sample coverage, PixelGen further proposes a noise-gating strategy that applies these losses only at lower-noise timesteps. On ImageNet-256 without classifier-free guidance, PixelGen achieves an FID of 5.11 in 80 training epochs, surpassing the latent diffusion baselines. Moreover, PixelGen scales efficiently to text-to-image generation, reaching a GenEval score of 0.79 with only 6 days of training on 8xH800 GPUs. These results show that perceptual supervision substantially narrows the gap between pixel and latent diffusion while preserving a simple one-stage pipeline. Codes are available at https://github.com/Zehong-Ma/PixelGen.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 59 of its 67 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

59 of 67 references.

Closest ancestors · 33

Same direction, newest first

  1. 2025PixelDiT: Pixel Diffusion Transformers for Image Generation25 Nov
  2. 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation24 Nov
  3. 2025DiP: Taming Diffusion Models in Pixel Space24 Nov
  4. 2025There is No VAE: End-to-End Pixel-Space Generative Modeling via Self-Supervised Pre-training14 Oct
  5. 2025Diffusion Transformers with Representation Autoencoders13 Oct
  6. 2025PixNerd: Pixel Neural Field Diffusion31 Jul
  7. 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Think2 Jul
  8. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformers14 Apr
  9. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models2 Jan
  10. 2024Boosting Latent Diffusion with Perceptual Objectives6 Nov
  11. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models14 Oct
  12. 2024FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modification14 Oct
21 more
  1. 2024Diffusion Models Need Visual Priors for Image Generation11 Oct
  2. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
  3. 2024Distilling Diffusion Models into Conditional GANs9 May
  4. 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models11 Apr
  5. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  7. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
  8. 2023Diffusion Model with Perceptual Loss30 Dec
  9. 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
  10. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
  11. 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
  12. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
  13. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation1 Mar
  14. 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
  15. 2022Scalable Diffusion Models with Transformers19 Dec
  16. 2022All are Worth Words: A ViT Backbone for Diffusion Models25 Sep
  17. 2022Classifier-Free Diffusion Guidance26 Jul
  18. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  19. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  20. 2020Denoising Diffusion Implicit Models6 Oct
  21. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 26

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  9. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  10. 2025Mean Flows for One-step Generative Modelingcited by 524
  11. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  12. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
14 more
  1. 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
  2. 2025Seedream 3.0 Technical Reportcited by 146
  3. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  4. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
  5. 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
  6. 2024Normalizing Flows are Capable Generative Modelscited by 89
  7. 2024DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesiscited by 72
  8. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
  9. 2026One-step Latent-free Image Generation with Pixel Mean Flowscited by 49
  10. 2025Fractal Generative Modelscited by 44
  11. 2025FARMER: Flow AutoRegressive Transformer over Pixelscited by 17
  12. 2025Native-Resolution Image Synthesiscited by 13
  13. 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
  14. 2025DMM: Building a Versatile Image Generation Model via Distillation-Based Model Mergingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
  2. 2026A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples
  3. 2024Pixel-Space Post-Training of Latent Diffusion Models
  4. 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models
  5. 2026Pixel-Space Diffusion Transformers
  6. 2026DiffusionBench: On Holistic Evaluation of Diffusion Transformers
  7. 2026Improving Controllable Generation: Faster Training and Better Performance via x0-Supervision
  8. 2026L2P: Unlocking Latent Potential for Pixel Generation