Pixel-Space Diffusion via Observation Operators
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 16 of its 31 references that are in the map. First posted on arXiv 22 Aug 2026.
Builds on
16 of 31 references.
Closest ancestors · 13
Same direction, newest first
- 2026PixelU: A U-Shaped Transformer for Efficient End-to-End Pixel Diffusion26 Jun
- 2026Show the Signal, Hide the Noise: Spectral Forcing for Pixel-Space Diffusion13 Jun
- 2026FrequencyBooster: Full-Frequency Modeling for High-Fidelity Pixel Diffusion18 May
- 2026HyperDiT: Hyper-Connected Transformers for High-Fidelity Pixel-Space Diffusion15 May
- 2026PixelGen: Improving Pixel Diffusion with Perceptual Supervision2 Feb
- 2026Revisiting Diffusion Model Predictions Through Dimensionality29 Jan
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generation25 Nov
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation24 Nov
- 2025DiP: Taming Diffusion Models in Pixel Space24 Nov
- 2025Latent Diffusion Model without Variational Autoencoder17 Oct
- 2025There is No VAE: End-to-End Pixel-Space Generative Modeling via Self-Supervised Pre-training14 Oct
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
1 more
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples
- 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
- 2024Diffusion Priors for Variational Likelihood Estimation and Image Denoising
- 2026Scale Space Diffusion
- 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusion
- 2026Advanced Pixel Diffusion Model with Guided Sparse Global Refinement
- 2023Diffusion Models Without Attention
- 2026Pixel-Space Diffusion Transformers