DuSPiT: Dual-Branch Sub-Patch Pixel Diffusion Transformer
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Transformers achieve strong image generation performance, but most operate in compressed latent spaces. Pixel-space diffusion avoids this information loss, yet existing approaches map each raw image patch to a single token, forcing one representation to handle both global communication and fine-grained details. We address this issue by proposing a new architecture, DuSPiT, a Dual-branch SubPatch Pixel Transformer. This model separates global structural reasoning from local appearance modeling. DuSPiT uses a compact base branch for efficient global reasoning and a parallel, high-capacity pixel branch, organized into subpatch groups, to preserve detailed appearance, with the two branches interacting through cross-attention. Our results show that DuSPiT generates images with richer details and stronger fine-grained structures, while also achieving a better quality--efficiency trade-off than prior pixel-space diffusion transformers.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 24 of its 28 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
24 of 28 references.
Closest ancestors · 17
Same direction, newest first
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generation25 Nov
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generation24 Nov
- 2025Latent Diffusion Model without Variational Autoencoder17 Oct
- 2025Diffusion Transformers with Representation Autoencoders13 Oct
- 2025PixNerd: Pixel Neural Field Diffusion31 Jul
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformers14 Apr
- 2025Masked Autoencoders Are Effective Tokenizers for Diffusion Models5 Feb
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models2 Jan
- 2024Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusion25 Oct
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models14 Oct
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
5 more
- 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
Other references · 7
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
- 2024JetFormer: An Autoregressive Generative Model of Raw Images and Textcited by 44
- 2025Fractal Generative Modelscited by 44
- 2025FARMER: Flow AutoRegressive Transformer over Pixelscited by 17
- 2025ZipIR: Latent Pyramid Diffusion Transformer for High-Resolution Image Restorationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DiP: Taming Diffusion Models in Pixel Space
- 2026Pixel-Space Diffusion Transformers
- 2026PixelDiT2: Representation-Grounded Pixel Diffusion Transformers
- 2022Exploring Transformer Backbones for Image Diffusion Models
- 2026SDiT: Semantic Region-Adaptive for Diffusion Transformers
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devices
- 2026A training-free framework for high-fidelity appearance transfer via diffusion transformers
- 2026Structured Residual Connectivity Matters for Diffusion Transformers