mlsanityData to 7 Oct 2026

Patched Denoising Diffusion Models For High-Resolution Image Synthesis

arXiv 2308.01316 ↗First posted 2 Aug 2023cs.CVcited by 45

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We propose an effective denoising diffusion model for generating high-resolution images (e.g., 1024×512), trained on small-size image patches (e.g., 64×64). We name our algorithm Patch-DM, in which a new feature collage strategy is designed to avoid the boundary artifact when synthesizing large-size images. Feature collage systematically crops and combines partial features of the neighboring patches to predict the features of a shifted image patch, allowing the seamless generation of the entire image due to the overlap in the patch feature space. Patch-DM produces high-quality image synthesis results on our newly collected dataset of nature images (1024×512), as well as on standard benchmarks of smaller sizes (256×256), including LSUN-Bedroom, LSUN-Church, and FFHQ. We compare our method with previous patch-based generation methods and achieve state-of-the-art FID scores on all four datasets. Further, Patch-DM also reduces memory complexity compared to the classic diffusion models.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 41 of its 57 references that are in the map. First posted on arXiv 2 Aug 2023.

Builds on

41 of 57 references.

Closest ancestors · 13

Same direction, newest first

  1. 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models25 Apr
  2. 2022Diffusion Models in Vision: A Survey10 Sep
  3. 2022Classifier-Free Diffusion Guidance26 Jul
  4. 2022Improving Diffusion Model Efficiency Through Patching9 Jul
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  6. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representation30 Nov
  7. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation10 Jun
  8. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  9. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Implicit Models6 Oct
  12. 2020Denoising Diffusion Probabilistic Models19 Jun
1 more
  1. 2020Improved Techniques for Training Score-Based Generative Models16 Jun

Other references · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  9. 2016Improved Techniques for Training GANscited by 2,938
  10. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  11. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  12. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
16 more
  1. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  2. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  3. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  4. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  5. 2016Adversarial Feature Learningcited by 350
  6. 2021Generating Images with Sparse Representationscited by 262
  7. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  8. 2021Projected GANs Converge Fastercited by 204
  9. 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
  10. 2021ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesiscited by 122
  11. 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
  12. 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
  13. 2019COCO-GAN: Generation by Parts via Conditional Coordinatingcited by 67
  14. 2018Non-Stationary Texture Synthesis by Adversarial Expansioncited by 66
  15. 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
  16. 2023Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRIcited by 45

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 23; 2025: 16; 2026: 5.

45 papers.

Sort:

By area:

  1. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 94
  2. 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 82
  3. 2024Towards a Mechanistic Explanation of Diffusion Model Generalizationcited by 42
  4. 2025DiP: Taming Diffusion Models in Pixel Spacecited by 42
  5. 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
  6. 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
  7. 2024Learning Image Priors through Patch-based Diffusion Models for Solving Inverse Problemscited by 18
  8. 2024Pruning then Reweighting: Towards Data-Efficient Training of Diffusion Modelscited by 17
  9. 2024Plug-and-Play Diffusion Distillationcited by 16
  10. 2024Epsilon-VAE: Denoising as Visual Decodingcited by 16
  11. 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Modelscited by 14
  12. 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Promptscited by 14
33 more
  1. 2023Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modelingcited by 13
  2. 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removalcited by 10
  3. 2024BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusioncited by 9
  4. 2024Learnable Sparsity for Vision Generative Modelscited by 9
  5. 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problemscited by 8
  6. 2025Local Diffusion Models and Phases of Data Distributionscited by 8
  7. 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
  8. 2024Efficient Generative Modeling with Residual Vector Quantization-Based Tokenscited by 7
  9. 2025Accelerating Diffusion Model Training under Minimal Budgets: A Condensation-Based Perspectivecited by 7
  10. 2024Multistable Shape from Shading Emerges from Patch Diffusioncited by 5
  11. 2024Illusion3D: 3D Multiview Illusion with 2D Diffusion Priorscited by 5
  12. 2025Early-Bird Diffusion: Investigating and Leveraging Timestep-Aware Early-Bird Tickets in Diffusion Models for Efficient Trainingcited by 5
  13. 2024Zero-shot Text-guided Infinite Image Synthesis with LLM guidancecited by 4
  14. 2024Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Modelscited by 4
  15. 2024Partially Conditioned Patch Parallelism for Accelerated Diffusion Model Inferencecited by 3
  16. 2024LoFi: Neural Local Fields for Scalable Image Reconstructioncited by 2
  17. 2025Bigger Isn't Always Better: Towards a General Prior for Medical Image Reconstructioncited by 2
  18. 2025Investigating the Feasibility of Patch-based Inference for Generalized Diffusion Priors in Inverse Problems for Medical Imagescited by 2
  19. 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusioncited by 2
  20. 2024RISSOLE: Parameter-efficient Diffusion Models via Block-wise Generation and Retrieval-Guidancecited by 1
  21. 2025Sparse-to-Sparse Training of Diffusion Modelscited by 1
  22. 2025RealDeal: Enhancing Realism and Details in Brain Image Generation via Image-to-Image Diffusion Modelscited by 1
  23. 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformercited by 1
  24. 2025Local Patches Meet Global Context: Scalable 3D Diffusion Priors for Computed Tomography Reconstructioncited by 1
  25. 2025q3-MuPa: Quick, Quiet, Quantitative Multi-Parametric MRI using Physics-Informed Diffusion Modelscited by 1
  26. 2026Spectral Regularization for Diffusion Modelscited by 1
  27. 2025Tera-MIND: Tera-scale mouse brain simulation via spatial mRNA-guided diffusioncited by 0
  28. 2025Efficient and robust 3D blind harmonization for large domain gapscited by 0
  29. 2025MAMBO: High-Resolution Generative Approach for Mammography Imagescited by 0
  30. 2026Map2World: Segment Map Conditioned Text to 3D World Generationcited by 0
  31. 2026Renormalization Group Flow Matching for Scalable Local Generative Modelingcited by 0
  32. 2026Efficient Training with Foresight: Multi-Token Auxiliary Supervision for Autoregressive Image Generationcited by 0
  33. 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancementcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient and Training-Free Single-Image Diffusion Models
  2. 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracing
  3. 2023Simple diffusion: End-to-end diffusion for high resolution images
  4. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance
  5. 2023Denoising Diffusion Bridge Models
  6. 2024PatchScaler: An Efficient Patch-Independent Diffusion Model for Image Super-Resolution
  7. 2022SinDDM: A Single Image Denoising Diffusion Model
  8. 2023PartDiff: Image Super-resolution with Partial Diffusion Models