mlsanityData to 7 Oct 2026

DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance

arXiv 2406.18459 ↗First posted 26 Jun 2024cs.CVcited by 33

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models are confined to generating images of up to 1K resolution, which is far from meeting the demands of contemporary commercial applications. Directly sampling higher-resolution images often yields results marred by artifacts such as object repetition and distorted shapes. Addressing the aforementioned issues typically necessitates training or fine-tuning models on higher-resolution datasets. However, this poses a formidable challenge due to the difficulty in collecting large-scale high-resolution images and substantial computational resources. While several preceding works have proposed alternatives to bypass the cumbersome training process, they often fail to produce convincing results. In this work, we probe the generative ability of diffusion models at higher resolution beyond their original capability and propose a novel progressive approach that fully utilizes generated low-resolution images to guide the generation of higher-resolution images. Our method obviates the need for additional training or fine-tuning which significantly lowers the burden of computational costs. Extensive experiments and results validate the efficiency and efficacy of our method. Project page: https://yhyun225.github.io/DiffuseHigh/

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 79 of its 89 references that are in the map. First posted on arXiv 26 Jun 2024.

Builds on

79 of 89 references.

Closest ancestors · 24

Same direction, newest first

  1. 2024ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance24 Jun
  2. 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis19 Mar
  3. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation16 Feb
  4. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
  5. 2023FreeU: Free Lunch in Diffusion U-Net20 Sep
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  7. 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning13 Apr
  8. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
  9. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model17 Mar
  10. 2022Scalable Diffusion Models with Transformers19 Dec
  11. 2022Classifier-Free Diffusion Guidance26 Jul
  12. 2022Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching16 Jun
12 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  3. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  4. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  6. 2021Bilateral Denoising Diffusion Models26 Aug
  7. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation10 Jun
  8. 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
  9. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Implicit Models6 Oct
  12. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2016Improved Techniques for Training GANscited by 2,938
38 more
  1. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  9. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  13. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  14. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  15. 2018Demystifying MMD GANscited by 1,268
  16. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  17. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  18. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  19. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  20. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  21. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  22. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  23. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  24. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  25. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  26. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  27. 2023ModelScope Text-to-Video Technical Reportcited by 651
  28. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  29. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  30. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  31. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  32. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  33. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  34. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  35. 2022Blended Latent Diffusioncited by 430
  36. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  37. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
  38. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 147

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 18; 2026: 9.

33 papers.

Sort:

By area:

  1. 2024FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusioncited by 29
  2. 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21
  3. 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 16
  4. 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Promptscited by 14
  5. 2025DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusioncited by 13
  6. 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformerscited by 10
  7. 2025HiStream: Efficient High-Resolution Video Generation via Redundancy-Eliminated Streamingcited by 8
  8. 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
  9. 2025Decoupling High and Low Frequencies for Faithful Image Generation with Fine Detailscited by 7
  10. 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
  11. 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusioncited by 5
  12. 2024AccDiffusion v2: Towards More Accurate Higher-Resolution Diffusion Extrapolationcited by 3
21 more
  1. 2025Exploring Position Encoding in Diffusion U-Net for Training-free High-resolution Image Generationcited by 3
  2. 2025Creatively Upscaling Images with Global-Regional Priorscited by 2
  3. 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characterscited by 2
  4. 2026SEGA: Spectral-Energy Guided Attention for Resolution Extrapolation in Diffusion Transformerscited by 2
  5. 2024ASGDiffusion: Parallel High-Resolution Generation with Asynchronous Structure Guidancecited by 1
  6. 2024Enhancing Long Video Generation Consistency without Tuningcited by 1
  7. 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectificationcited by 1
  8. 2025DiffuseSlide: Training-Free High Frame Rate Video Generation Diffusioncited by 1
  9. 2025InfoScale: Unleashing Training-free Variable-scaled Image Generation via Effective Utilization of Informationcited by 1
  10. 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attentioncited by 1
  11. 2025ResDiT: Evoking the Intrinsic Resolution Scalability in Diffusion Transformerscited by 1
  12. 2026TIDE: Text-Informed Dynamic Extrapolation with Step-Aware Temperature Control for Diffusion Transformerscited by 1
  13. 2025Personalized Federated Training of Diffusion Models with Privacy Guaranteescited by 0
  14. 2025HiMat: DiT-based Ultra-High Resolution SVBRDF Generationcited by 0
  15. 2026MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generationcited by 0
  16. 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generationcited by 0
  17. 2026ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Modelscited by 0
  18. 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editingcited by 0
  19. 2026PhotoQuilt: Training-Free Arbitrary-Resolution Photomosaics via Bootstrapped Tiled Denoisingcited by 0
  20. 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editingcited by 0
  21. 2026HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Greedy Growing Enables High-Resolution Pixel-Based Diffusion Models
  2. 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion
  3. 2024PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher
  4. 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning
  5. 2025LowDiff: Efficient Diffusion Sampling with Low-Resolution Condition
  6. 2023Boosting Latent Diffusion with Flow Matching
  7. 2024Fixed Point Diffusion Models
  8. 2024Conditional Image Synthesis with Diffusion Models: A Survey