mlsanityData to 7 Oct 2026

ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance

arXiv 2406.16476 ↗First posted 24 Jun 2024cs.CVcited by 21

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models excel at producing high-quality images; however, scaling to higher resolutions, such as 4K, often results in over-smoothed content, structural distortions, and repetitive patterns. To this end, we introduce ResMaster, a novel, training-free method that empowers resolution-limited diffusion models to generate high-quality images beyond resolution restrictions. Specifically, ResMaster leverages a low-resolution reference image created by a pre-trained diffusion model to provide structural and fine-grained guidance for crafting high-resolution images on a patch-by-patch basis. To ensure a coherent global structure, ResMaster meticulously aligns the low-frequency components of high-resolution patches with the low-resolution reference at each denoising step. For fine-grained guidance, tailored image prompts based on the low-resolution reference and enriched textual prompts produced by a vision-language model are incorporated. This approach could significantly mitigate local pattern distortions and improve detail refinement. Extensive experiments validate that ResMaster sets a new benchmark for high-resolution image generation and demonstrates promising efficiency. The project page is https://shuweis.github.io/ResMaster .

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 24 Jun 2024.

Builds on

36 of 38 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024SD-DiT: Unleashing the Power of Self-supervised Discrimination in Diffusion Transformer25 Mar
  2. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
  3. 2024FiT: Flexible Vision Transformer for Diffusion Model19 Feb
  4. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
  5. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
  6. 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  8. 2022Scalable Diffusion Models with Transformers19 Dec
  9. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  10. 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
  11. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  12. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
2 more
  1. 2020Denoising Diffusion Implicit Models6 Oct
  2. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  4. 2016Improved Techniques for Training GANscited by 2,938
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  7. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  8. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  9. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  10. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  11. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  12. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
10 more
  1. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
  2. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
  3. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  4. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 105
  5. 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Followingcited by 77
  6. 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
  7. 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
  8. 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Imagescited by 36
  9. 2023Learning Disentangled Identifiers for Action-Customized Text-to-Image Generationcited by 24
  10. 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 11; 2026: 4.

21 papers.

Sort:

By area:

  1. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 33
  2. 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
  3. 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21
  4. 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
  5. 2024FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Samplingcited by 15
  6. 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Promptscited by 14
  7. 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusioncited by 12
  8. 2025FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Computecited by 12
  9. 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformerscited by 10
  10. 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
  11. 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
  12. 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusioncited by 5
9 more
  1. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  2. 2025HOT: Hadamard-based Optimized Trainingcited by 2
  3. 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectificationcited by 1
  4. 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attentioncited by 1
  5. 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Datasetcited by 1
  6. 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesiscited by 0
  7. 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracingcited by 0
  8. 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editingcited by 0
  9. 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ResDiT: Evoking the Intrinsic Resolution Scalability in Diffusion Transformers
  2. 2025GuideSR: Rethinking Guidance for One-Step High-Fidelity Diffusion-Based Super-Resolution
  3. 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
  4. 2024ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models
  5. 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolution
  6. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  7. 2025One-Step Residual Shifting Diffusion for Image Super-Resolution via Distillation
  8. 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning