ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models excel at producing high-quality images; however, scaling to higher resolutions, such as 4K, often results in over-smoothed content, structural distortions, and repetitive patterns. To this end, we introduce ResMaster, a novel, training-free method that empowers resolution-limited diffusion models to generate high-quality images beyond resolution restrictions. Specifically, ResMaster leverages a low-resolution reference image created by a pre-trained diffusion model to provide structural and fine-grained guidance for crafting high-resolution images on a patch-by-patch basis. To ensure a coherent global structure, ResMaster meticulously aligns the low-frequency components of high-resolution patches with the low-resolution reference at each denoising step. For fine-grained guidance, tailored image prompts based on the low-resolution reference and enriched textual prompts produced by a vision-language model are incorporated. This approach could significantly mitigate local pattern distortions and improve detail refinement. Extensive experiments validate that ResMaster sets a new benchmark for high-resolution image generation and demonstrates promising efficiency. The project page is https://shuweis.github.io/ResMaster .
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 24 Jun 2024.
Builds on
36 of 38 references.
Closest ancestors · 14
Same direction, newest first
- 2024SD-DiT: Unleashing the Power of Self-supervised Discrimination in Diffusion Transformer25 Mar
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024FiT: Flexible Vision Transformer for Diffusion Model19 Feb
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
2 more
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2016Improved Techniques for Training GANscited by 2,938
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
10 more
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
- 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 105
- 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Followingcited by 77
- 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
- 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Imagescited by 36
- 2023Learning Disentangled Identifiers for Action-Customized Text-to-Image Generationcited by 24
- 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19
Built on by
Citing papers per year: 2024: 6; 2025: 11; 2026: 4.
21 papers.
Sort:
By area:
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 33
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
- 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2024FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Samplingcited by 15
- 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Promptscited by 14
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusioncited by 12
- 2025FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Computecited by 12
- 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformerscited by 10
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
- 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusioncited by 5
9 more
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025HOT: Hadamard-based Optimized Trainingcited by 2
- 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectificationcited by 1
- 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attentioncited by 1
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Datasetcited by 1
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesiscited by 0
- 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracingcited by 0
- 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editingcited by 0
- 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editingcited by 0
- 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing7 Jul 2026
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Dataset19 May 2026
- 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing17 May 2026
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformers4 Dec 2025
- 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusion29 Oct 2025
- 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention18 Oct 2025
- 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracing29 Jul 2025
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesis26 Jun 2025
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesis31 May 2025
- 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidance8 Apr 2025
- 2025HOT: Hadamard-based Optimized Training27 Mar 2025
9 more
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Models24 Mar 2025
- 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectification4 Mar 2025
- 2025FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Compute27 Feb 2025
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion27 Nov 2024
- 2024FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Sampling24 Oct 2024
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion15 Oct 2024
- 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Prompts4 Sep 2024
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance26 Jun 2024
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidancecited by 33
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2024FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Samplingcited by 15
- 2024HiPrompt: Tuning-free Higher-Resolution Generation with Hierarchical MLLM Promptscited by 14
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusioncited by 12
- 2025FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Computecited by 12
- 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformerscited by 10
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
- 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusioncited by 5
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectificationcited by 1
12 most cited of 15 All 15 (JSON)
- 2026Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing7 Jul 2026
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformers4 Dec 2025
- 2025ScaleDiff: Higher-Resolution Image Synthesis via Efficient and Model-Agnostic Diffusion29 Oct 2025
- 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention18 Oct 2025
- 2025APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracing29 Jul 2025
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Models24 Mar 2025
- 2025RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectification4 Mar 2025
- 2025FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Compute27 Feb 2025
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion27 Nov 2024
- 2024FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Sampling24 Oct 2024
12 newest of 15 All 15 (JSON)
- 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
- 2025HOT: Hadamard-based Optimized Trainingcited by 2
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Datasetcited by 1
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesiscited by 0
- 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editingcited by 0
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Dataset19 May 2026
- 2026HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing17 May 2026
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesis26 Jun 2025
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesis31 May 2025
- 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidance8 Apr 2025
- 2025HOT: Hadamard-based Optimized Training27 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025ResDiT: Evoking the Intrinsic Resolution Scalability in Diffusion Transformers
- 2025GuideSR: Rethinking Guidance for One-Step High-Fidelity Diffusion-Based Super-Resolution
- 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
- 2024ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models
- 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolution
- 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
- 2025One-Step Residual Shifting Diffusion for Image Super-Resolution via Distillation
- 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning