UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformers
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Recent image diffusion transformers achieve high-fidelity generation, but struggle to generate images beyond these scales, suffering from content repetition and quality degradation. In this work, we present UltraImage, a principled framework that addresses both issues. Through frequency-wise analysis of positional embeddings, we identify that repetition arises from the periodicity of the dominant frequency, whose period aligns with the training resolution. We introduce a recursive dominant frequency correction to constrain it within a single period after extrapolation. Furthermore, we find that quality degradation stems from diluted attention and thus propose entropy-guided adaptive attention concentration, which assigns higher focus factors to sharpen local attention for fine detail and lower ones to global attention patterns to preserve structural consistency. Experiments show that UltraImage consistently outperforms prior methods on Qwen-Image and Flux (around 4K) across three generation scenarios, reducing repetition and improving visual fidelity. Moreover, UltraImage can generate images up to 6K*6K without low-resolution guidance from a training resolution of 1328p, demonstrating its extreme extrapolation capability. Project page is available at hrefhttps://thu-ml.github.io/ultraimage.github.io/https://thu-ml.github.io/ultraimage.github.io/.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 42 of its 48 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
42 of 48 references.
Closest ancestors · 24
Same direction, newest first
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Models24 Mar
- 2025Ultra-Resolution Adaptation with Ease20 Mar
- 2024FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion12 Dec
- 2024I-Max: Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers with Projected Flow10 Oct
- 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance26 Jun
- 2024ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance24 Jun
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT5 Jun
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers9 May
- 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis19 Mar
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024FiT: Flexible Vision Transformer for Diffusion Model19 Feb
- 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation16 Feb
12 more
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022All are Worth Words: A ViT Backbone for Diffusion Models25 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2018Demystifying MMD GANscited by 1,268
- 2025Qwen-Image Technical Reportcited by 973
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
- 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 105
6 more
- 2024UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peakscited by 64
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
- 2023Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesiscited by 55
- 2024LinFusion: 1 GPU, 1 Minute, 16K Imagecited by 42
- 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Imagescited by 36
- 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2026SLA2: Sparse-Linear Attention with Learnable Routing and QATcited by 21
- 2026SpargeAttention2: Trainable Sparse Attention via Hybrid Top-k+Top-p Masking and Distillation Fine-Tuningcited by 16
- 2026SEGA: Spectral-Energy Guided Attention for Resolution Extrapolation in Diffusion Transformerscited by 2
- 2026TIDE: Text-Informed Dynamic Extrapolation with Step-Aware Temperature Control for Diffusion Transformerscited by 1
- 2026Spatial Gram Alignment for Ultra-High-Resolution Image Synthesiscited by 1
- 2026ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Modelscited by 0
- 2026RaPD: Resolution-Agnostic Pixel Diffusion via Semantics-Enriched Implicit Representationscited by 0
- 2026HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Modelscited by 0
- 2026HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models7 Aug 2026
- 2026SEGA: Spectral-Energy Guided Attention for Resolution Extrapolation in Diffusion Transformers21 May 2026
- 2026Spatial Gram Alignment for Ultra-High-Resolution Image Synthesis20 May 2026
- 2026RaPD: Resolution-Agnostic Pixel Diffusion via Semantics-Enriched Implicit Representations15 May 2026
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation14 May 2026
- 2026ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models11 May 2026
- 2026TIDE: Text-Informed Dynamic Extrapolation with Step-Aware Temperature Control for Diffusion Transformers9 Mar 2026
- 2026SpargeAttention2: Trainable Sparse Attention via Hybrid Top-k+Top-p Masking and Distillation Fine-Tuning13 Feb 2026
- 2026SLA2: Sparse-Linear Attention with Learnable Routing and QAT13 Feb 2026
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers
- 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention
- 2025DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion
- 2025LEDiT: Your Length-Extrapolatable Diffusion Transformer without Positional Encoding
- 2025ResDiT: Evoking the Intrinsic Resolution Scalability in Diffusion Transformers
- 2025Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape
- 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion