mlsanityData to 7 Oct 2026

UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformers

arXiv 2512.04504 ↗First posted 4 Dec 2025cs.CVcited by 10

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Recent image diffusion transformers achieve high-fidelity generation, but struggle to generate images beyond these scales, suffering from content repetition and quality degradation. In this work, we present UltraImage, a principled framework that addresses both issues. Through frequency-wise analysis of positional embeddings, we identify that repetition arises from the periodicity of the dominant frequency, whose period aligns with the training resolution. We introduce a recursive dominant frequency correction to constrain it within a single period after extrapolation. Furthermore, we find that quality degradation stems from diluted attention and thus propose entropy-guided adaptive attention concentration, which assigns higher focus factors to sharpen local attention for fine detail and lower ones to global attention patterns to preserve structural consistency. Experiments show that UltraImage consistently outperforms prior methods on Qwen-Image and Flux (around 4K) across three generation scenarios, reducing repetition and improving visual fidelity. Moreover, UltraImage can generate images up to 6K*6K without low-resolution guidance from a training resolution of 1328p, demonstrating its extreme extrapolation capability. Project page is available at hrefhttps://thu-ml.github.io/ultraimage.github.io/https://thu-ml.github.io/ultraimage.github.io/.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 42 of its 48 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

42 of 48 references.

Closest ancestors · 24

Same direction, newest first

  1. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Models24 Mar
  2. 2025Ultra-Resolution Adaptation with Ease20 Mar
  3. 2024FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusion12 Dec
  4. 2024I-Max: Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers with Projected Flow10 Oct
  5. 2024DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance26 Jun
  6. 2024ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance24 Jun
  7. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT5 Jun
  8. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers9 May
  9. 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis19 Mar
  10. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
  11. 2024FiT: Flexible Vision Transformer for Diffusion Model19 Feb
  12. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation16 Feb
12 more
  1. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  2. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
  3. 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesis4 Sep
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  5. 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
  6. 2022Scalable Diffusion Models with Transformers19 Dec
  7. 2022All are Worth Words: A ViT Backbone for Diffusion Models25 Sep
  8. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  9. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul
  10. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  11. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  12. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  5. 2018Demystifying MMD GANscited by 1,268
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  8. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  9. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  10. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  11. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  12. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 105
6 more
  1. 2024UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peakscited by 64
  2. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
  3. 2023Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesiscited by 55
  4. 2024LinFusion: 1 GPU, 1 Minute, 16K Imagecited by 42
  5. 2023Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Imagescited by 36
  6. 2025HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidancecited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers
  2. 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention
  3. 2025DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion
  4. 2025LEDiT: Your Length-Extrapolatable Diffusion Transformer without Positional Encoding
  5. 2025ResDiT: Evoking the Intrinsic Resolution Scalability in Diffusion Transformers
  6. 2025Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape
  7. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  8. 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion