UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion transformers have recently delivered strong text-to-image generation around 1K resolution, but we show that extending them to native 4K across diverse aspect ratios exposes a tightly coupled failure mode spanning positional encoding, VAE compression, and optimization. Tackling any of these factors in isolation leaves substantial quality on the table. We therefore take a data-model co-design view and introduce UltraFlux, a Flux-based DiT trained natively at 4K on MultiAspect-4K-1M, a 1M-image 4K corpus with controlled multi-AR coverage, bilingual captions, and rich VLM/IQA metadata for resolution- and AR-aware sampling. On the model side, UltraFlux couples (i) Resonance 2D RoPE with YaRN for training-window-, frequency-, and AR-aware positional encoding at 4K; (ii) a simple, non-adversarial VAE post-training scheme that improves 4K reconstruction fidelity; (iii) an SNR-Aware Huber Wavelet objective that rebalances gradients across timesteps and frequency bands; and (iv) a Stage-wise Aesthetic Curriculum Learning strategy that concentrates high-aesthetic supervision on high-noise steps governed by the model prior. Together, these components yield a stable, detail-preserving 4K DiT that generalizes across wide, square, and tall ARs. On the Aesthetic-Eval at 4096 benchmark and multi-AR 4K settings, UltraFlux consistently outperforms strong open-source baselines across fidelity, aesthetic, and alignment metrics, and-with a LLM prompt refiner-matches or surpasses the proprietary Seedream 4.0.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 38 of its 43 references that are in the map. First posted on arXiv 22 Nov 2025.
Builds on
38 of 43 references.
Closest ancestors · 15
Same direction, newest first
- 2025Ultra-High-Resolution Image Synthesis: Data, Method and Evaluation2 Jun
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Models24 Mar
- 2025Ultra-Resolution Adaptation with Ease20 Mar
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers14 Oct
- 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis19 Mar
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Models15 Mar
- 2024Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon14 Mar
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation16 Feb
- 2023HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Models29 Nov
- 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models11 Oct
3 more
Other references · 23
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
11 more
- 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 81
- 2023ElasticDiffusion: Training-free Arbitrary Size Image Generation through Global-Local Content Separationcited by 37
- 2025ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understandingcited by 36
- 2024CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Upcited by 26
- 2025OmniSync: Towards Universal Lip Synchronization via Diffusion Transformerscited by 26
- 2024Resonance RoPE: Improving Context Length Generalization of Large Language Modelscited by 25
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
- 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 20
- 2025T-LoRA: Single Image Diffusion Model Customization Without Overfittingcited by 15
- 2024HiRoPE: Length Extrapolation for Code Models Using Hierarchical Positioncited by 8
- 2025Hunyuan-MT Technical Reportcited by 7
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 10
- 2026PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusioncited by 6
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Datasetcited by 1
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppressioncited by 0
- 2026EDITBRIDGE: Towards Faithful and Efficient Ultra-High-Resolution Image Editingcited by 0
- 2026EDITBRIDGE: Towards Faithful and Efficient Ultra-High-Resolution Image Editing18 Aug 2026
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer28 May 2026
- 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolution25 May 2026
- 2026PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion22 May 2026
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Dataset19 May 2026
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppression13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026NanoFLUX: Distillation-Driven Compression of Large Text-to-Image Generation Models for Mobile Devices
- 2025UltraImageGen: Efficient Ultra-High-Resolution Image Generation with Hierarchical Local Attention
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Dataset
- 2024Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis
- 2024MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning
- 2025Native-Resolution Image Synthesis
- 2024Efficient Scaling of Diffusion Transformers for Text-to-Image Generation
- 2024High-Resolution Image Synthesis via Next-Token Prediction