Exploring the Performance Frontier of Compact Unified Image Generation Models
Not on the map. Why?
Abstract (arXiv)
We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing. Our goal is to explore how far a relatively small visual generator can be pushed through systematic training engineering under a constrained computational budget. Swift-Image adopts an efficient 6B single-stream DiT and a progressive training pipeline that evolves from broad semantic coverage to higher resolution, stronger visual quality, and unified generation-editing supervision. For post-training, we employ parallel expert reinforcement learning followed by multi-teacher on-policy distillation to alleviate interference among heterogeneous objectives. We further decouple high-level reasoning from pixel-level rendering with a Prompt Enhancer that translates user requests into generator-aligned visual specifications. For efficient deployment, structural pruning and few-step distillation produce 3B and accelerated variants. Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps. Our study also summarizes practical lessons for architecture, data curriculum, post-training, prompt enhancement, and model compression.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 58 of its 68 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
58 of 68 references.
References · 58
- 2017Attention Is All You Needcited by 59,932
- 2025Qwen3 Technical Reportcited by 8,195
- 2016Layer Normalizationcited by 5,579
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Qwen-Image Technical Reportcited by 973
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
38 more
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025Muon is Scalable for LLM Trainingcited by 381
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 95
- 2025LongCat-Image Technical Reportcited by 92
- 2026Attention Residualscited by 57
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 56
- 2024Exploring the Role of Large Language Models in Prompt Encoding for Diffusion Modelscited by 45
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 38
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
- 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
- 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 29
- 2026Qwen-Image-2.0 Technical Reportcited by 28
- 2026Gen-Searcher: Reinforcing Agentic Search for Image Generationcited by 25
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 21
- 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
- 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesiscited by 16
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
- 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Taskscited by 12
- 2026DanceOPD: On-Policy Generative Field Distillationcited by 12
- 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generationcited by 10
- 2024How Control Information Influences Multilingual Text Image Generation and Editing?cited by 9
- 2024Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognitioncited by 8
- 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generationcited by 7
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.