mlsanityData to 7 Oct 2026

Exploring the Performance Frontier of Compact Unified Image Generation Models

arXiv 2608.20334 ↗First posted 20 Aug 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing. Our goal is to explore how far a relatively small visual generator can be pushed through systematic training engineering under a constrained computational budget. Swift-Image adopts an efficient 6B single-stream DiT and a progressive training pipeline that evolves from broad semantic coverage to higher resolution, stronger visual quality, and unified generation-editing supervision. For post-training, we employ parallel expert reinforcement learning followed by multi-teacher on-policy distillation to alleviate interference among heterogeneous objectives. We further decouple high-level reasoning from pixel-level rendering with a Prompt Enhancer that translates user requests into generator-aligned visual specifications. For efficient deployment, structural pruning and few-step distillation produce 3B and accelerated variants. Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps. Our study also summarizes practical lessons for architecture, data curriculum, post-training, prompt enhancement, and model compression.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 58 of its 68 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

58 of 68 references.

References · 58

  1. 2017Attention Is All You Needcited by 59,932
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2016Layer Normalizationcited by 5,579
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  7. 2020GLU Variants Improve Transformercited by 1,724
  8. 2019Root Mean Square Layer Normalizationcited by 1,425
  9. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  12. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
38 more
  1. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
  2. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  5. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  6. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  7. 2025Muon is Scalable for LLM Trainingcited by 381
  8. 2025Diffusion Transformers with Representation Autoencoderscited by 275
  9. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  10. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  11. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  12. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  13. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  14. 2025HunyuanImage 3.0 Technical Reportcited by 138
  15. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  16. 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 95
  17. 2025LongCat-Image Technical Reportcited by 92
  18. 2026Attention Residualscited by 57
  19. 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 56
  20. 2024Exploring the Role of Large Language Models in Prompt Encoding for Diffusion Modelscited by 45
  21. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
  22. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 38
  23. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
  24. 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
  25. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
  26. 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 29
  27. 2026Qwen-Image-2.0 Technical Reportcited by 28
  28. 2026Gen-Searcher: Reinforcing Agentic Search for Image Generationcited by 25
  29. 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 21
  30. 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
  31. 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesiscited by 16
  32. 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
  33. 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Taskscited by 12
  34. 2026DanceOPD: On-Policy Generative Field Distillationcited by 12
  35. 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generationcited by 10
  36. 2024How Control Information Influences Multilingual Text Image Generation and Editing?cited by 9
  37. 2024Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognitioncited by 8
  38. 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generationcited by 7

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.