SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Training image generation foundation models consumes substantial resources. Previous methods have attempted to leverage semantic guidance to accelerate the training process, yet their experiments were only conducted on simple datasets such as ImageNet, at low resolutions, and with small-scale models. In this paper, we propose SeFi-Image, a text-to-image foundation model built upon semantic-first diffusion, a novel latent diffusion modeling paradigm. We instantiate SeFi-Image at three model scales, 1B, 2B, and 5B parameters, enabling systematic study of scaling behavior and flexible deployment under varying compute budgets. Notably, our largest 5B model was trained with merely 125K A800 GPU hours, corresponding to roughly 10-20% of the training compute used by Z-Image. However, it achieves results comparable to or even superior to Qwen-Image and Z-Image. Despite this modest training compute, SeFi-Image achieves strong performance on a wide range of benchmarks, including GenEval, DPG, LongTextBench, OneIG, and CVTG-2K. Moreover, we provide DMD2-distilled few-step turbo variants for each model scale to accommodate diverse hardware constraints and latency requirements. We publicly release our code, weights and hope this work offers the community useful insights into semantic-guided diffusion modeling for T2I generation, while also providing practical and readily deployable model options.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 22 of its 49 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
22 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2025SVG-T2I: Scaling Up Text-to-Image Latent Diffusion Model Without Variational Autoencoder12 Dec
- 2025Semantics Lead the Way: Harmonizing Semantic and Texture Modeling with Asynchronous Latent Diffusion4 Dec
Other references · 20
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
8 more
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
- 2025Latent Diffusion Model without Variational Autoencodercited by 88
- 2026Scaling Text-to-Image Diffusion Transformers with Representation Autoencoderscited by 53
- 2025Boosting Generative Image Modeling via Joint Image-Feature Synthesiscited by 45
- 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 25
- 2026Lens: Rethinking Training Efficiency for Foundational Text-to-Image Modelscited by 6
- 2025REGLUE Your Latents with Global and Local Semantics for Entangled Diffusioncited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models
- 2026Abra: Scaling Diffusion Image Training
- 2023Wuerstchen: An Efficient Architecture for Large-Scale Text-to-Image Diffusion Models
- 2024On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
- 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
- 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning
- 2024Diffusion Models Need Visual Priors for Image Generation
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflection