Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models
Not on the map. Why?
Abstract (arXiv)
We introduce Lens, a 3.8B-parameter T2I model that achieves performance competitive with, and in several cases surpassing, state-of-the-art models with more than 6B parameters across various benchmarks, while requiring significantly less training compute. For example, Lens requires only about 19.3% of the training compute used by Z-Image. The training efficiency of Lens stems from two key strategies beyond its compact model size. First, we maximize data information density per training batch by (i) training on Lens-800M, a dataset of 800M densely captioned image-text pairs whose captions are generated by GPT-4.1 and contain approximately 109 words on average, providing richer semantic supervision than conventional short captions, and (ii) constructing each batch from images with multiple resolutions and diverse aspect ratios, thereby enlarging the effective visual coverage of each optimization step. Second, we improve convergence speed through careful architectural choices, including adopting a semantic VAE that provides better latent representations and employing a strong language encoder that accelerates optimization while enabling multilingual generalization from English-only training data. After pre-training, we apply RL with taxonomy-driven prompts (Lens-RL-8K) and structured reward rubrics to suppress artifacts and improve visual quality, a reasoner module with training-free system prompt search to better align user requests with the model, and distillation-based acceleration for 4-step inference. Through efficient training and systematic optimization, Lens generalizes to arbitrary aspect ratios from 1:2 to 2:1 and resolutions up to 1440^2, and supports prompts in several commonly used languages. Thanks to its compact size, Lens generates a 1024^2 image in 3.15 seconds on a single NVIDIA H100 GPU, while its distilled turbo version performs 4-step generation in 0.84 seconds.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 66 of its 80 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
66 of 80 references.
References · 66
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2017Billion-scale similarity search with GPUscited by 2,477
38 more
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Qwen-Image Technical Reportcited by 973
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023Adversarial Diffusion Distillationcited by 741
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 246
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2017Stabilizing Training of Generative Adversarial Networks through Regularizationcited by 118
- 2025Reinforcement Learning with Rubric Anchorscited by 108
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2024Aligning Diffusion Models by Optimizing Human Utilitycited by 99
- 2025LongCat-Image Technical Reportcited by 92
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusioncited by 0
- 2026VibeEdit: Image Editing with Canvas Instructionscited by 0
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generationcited by 0
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation8 Oct 2026
- 2026VibeEdit: Image Editing with Canvas Instructions8 Oct 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion21 Jun 2026