mlsanityData to 7 Oct 2026

Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models

arXiv 2605.21573 ↗First posted 20 May 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

We introduce Lens, a 3.8B-parameter T2I model that achieves performance competitive with, and in several cases surpassing, state-of-the-art models with more than 6B parameters across various benchmarks, while requiring significantly less training compute. For example, Lens requires only about 19.3% of the training compute used by Z-Image. The training efficiency of Lens stems from two key strategies beyond its compact model size. First, we maximize data information density per training batch by (i) training on Lens-800M, a dataset of 800M densely captioned image-text pairs whose captions are generated by GPT-4.1 and contain approximately 109 words on average, providing richer semantic supervision than conventional short captions, and (ii) constructing each batch from images with multiple resolutions and diverse aspect ratios, thereby enlarging the effective visual coverage of each optimization step. Second, we improve convergence speed through careful architectural choices, including adopting a semantic VAE that provides better latent representations and employing a strong language encoder that accelerates optimization while enabling multilingual generalization from English-only training data. After pre-training, we apply RL with taxonomy-driven prompts (Lens-RL-8K) and structured reward rubrics to suppress artifacts and improve visual quality, a reasoner module with training-free system prompt search to better align user requests with the model, and distillation-based acceleration for 4-step inference. Through efficient training and systematic optimization, Lens generalizes to arbitrary aspect ratios from 1:2 to 2:1 and resolutions up to 1440^2, and supports prompts in several commonly used languages. Thanks to its compact size, Lens generates a 1024^2 image in 3.15 seconds on a single NVIDIA H100 GPU, while its distilled turbo version performs 4-step generation in 0.84 seconds.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 66 of its 80 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

66 of 80 references.

References · 66

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  12. 2017Billion-scale similarity search with GPUscited by 2,477
38 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  2. 2023Consistency Modelscited by 1,778
  3. 2019Root Mean Square Layer Normalizationcited by 1,425
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  5. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  6. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  8. 2025Qwen-Image Technical Reportcited by 973
  9. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  13. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  14. 2023Adversarial Diffusion Distillationcited by 741
  15. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  16. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  17. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  18. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  19. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  20. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  21. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  22. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  23. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  24. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
  25. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  26. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 246
  27. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  28. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
  29. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  30. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
  31. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  32. 2025HunyuanImage 3.0 Technical Reportcited by 138
  33. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  34. 2017Stabilizing Training of Generative Adversarial Networks through Regularizationcited by 118
  35. 2025Reinforcement Learning with Rubric Anchorscited by 108
  36. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  37. 2024Aligning Diffusion Models by Optimizing Human Utilitycited by 99
  38. 2025LongCat-Image Technical Reportcited by 92

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.