mlsanityData to 14 Oct 2026

Toward Early Quality Assessment of Text-to-Image Diffusion Models

arXiv 2603.02829 ↗First posted 3 Mar 2026cs.CV cs.LGcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at https://github.com/Guhuary/ProbeSelect.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 31 of its 37 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

31 of 37 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model2 Sep
  2. 2023Emergent Correspondence from Image Diffusion6 Jun
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2016Improved Techniques for Training GANscited by 2,970
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
15 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  2. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  4. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  5. 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
  6. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  7. 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Accelerationcited by 70
  8. 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
  9. 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flowcited by 30
  10. 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillationcited by 18
  11. 2024A Survey on Quality Metrics for Text-to-Image Generationcited by 18
  12. 2024Where's Waldo: Diffusion Features for Personalized Segmentation and Retrievalcited by 18
  13. 2024A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Modelscited by 13
  14. 2025Controlling Latent Diffusion Using Latent CLIPcited by 4
  15. 2024Optimizing Resource Consumption in Diffusion Models through Hallucination Early Detectioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion Probe: Generated Image Result Prediction Using CNN Probes
  2. 2026Boosting Text-to-Image Diffusion Models via Core Token Attention-Based Seed Selection
  3. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization
  4. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models
  5. 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
  6. 2026Na"ive PAINE: Lightweight Text-to-Image Generation Improvement with Prompt Evaluation
  7. 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
  8. 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models