Toward Early Quality Assessment of Text-to-Image Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at https://github.com/Guhuary/ProbeSelect.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 31 of its 37 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
31 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model2 Sep
- 2023Emergent Correspondence from Image Diffusion6 Jun
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2016Improved Techniques for Training GANscited by 2,970
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
15 more
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Accelerationcited by 70
- 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
- 2024SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flowcited by 30
- 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillationcited by 18
- 2024A Survey on Quality Metrics for Text-to-Image Generationcited by 18
- 2024Where's Waldo: Diffusion Features for Personalized Segmentation and Retrievalcited by 18
- 2024A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Modelscited by 13
- 2025Controlling Latent Diffusion Using Latent CLIPcited by 4
- 2024Optimizing Resource Consumption in Diffusion Models through Hallucination Early Detectioncited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoning29 Sep 2026
- 2026Unlocking Few-Step Diffusion for Faithful Previews28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Diffusion Probe: Generated Image Result Prediction Using CNN Probes
- 2026Boosting Text-to-Image Diffusion Models via Core Token Attention-Based Seed Selection
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization
- 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
- 2026Na"ive PAINE: Lightweight Text-to-Image Generation Improvement with Prompt Evaluation
- 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models