Diffusion Probe: Generated Image Result Prediction Using CNN Probes
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a strong correlation between early diffusion cross-attention distributions and final image quality. Based on this finding, we introduce Diffusion Probe, a framework that leverages internal cross-attention maps as predictive signals. We design a lightweight predictor that maps statistical properties of early-stage cross-attention extracted from initial denoising steps to the final image's overall quality. This enables accurate forecasting of image quality across diverse evaluation metrics long before full synthesis is complete. We validate Diffusion Probe across a wide range of settings. On multiple T2I models, across early denoising windows, resolutions, and quality metrics, it achieves strong correlation (PCC > 0.7) and high classification performance (AUC-ROC > 0.9). Its reliability translates into practical gains. By enabling early quality-aware decisions in workflows such as prompt optimization, seed selection, and accelerated RL training, the probe supports more targeted sampling and avoids computation on low-potential generations. This reduces computational overhead while improving final output quality.Diffusion Probe is model-agnostic, efficient, and broadly applicable, offering a practical solution for improving T2I generation efficiency through early quality prediction.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 40 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
27 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement6 Mar
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attention10 Oct
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
10 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 452
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 151
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2025Detecting High-Stakes Interactions with Activation Probescited by 45
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 31
- 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generationcited by 18
- 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 17
- 2023PromptCrafter: Crafting Text-to-Image Prompt through Mixed-Initiative Dialogue with LLMcited by 6
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 8
- 2026simpleposter: A simple baseline for product poster generationcited by 3
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understandingcited by 2
- 2026A Deformable Attention-Based Detection Transformer with Cross-Scale Feature Fusion for Industrial Coil Spring Inspectioncited by 0
- 2026Multi-View Deformable Convolution Meets Visual Mamba for Coronary Artery Segmentationcited by 0
- 2026JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustnesscited by 0
- 2026Latent Space Probing for Adult Content Detection in Video Generative Modelscited by 0
- 2026Latent Reward Registers for Diffusion Preference Alignmentcited by 0
- 2026Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Modelscited by 0
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasioncited by 0
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detectioncited by 0
1 more
- 2026Unlocking Few-Step Diffusion for Faithful Previewscited by 0
- 2026Unlocking Few-Step Diffusion for Faithful Previews28 Sep 2026
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion28 Aug 2026
- 2026Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models27 Aug 2026
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understanding5 Aug 2026
- 2026Latent Reward Registers for Diffusion Preference Alignment4 Aug 2026
- 2026simpleposter: A simple baseline for product poster generation9 May 2026
- 2026Latent Space Probing for Adult Content Detection in Video Generative Models25 Apr 2026
- 2026JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustness24 Mar 2026
- 2026Multi-View Deformable Convolution Meets Visual Mamba for Coronary Artery Segmentation23 Mar 2026
- 2026A Deformable Attention-Based Detection Transformer with Cross-Scale Feature Fusion for Industrial Coil Spring Inspection13 Mar 2026
1 more
- 2026simpleposter: A simple baseline for product poster generationcited by 3
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understandingcited by 2
- 2026A Deformable Attention-Based Detection Transformer with Cross-Scale Feature Fusion for Industrial Coil Spring Inspectioncited by 0
- 2026JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustnesscited by 0
- 2026Latent Space Probing for Adult Content Detection in Video Generative Modelscited by 0
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detectioncited by 0
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detectioncited by 0
- 2026Unlocking Few-Step Diffusion for Faithful Previewscited by 0
- 2026Unlocking Few-Step Diffusion for Faithful Previews28 Sep 2026
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understanding5 Aug 2026
- 2026simpleposter: A simple baseline for product poster generation9 May 2026
- 2026Latent Space Probing for Adult Content Detection in Video Generative Models25 Apr 2026
- 2026JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustness24 Mar 2026
- 2026A Deformable Attention-Based Detection Transformer with Cross-Scale Feature Fusion for Industrial Coil Spring Inspection13 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Toward Early Quality Assessment of Text-to-Image Diffusion Models
- 2026AI-T2I: Aggregating-and-Isolating Cross-Attention to Diffusion Models for Text-to-Image Synthesis
- 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generation
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization
- 2024Improved Noise Schedule for Diffusion Training
- 2026A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
- 2024Diffusion Model Compression for Image-to-Image Translation