A Decomposable Probe for Few-Step Diffusion Models: Prompt, Latent, and Score Selectivity across Backbone Families and Distillation Paradigms
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Few-step distilled diffusion students cut text-to-image inference from ~50 to 1-8 network evaluations, but the quality gap is usually summarised by a single FID/CLIP scalar that cannot say which axis of the conditioning response changed, nor whether a behaviour comes from the architecture, the distillation objective, or simply from being a diffusion model. We replace the scalar with a decomposable probe that injects controlled perturbations along three layers (prompt encoder, denoiser input, denoiser output) under three modes (mean, variance, scale) and six strengths, reporting a bootstrap-median Bures W2^2 selectivity ratio on Inception features. Under a single matched estimator across 23 models -- five teachers and 18 distilled students spanning five backbone families (SDXL, SD1.5, SD3.5, PixArt-alpha, FLUX), three architecture classes (UNet, DiT, MMDiT), and five distillation paradigms -- the three layers read three empirically separable factors: the prompt layer is a universal prompt-mean response (a sanity channel, not a discriminator), the latent layer reads the prediction type, and the score layer reads the distillation objective. Our main result: within this sweep, the latent layer is a near-binary detector of rectified-flow backbones. Its ratio exceeds 1 across a sustained low-to-mid band only for rectified-flow models (SD3.5, FLUX); no epsilon-prediction model qualifies. A matched epsilon-prediction control (PixArt-alpha) rules out wide-T5 conditioning, and the fingerprint survives adversarial (ADD) distillation as both teacher and student. Two secondary score-layer findings hold under narrower scopes: a canonical 4-step ADD-vs-rest contrast on the UNet families with a non-ADD baseline, and a CI-separated trajectory-rollout early-strength score spike on both UNet and DiT. All ratios are CI-citable under one estimator; we release the per-cell tables and the estimator.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
35 of 40 references.
Closest ancestors · 25
Same direction, newest first
- 2024Classifier-Free Guidance is a Predictor-Corrector16 Aug
- 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
- 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation4 Jun
- 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
- 2024Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation8 May
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance26 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillation21 Feb
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Models10 Jan
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
13 more
- 2023Adversarial Diffusion Distillation28 Nov
- 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Module9 Nov
- 2023Improved Techniques for Training Consistency Models22 Oct
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023FreeU: Free Lunch in Diffusion U-Net20 Sep
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
- 2023Consistency Models2 Mar
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Revisiting Classifier-Free Guidance Methods in Latent Diffusion Models
- 2024Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
- 2026Toward Early Quality Assessment of Text-to-Image Diffusion Models
- 2026Enabling Preference-driven Unlearning in Few-step Distilled Text-to-Image Diffusion Models
- 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference
- 2024SFDDM: Single-fold Distillation for Diffusion models
- 2025Few-Step Diffusion via Score identity Distillation
- 2026Learning Sampling Parameters for Diffusion Models