PreviewDiff: Multimodal Critic-Guided Search over Diffusion Latents
On the map: Diffusion models → Image generation, text-to-image and editing also fits: Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding, spatial relations, and temporally grounded actions. A common way to improve prompt satisfaction is to spend more compute at test time through Best-of-N sampling, but final-sample selection is fixed. Best-of-N can only choose among completed outputs and cannot repair a promising trajectory before it fails. We introduce PreviewDiff, a training-free test-time search method that turns diffusion sampling from scalar search into a multimodal critic-guided search over intermediate latents. At selected denoising checkpoints, PreviewDiff decodes a partial preview, asks a multimodal judge to score and critique it, and uses the resulting natural-language feedback to branch over semantic prompt edits and locally re-noised latent continuations. These branches are then scored and selectively rolled forward, allowing verifier compute to guide generation while the sample is still editable. Across image and video generation benchmarks, PreviewDiff consistently improves over budget-matched Best-of-N selection and strong scalar-search baselines. Ablations show that earlier interventions and increased search width provide the largest gains, while deeper search and additional semantic variants offer complementary improvements. PreviewDiff demonstrates that multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 42 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
38 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2023Learning from Mistakes: Iterative Prompt Relabeling for Text-to-Image Diffusion Model Training23 Dec
- 2023Self-correcting LLM-controlled Diffusion Models27 Nov
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
Other references · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
22 more
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 225
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 201
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
- 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 89
- 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
- 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 38
- 2025Monte Carlo Tree Diffusion for System 2 Planningcited by 33
- 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 33
- 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
- 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion modelscited by 31
- 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Searchcited by 28
- 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 21
- 2025Test-time Prompt Refinement for Text-to-Image Modelscited by 16
- 2025VisualPrompter: Semantic-Aware Prompt Optimization with Visual Feedback for Text-to-Image Synthesiscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Image Diffusion Preview with Consistency Solver
- 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders
- 2024Diffusion Models Need Visual Priors for Image Generation
- 2023AdaDiff: Adaptive Step Selection for Fast Diffusion Models
- 2025Conditioning Residuals for Diffusion Models via Representation Feedback
- 2024UniFL: Improve Latent Diffusion Model via Unified Feedback Learning
- 2025Inference-Time Optimization of Prompt Embeddings in Diffusion Models: A Comparison of sep-CMA-ES and Adam
- 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models