mlsanityData to 7 Oct 2026

PreviewDiff: Multimodal Critic-Guided Search over Diffusion Latents

arXiv 2609.36199 ↗First posted 28 Sep 2026cs.CV cs.AI cs.LGcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing also fits: Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding, spatial relations, and temporally grounded actions. A common way to improve prompt satisfaction is to spend more compute at test time through Best-of-N sampling, but final-sample selection is fixed. Best-of-N can only choose among completed outputs and cannot repair a promising trajectory before it fails. We introduce PreviewDiff, a training-free test-time search method that turns diffusion sampling from scalar search into a multimodal critic-guided search over intermediate latents. At selected denoising checkpoints, PreviewDiff decodes a partial preview, asks a multimodal judge to score and critique it, and uses the resulting natural-language feedback to branch over semantic prompt edits and locally re-noised latent continuations. These branches are then scored and selectively rolled forward, allowing verifier compute to guide generation while the sample is still editable. Across image and video generation benchmarks, PreviewDiff consistently improves over budget-matched Best-of-N selection and strong scalar-search baselines. Ablations show that earlier interventions and increased search width provide the largest gains, while deeper search and additional semantic variants offer complementary improvements. PreviewDiff demonstrates that multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 42 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

38 of 42 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Learning from Mistakes: Iterative Prompt Relabeling for Text-to-Image Diffusion Model Training23 Dec
  2. 2023Self-correcting LLM-controlled Diffusion Models27 Nov
  3. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  8. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  10. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  12. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
22 more
  1. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  2. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  3. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  4. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  6. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  7. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 225
  8. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 201
  9. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
  10. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
  11. 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 89
  12. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
  13. 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
  14. 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 38
  15. 2025Monte Carlo Tree Diffusion for System 2 Planningcited by 33
  16. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 33
  17. 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
  18. 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion modelscited by 31
  19. 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Searchcited by 28
  20. 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 21
  21. 2025Test-time Prompt Refinement for Text-to-Image Modelscited by 16
  22. 2025VisualPrompter: Semantic-Aware Prompt Optimization with Visual Feedback for Text-to-Image Synthesiscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Image Diffusion Preview with Consistency Solver
  2. 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders
  3. 2024Diffusion Models Need Visual Priors for Image Generation
  4. 2023AdaDiff: Adaptive Step Selection for Fast Diffusion Models
  5. 2025Conditioning Residuals for Diffusion Models via Representation Feedback
  6. 2024UniFL: Improve Latent Diffusion Model via Unified Feedback Learning
  7. 2025Inference-Time Optimization of Prompt Embeddings in Diffusion Models: A Comparison of sep-CMA-ES and Adam
  8. 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models