mlsanityData to 7 Oct 2026

DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders

arXiv 2512.13690 ↗First posted 15 Dec 2025cs.CV cs.AI cs.GRcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video diffusion models have revolutionized generative video synthesis, but they are imprecise, slow, and can be opaque during generation -- keeping users in the dark for a prolonged period. In this work, we propose DiffusionBrowser, a model-agnostic, lightweight decoder framework that allows users to interactively generate previews at any point (timestep or transformer block) during the denoising process. Our model can generate multi-modal preview representations that include RGB and scene intrinsics at more than 4× real-time speed (less than 1 second for a 4-second video) that convey consistent appearance and motion to the final video. With the trained decoder, we show that it is possible to interactively guide the generation at intermediate noise steps via stochasticity reinjection and modal steering, unlocking a new control capability. Moreover, we systematically probe the model using the learned decoders, revealing how scene, object, and other details are composed and assembled during the otherwise black-box denoising process.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 45 of its 52 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

45 of 52 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  2. 2025Bidirectional Sparse Attention for Faster Video Diffusion Training1 Sep
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  4. 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
  5. 2024Autoregressive Video Generation without Vector Quantization18 Dec
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  7. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Models12 Dec
  8. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar

Other references · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2023Consistency Modelscited by 1,778
  8. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  9. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
  10. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  11. 2023Emergent Correspondence from Image Diffusioncited by 437
  12. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
25 more
  1. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  2. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  3. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
  4. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  5. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
  6. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
  7. 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 151
  8. 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 108
  9. 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
  10. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
  11. 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animatorcited by 74
  12. 2023Intrinsic Image Diffusion for Indoor Single-view Material Estimationcited by 73
  13. 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 55
  14. 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
  15. 2023Generative Models: What Do They Know? Do They Know Things? Let's Find Out!cited by 50
  16. 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 48
  17. 2023DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generationcited by 47
  18. 2024CleanDIFT: Diffusion Features without Noisecited by 42
  19. 2024Spatiotemporal Skip Guidance for Enhanced Video Diffusion Samplingcited by 33
  20. 2025FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generationcited by 32
  21. 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion modelscited by 31
  22. 2023Beyond Surface Statistics: Scene Representations in a Latent Diffusion Modelcited by 29
  23. 2025IntrinsiX: High-Quality PBR Generation using Image Priorscited by 18
  24. 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
  25. 2024Mixture of Efficient Diffusion Experts Through Automatic Interval and Sub-Network Selectioncited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient Video Diffusion Models: Advancements and Challenges
  2. 2022Video Diffusion Models
  3. 2025Toward Lightweight and Fast Decoders for Diffusion Models in Image and Video Generation
  4. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  5. 2022Diffusion Probabilistic Modeling for Video Generation
  6. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation
  7. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference
  8. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models