mlsanityData to 7 Oct 2026

SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer

arXiv 2605.30409 ↗First posted 28 May 2026cs.CV cs.AIcited by 10

On the map: Diffusion models → Video generation

Abstract (arXiv)

Real-time streaming video-to-video editing (V2V) is critical for interactive applications such as live broadcasting and gaming, yet it remains a formidable challenge due to the stringent requirements for temporal consistency and inference throughput. In this paper, we present SANA-Streaming, a system-algorithm co-designed framework for high-resolution, real-time streaming video editing on consumer GPUs, with the following three core designs: (1) Hybrid Diffusion Transformer architecture introduces softmax attention in part of the blocks to improve local modeling capabilities while preserving the efficiency of linear layers. (2) Cycle-Reverse Regularization is a novel training strategy that enforces semantic consistency by predicting source frames from generated content via flow matching, improving temporal consistency without requiring paired long edited videos. (3) Efficient System Co-design combines fused GDN kernels and Mixed-Precision Quantization (MPQ) optimized for the NVIDIA Blackwell (RTX 5090) architecture. By profiling real-world throughput, our MPQ maximizes Tensor Core utilization while maintaining generation quality. The resulting system achieves real-time 1280 x 704 resolution editing at 24 end-to-end FPS on a single RTX 5090 GPU, with the DiT core running at 58 FPS. Experimental results demonstrate that our co-design approach significantly outperforms existing SOTA methods in both temporal coherence and system throughput.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 42 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

40 of 42 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
  2. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  3. 2025SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention28 Sep
  4. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  6. 2025VACE: All-in-One Video Creation and Editing10 Mar

Other references · 34

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  4. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  5. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  7. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  8. 2019Root Mean Square Layer Normalizationcited by 1,425
  9. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  10. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  12. 2025Qwen-Image Technical Reportcited by 973
22 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  3. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
  4. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
  5. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
  6. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 471
  7. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  8. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  9. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
  10. 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 169
  11. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  12. 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
  13. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  14. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  15. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 61
  16. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 50
  17. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
  18. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
  19. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
  20. 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
  21. 2025Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devicescited by 15
  22. 2025UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratioscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Streaming Video Diffusion: Online Video Editing with Diffusion Models
  2. 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution
  3. 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformer
  4. 2026Streaming Video Editing with Easy Adaptation
  5. 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generation
  6. 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation
  7. 2026Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
  8. 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep