SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer
On the map: Diffusion models → Video generation
Abstract (arXiv)
Real-time streaming video-to-video editing (V2V) is critical for interactive applications such as live broadcasting and gaming, yet it remains a formidable challenge due to the stringent requirements for temporal consistency and inference throughput. In this paper, we present SANA-Streaming, a system-algorithm co-designed framework for high-resolution, real-time streaming video editing on consumer GPUs, with the following three core designs: (1) Hybrid Diffusion Transformer architecture introduces softmax attention in part of the blocks to improve local modeling capabilities while preserving the efficiency of linear layers. (2) Cycle-Reverse Regularization is a novel training strategy that enforces semantic consistency by predicting source frames from generated content via flow matching, improving temporal consistency without requiring paired long edited videos. (3) Efficient System Co-design combines fused GDN kernels and Mixed-Precision Quantization (MPQ) optimized for the NVIDIA Blackwell (RTX 5090) architecture. By profiling real-world throughput, our MPQ maximizes Tensor Core utilization while maintaining generation quality. The resulting system achieves real-time 1280 x 704 resolution editing at 24 end-to-end FPS on a single RTX 5090 GPU, with the DiT core running at 58 FPS. Experimental results demonstrate that our co-design approach significantly outperforms existing SOTA methods in both temporal coherence and system throughput.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 42 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
40 of 42 references.
Closest ancestors · 6
Same direction, newest first
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention28 Sep
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025VACE: All-in-One Video Creation and Editing10 Mar
Other references · 34
- 2025Qwen3 Technical Reportcited by 8,195
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Qwen-Image Technical Reportcited by 973
22 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 471
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
- 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 169
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 61
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 50
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
- 2025Turbo-VAED: Fast and Stable Transfer of Video-VAEs to Mobile Devicescited by 15
- 2025UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratioscited by 6
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusioncited by 4
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generationcited by 2
- 2026Instruction-Based Video Editing by Repurposing an Image Editing Modelcited by 2
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPUcited by 0
- 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitratecited by 0
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adaptercited by 0
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 0
- 2026EditaLive! Unified Character Video Editing for Live Streamingcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation30 Sep 2026
- 2026EditaLive! Unified Character Video Editing for Live Streaming27 Aug 2026
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter21 Aug 2026
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing16 Aug 2026
- 2026Instruction-Based Video Editing by Repurposing an Image Editing Model14 Aug 2026
- 2026JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion4 Aug 2026
- 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate30 Jul 2026
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation23 Jul 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing25 Jun 2026
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPU4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2024Streaming Video Diffusion: Online Video Editing with Diffusion Models
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution
- 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformer
- 2026Streaming Video Editing with Easy Adaptation
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generation
- 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation
- 2026Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
- 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep