JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion
Not on the map. Why?
Abstract (arXiv)
Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD), and Long-Horizon Autoregressive Distillation to reduce train--inference mismatch, preserve source fidelity during two-step generation, and mitigate accumulated temporal drift. Extensive automatic and human evaluations show that JoyAI-Video-Edit substantially outperforms existing streaming editors and remains competitive with strong offline systems on both short and long videos. The complete system achieves end-to-end 720p video editing at approximately 30 FPS on a single Nvidia B200 GPU. Code is available at https://github.com/jd-opensource/JoyAI-Video-Edit.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
31 of 37 references.
References · 31
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
19 more
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 27
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesiscited by 13
- 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 12
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
- 2026HP-Edit: A Human-Preference Post-Training Framework for Image Editingcited by 6
- 2026Vidu S1: A Real-Time Interactive Video Generation Modelcited by 4
- 2026YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removalcited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generationcited by 5
- 2026Instruction-Based Video Editing by Repurposing an Image Editing Modelcited by 3
- 2026DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generationcited by 1
- 2026Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editingcited by 0
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generationcited by 0
- 2026ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editingcited by 0
- 2026ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing6 Oct 2026
- 2026DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation2 Oct 2026
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation29 Sep 2026
- 2026Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editing28 Sep 2026
- 2026Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation10 Sep 2026
- 2026Instruction-Based Video Editing by Repurposing an Image Editing Model14 Aug 2026