mlsanityData to 14 Oct 2026

JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion

arXiv 2608.03974 ↗First posted 4 Aug 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD), and Long-Horizon Autoregressive Distillation to reduce train--inference mismatch, preserve source fidelity during two-step generation, and mitigate accumulated temporal drift. Extensive automatic and human evaluations show that JoyAI-Video-Edit substantially outperforms existing streaming editors and remains competitive with strong offline systems on both short and long videos. The complete system achieves end-to-end 720p video editing at approximately 30 FPS on a single Nvidia B200 GPU. Code is available at https://github.com/jd-opensource/JoyAI-Video-Edit.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

31 of 37 references.

References · 31

  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  4. 2025VACE: All-in-One Video Creation and Editingcited by 479
  5. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  7. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  8. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  9. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  10. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
  11. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  12. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
19 more
  1. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  2. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  3. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  4. 2025UNIC: Unified In-Context Video Editingcited by 55
  5. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  6. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
  7. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  8. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
  9. 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
  10. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
  11. 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 27
  12. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  13. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  14. 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesiscited by 13
  15. 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 12
  16. 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
  17. 2026HP-Edit: A Human-Preference Post-Training Framework for Image Editingcited by 6
  18. 2026Vidu S1: A Real-Time Interactive Video Generation Modelcited by 4
  19. 2026YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removalcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.