InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter
Not on the map. Why?
Abstract (arXiv)
With large pretrained models, existing methods have effectively improved instruction-based video editing. However, most of them rely on an in-place editing assumption. They align the edited video with the given source clip frame by frame over a fixed time span. This pattern fails for open-ended streams, e.g., restyling a live game or applying a camera move to an ongoing shot. In such cases, edits must extend to future frames as they arrive, rather than be applied to a static input clip. In this paper, we study this setting and name it infinite video editing: given a preceding segment and an edit request, a model must generate the next segment that continues the stream while applying the requested edit. This process repeats as an unbounded sequence of edit instructions arrives. This task brings two challenges: the edit must be a faithful continuation rather than a frame-wise rewrite, and generation quality must remain stable as edits accumulate. To address them, we first design a data-collection pipeline for infinite video editing. Based on the collected data, we propose InfinityEdit, a lightweight edit adapter that equips a streaming video generator with unbounded editing ability. The adapter contains three attention modules. History cross-attention guides the denoising frames using the input frames. Temporal causal self-attention keeps temporal cues flowing only from earlier frames to later ones. Edit cross-attention injects the edit request into generation. During inference, the adapter is activated only in the chunk where an edit request arrives. Subsequent chunks are generated by the original model with a reset anchor frame. This scheme applies the edit while preserving the original model's infinite generation ability. Extensive experiments show that InfinityEdit faithfully continues the stream under each edit, and stays stable over unbounded edit sequences.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 55 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
47 of 55 references.
References · 47
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023CoTracker: It is Better to Track Togethercited by 516
35 more
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
- 2025Mixture of Contexts for Long Video Generationcited by 90
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 85
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 78
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 75
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 52
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 50
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 34
- 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generationcited by 30
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 27
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 23
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusioncited by 14
- 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 13
- 2026FlowAct-R1: Towards Interactive Humanoid Video Generationcited by 11
- 2026SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing modelcited by 11
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 10
- 2026Alleviating Sparse Rewards by Modeling Step-Wise and Long-Term Sampling Effects in Flow-Based GRPOcited by 9
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 8
- 2026Tuning-free Visual Effect Transfer across Videoscited by 3
- 2026MARBLE: Multi-Aspect Reward Balance for Diffusion RLcited by 3
Built on by
Not cited yet.