Streaming Drag-Oriented Interactive Video Manipulation: Drag Anything, Anytime!
On the map: Diffusion models → Video generation
Abstract (arXiv)
Achieving streaming, fine-grained control over the outputs of autoregressive video diffusion models remains challenging, making it difficult to ensure that they consistently align with user expectations. To bridge this gap, we propose stReaming drag-oriEnted interactiVe vidEo manipuLation (REVEL), a new task that enables users to modify generated videos anytime on anything via fine-grained, interactive drag. Beyond DragVideo and SG-I2V, REVEL unifies drag-style video manipulation as editing and animating video frames with both supporting user-specified translation, deformation, and rotation effects, making drag operations versatile. In resolving REVEL, we observe: i) drag-induced perturbations accumulate in latent space, causing severe latent distribution drift that halts the drag process; ii) streaming drag is easily disturbed by context frames, thereby yielding visually unnatural outcomes. We thus propose a training-free approach, DragStream, comprising: i) an adaptive distribution self-rectification strategy that leverages neighboring frames' statistics to effectively constrain the drift of latent embeddings; ii) a spatial-frequency selective optimization mechanism, allowing the model to fully exploit contextual information while mitigating its interference via selectively propagating visual cues along generation. Our method can be seamlessly integrated into existing autoregressive video diffusion models, and extensive experiments firmly demonstrate the effectiveness of our DragStream.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 30 of its 38 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
30 of 38 references.
Closest ancestors · 11
Same direction, newest first
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generation4 Jul
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Model21 Oct
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
- 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models24 Jun
- 2024Streaming Video Diffusion: Online Video Editing with Diffusion Models30 May
- 2024Looking Backward: Streaming Video-to-Video Translation with Feature Banks24 May
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
- 2023Pix2Video: Video Editing using Image Diffusion22 Mar
Other references · 19
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
- 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2020Wavelet Integrated CNNs for Noise-Robust Image Classificationcited by 60
- 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generationcited by 56
7 more
- 2023DragVideo: Interactive Drag-style Video Editingcited by 40
- 2024AnimateAnything: Consistent and Controllable Animation for Video Generationcited by 34
- 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 29
- 2024RMem: Restricted Memory Banks Improve Video Object Segmentationcited by 22
- 2024Selective Vision-Language Subspace Projection for Few-shot CLIPcited by 18
- 2025DragNeXt: Rethinking Drag-Based Image Editingcited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Real-Time Motion-Controllable Autoregressive Video Diffusioncited by 7
- 2025Parallel Diffusion Solver via Residual Dirichlet Policy Optimizationcited by 3
- 2026Free Lunch for Stabilizing Rectified Flow Inversioncited by 2
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applicationscited by 1
- 2026PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Controlcited by 1
- 2026PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control15 Sep 2026
- 2026Free Lunch for Stabilizing Rectified Flow Inversion12 Feb 2026
- 2025Parallel Diffusion Solver via Residual Dirichlet Policy Optimization28 Dec 2025
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applications20 Nov 2025
- 2025Real-Time Motion-Controllable Autoregressive Video Diffusion9 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Reproducing DragDiffusion: Interactive Point-Based Editing with Diffusion Models
- 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editing
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2024InstantDrag: Improving Interactivity in Drag-based Image Editing
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2024ReVideo: Remake a Video with Motion and Content Control
- 20264DStreamCtrl: Interactive Video Generation with Online 4D Control