Reimagine Video Dynamics
Not on the map. Why?
Abstract (arXiv)
Most video editing methods focus on changing the appearance of the source video, while offering limited control over its dynamics. We introduce Reimagine Video Dynamics (RVD), a framework that disentangles a compact, editable dynamics token from visual context. We learn this token through self-supervised reconstruction: given the first frame as visual context, a renderer must recover the original video from the dynamics token, encouraging it to capture how the scene evolves rather than how it looks. This disentanglement allows video dynamics to be edited directly while preserving visual context. We develop a language-guided dynamics-token editor that transforms source dynamics into target dynamics, and train it with a scalable counterfactual video-pair pipeline and a two-stage training strategy. Extensive experiments show that RVD enables effective video dynamics editing, training-free retiming, and appearance-controlled re-rendering.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 48 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
47 of 48 references.
References · 47
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
35 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025DINOv3cited by 1,414
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2025Diffusion Transformers with Representation Autoencoderscited by 295
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2023Generative Image Dynamicscited by 94
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 80
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
- 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 57
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 48
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
- 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Modelscited by 22
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 19
- 2025MotionV2V: Editing Motion in a Videocited by 14
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
- 2026VOID: Video Object and Interaction Deletioncited by 9
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4
- 2026OptiWorld: Optimal Control for Video World Generation under Physical Constraintscited by 2
Built on by
Not cited yet.