mlsanityData to 14 Oct 2026

Reimagine Video Dynamics

arXiv 2609.36496 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Most video editing methods focus on changing the appearance of the source video, while offering limited control over its dynamics. We introduce Reimagine Video Dynamics (RVD), a framework that disentangles a compact, editable dynamics token from visual context. We learn this token through self-supervised reconstruction: given the first frame as visual context, a renderer must recover the original video from the dynamics token, encouraging it to capture how the scene evolves rather than how it looks. This disentanglement allows video dynamics to be edited directly while preserving visual context. We develop a language-guided dynamics-token editor that transforms source dynamics into target dynamics, and train it with a scalable counterfactual video-pair pipeline and a two-stage training strategy. Extensive experiments show that RVD enables effective video dynamics editing, training-free retiming, and appearance-controlled re-rendering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 48 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

47 of 48 references.

References · 47

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
35 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2025DINOv3cited by 1,414
  3. 2025Qwen-Image Technical Reportcited by 1,044
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  5. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  8. 2025Diffusion Transformers with Representation Autoencoderscited by 295
  9. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  10. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  11. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  12. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
  13. 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
  14. 2023Generative Image Dynamicscited by 94
  15. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  16. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  17. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 80
  18. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  19. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  20. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 57
  21. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
  22. 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
  23. 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 48
  24. 2025PhysAnimator: Physics-Guided Generative Cartoon Animationcited by 42
  25. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
  26. 2026Inference-time Physics Alignment of Video Generative Models with Latent World Modelscited by 37
  27. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  28. 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Modelscited by 22
  29. 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 19
  30. 2025MotionV2V: Editing Motion in a Videocited by 14
  31. 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
  32. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  33. 2026VOID: Video Object and Interaction Deletioncited by 9
  34. 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4
  35. 2026OptiWorld: Optimal Control for Video World Generation under Physical Constraintscited by 2

Built on by

Not cited yet.