mlsanityData to 14 Oct 2026

Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance

arXiv 2512.08765 ↗First posted 9 Dec 2025cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

We present Wan-Move, a simple and scalable framework that brings motion control to video generative models. Existing motion-controllable methods typically suffer from coarse control granularity and limited scalability, leaving their outputs insufficient for practical use. We narrow this gap by achieving precise and high-quality motion control. Our core idea is to directly make the original condition features motion-aware for guiding video synthesis. To this end, we first represent object motions with dense point trajectories, allowing fine-grained control over the scene. We then project these trajectories into latent space and propagate the first frame's features along each trajectory, producing an aligned spatiotemporal feature map that tells how each scene element should move. This feature map serves as the updated latent condition, which is naturally integrated into the off-the-shelf image-to-video model, e.g., Wan-I2V-14B, as motion guidance without any architecture change. It removes the need for auxiliary motion encoders and makes fine-tuning base models easily scalable. Through scaled training, Wan-Move generates 5-second, 480p videos whose motion controllability rivals Kling 1.5 Pro's commercial Motion Brush, as indicated by user studies. To support comprehensive evaluation, we further design MoveBench, a rigorously curated benchmark featuring diverse content categories and hybrid-verified annotations. It is distinguished by larger data volume, longer video durations, and high-quality motion annotations. Extensive experiments on MoveBench and the public dataset consistently show Wan-Move's superior motion quality. Code, models, and benchmark data are made publicly available.

Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Builds on 75 of its 90 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

75 of 90 references.

References · 75

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2024GPT-4o System Cardcited by 4,588
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
  1. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2024Depth Anything V2cited by 1,422
  6. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  7. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  8. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  9. 2023ModelScope Text-to-Video Technical Reportcited by 658
  10. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  11. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  12. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  13. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  14. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  15. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  16. 2023CoTracker: It is Better to Track Togethercited by 522
  17. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  18. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  19. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  20. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  21. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  22. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  23. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  24. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  25. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  26. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 245
  27. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  28. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  29. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  30. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  31. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  32. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
  33. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  34. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  35. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
  36. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
  37. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  38. 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 103

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 44.

45 papers.

Sort:

By area:

  1. 2026World Action Models: The Next Frontier in Embodied AIcited by 50
  2. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
  3. 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 10
  4. 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenescited by 9
  5. 2026Masked Visual Actions for Unified World Modelingcited by 9
  6. 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
  7. 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
  8. 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 5
  9. 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Jointscited by 4
  10. 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
  11. 2026TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidancecited by 3
  12. 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
33 more
  1. 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
  2. 2026MoRight: Motion Control Done Rightcited by 2
  3. 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Modelscited by 2
  4. 2026TrajLoom: Dense Future Trajectory Generation from Videocited by 1
  5. 2026TETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolationcited by 1
  6. 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
  7. 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
  8. 2026TrAction: Action Recognition with Sparse Trajectoriescited by 1
  9. 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamicscited by 1
  10. 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1
  11. 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generationcited by 1
  12. 2026FaceCam: Portrait Video Camera Control via Scale-Aware Conditioningcited by 0
  13. 2026HECTOR: Hybrid Editable Compositional Object References for Video Generationcited by 0
  14. 2026Tora3: Trajectory-Guided Audio-Video Generation with Physical Coherencecited by 0
  15. 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesiscited by 0
  16. 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generationcited by 0
  17. 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Textcited by 0
  18. 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
  19. 2026Neural Voxel Dynamics: Learning Volumetric Feature Advection for 3D Physics in V-JEPA Latent Spacecited by 0
  20. 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Modelscited by 0
  21. 2026TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Controlcited by 0
  22. 2026Motion4Motion: Motion Transfer Across Subjects at Inferencecited by 0
  23. 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulationcited by 0
  24. 2026GraphVid: Interactive Graph-Controllable Video Generationcited by 0
  25. 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
  26. 2026Beyond Pixels: From Video Priors to 4D Worldscited by 0
  27. 2026What Moves? Localized Motion Representations for Compositional Scene Controlcited by 0
  28. 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
  29. 2026Unifying Video Tasks via Spatiotemporal Analogycited by 0
  30. 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
  31. 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
  32. 2026Generative Cinematographer: Composing Camera and Object Motion in 3Dcited by 0
  33. 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Trainingcited by 0