Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance
Not on the map. Why?
Abstract (arXiv)
We present Wan-Move, a simple and scalable framework that brings motion control to video generative models. Existing motion-controllable methods typically suffer from coarse control granularity and limited scalability, leaving their outputs insufficient for practical use. We narrow this gap by achieving precise and high-quality motion control. Our core idea is to directly make the original condition features motion-aware for guiding video synthesis. To this end, we first represent object motions with dense point trajectories, allowing fine-grained control over the scene. We then project these trajectories into latent space and propagate the first frame's features along each trajectory, producing an aligned spatiotemporal feature map that tells how each scene element should move. This feature map serves as the updated latent condition, which is naturally integrated into the off-the-shelf image-to-video model, e.g., Wan-I2V-14B, as motion guidance without any architecture change. It removes the need for auxiliary motion encoders and makes fine-tuning base models easily scalable. Through scaled training, Wan-Move generates 5-second, 480p videos whose motion controllability rivals Kling 1.5 Pro's commercial Motion Brush, as indicated by user studies. To support comprehensive evaluation, we further design MoveBench, a rigorously curated benchmark featuring diverse content categories and hybrid-verified annotations. It is distinguished by larger data volume, longer video durations, and high-quality motion annotations. Extensive experiments on MoveBench and the public dataset consistently show Wan-Move's superior motion quality. Code, models, and benchmark data are made publicly available.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Builds on 75 of its 90 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
75 of 90 references.
References · 75
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024GPT-4o System Cardcited by 4,588
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Depth Anything V2cited by 1,422
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 245
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 103
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 44.
45 papers.
Sort:
By area:
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 10
- 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenescited by 9
- 2026Masked Visual Actions for Unified World Modelingcited by 9
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 5
- 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Jointscited by 4
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2026TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidancecited by 3
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
33 more
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
- 2026MoRight: Motion Control Done Rightcited by 2
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Modelscited by 2
- 2026TrajLoom: Dense Future Trajectory Generation from Videocited by 1
- 2026TETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolationcited by 1
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
- 2026TrAction: Action Recognition with Sparse Trajectoriescited by 1
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamicscited by 1
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generationcited by 1
- 2026FaceCam: Portrait Video Camera Control via Scale-Aware Conditioningcited by 0
- 2026HECTOR: Hybrid Editable Compositional Object References for Video Generationcited by 0
- 2026Tora3: Trajectory-Guided Audio-Video Generation with Physical Coherencecited by 0
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesiscited by 0
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generationcited by 0
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Textcited by 0
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
- 2026Neural Voxel Dynamics: Learning Volumetric Feature Advection for 3D Physics in V-JEPA Latent Spacecited by 0
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Modelscited by 0
- 2026TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Controlcited by 0
- 2026Motion4Motion: Motion Transfer Across Subjects at Inferencecited by 0
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulationcited by 0
- 2026GraphVid: Interactive Graph-Controllable Video Generationcited by 0
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
- 2026Beyond Pixels: From Video Priors to 4D Worldscited by 0
- 2026What Moves? Localized Motion Representations for Compositional Scene Controlcited by 0
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026Unifying Video Tasks via Spatiotemporal Analogycited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3Dcited by 0
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Trainingcited by 0
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training7 Oct 2026
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3D1 Oct 2026
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026Unifying Video Tasks via Spatiotemporal Analogy27 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026What Moves? Localized Motion Representations for Compositional Scene Control3 Sep 2026
- 2026Beyond Pixels: From Video Priors to 4D Worlds11 Aug 2026
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control31 Jul 2026
- 2026GraphVid: Interactive Graph-Controllable Video Generation23 Jul 2026
- 2026Masked Visual Actions for Unified World Modeling21 Jul 2026
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulation21 Jul 2026
33 more
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation2 Jul 2026
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control1 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models26 Jun 2026
- 2026Neural Voxel Dynamics: Learning Volumetric Feature Advection for 3D Physics in V-JEPA Latent Space24 Jun 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Tracking18 Jun 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics18 Jun 2026
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text3 Jun 2026
- 2026TrAction: Action Recognition with Sparse Trajectories2 Jun 2026
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation29 May 2026
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models24 May 2026
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning20 May 2026
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoning19 May 2026
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesis12 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May 2026
- 2026Tora3: Trajectory-Guided Audio-Video Generation with Physical Coherence10 Apr 2026
- 2026MoRight: Motion Control Done Right8 Apr 2026
- 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation4 Apr 2026
- 2026TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidance26 Mar 2026
- 2026TETO: Tracking Events with Teacher Observation for Motion Estimation and Frame Interpolation24 Mar 2026
- 2026TrajLoom: Dense Future Trajectory Generation from Video23 Mar 2026
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generation13 Mar 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Joints12 Mar 2026
- 2026HECTOR: Hybrid Editable Compositional Object References for Video Generation9 Mar 2026
- 2026FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning5 Mar 2026
- 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenes29 Jan 2026
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Text18 Dec 2025
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2026Masked Visual Actions for Unified World Modelingcited by 9
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memorycited by 5
- 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Jointscited by 4
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Modelscited by 2
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamicscited by 1
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulationcited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026Masked Visual Actions for Unified World Modeling21 Jul 2026
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulation21 Jul 2026
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics18 Jun 2026
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models24 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May 2026
- 2026Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Joints12 Mar 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generationcited by 1
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Modelscited by 0
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation2 Jul 2026
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models26 Jun 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning20 May 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 10
- 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenescited by 9
- 2025The World is Your Canvas: Painting Promptable Events with Reference Images, Trajectories, and Textcited by 7
- 2026TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidancecited by 3
- 2026MoRight: Motion Control Done Rightcited by 2
- 2026TrajLoom: Dense Future Trajectory Generation from Videocited by 1
- 2026TrAction: Action Recognition with Sparse Trajectoriescited by 1
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Trackingcited by 1
- 2026FaceCam: Portrait Video Camera Control via Scale-Aware Conditioningcited by 0
- 2026HECTOR: Hybrid Editable Compositional Object References for Video Generationcited by 0
- 2026Tora3: Trajectory-Guided Audio-Video Generation with Physical Coherencecited by 0
- 2026UniFixer: A Universal Reference-Guided Fixer for Diffusion-Based View Synthesiscited by 0
12 most cited of 24 All 24 (JSON)
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training7 Oct 2026
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3D1 Oct 2026
- 2026Unifying Video Tasks via Spatiotemporal Analogy27 Sep 2026
- 2026What Moves? Localized Motion Representations for Compositional Scene Control3 Sep 2026
- 2026Beyond Pixels: From Video Priors to 4D Worlds11 Aug 2026
- 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control31 Jul 2026
- 2026GraphVid: Interactive Graph-Controllable Video Generation23 Jul 2026
- 2026Motion4Motion: Motion Transfer Across Subjects at Inference13 Jul 2026
- 2026TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control1 Jul 2026
- 2026Neural Voxel Dynamics: Learning Volumetric Feature Advection for 3D Physics in V-JEPA Latent Space24 Jun 2026
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Tracking18 Jun 2026
- 2026Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text3 Jun 2026
12 newest of 24 All 24 (JSON)