mlsanityData to 14 Oct 2026

Moaw: Unleashing Motion Awareness for Video Diffusion Models

arXiv 2601.12761 ↗First posted 19 Jan 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video diffusion models, trained on large-scale datasets, naturally capture correspondences of shared features across frames. Recent works have exploited this property for tasks such as optical flow prediction and tracking in a zero-shot setting. Motivated by these findings, we investigate whether supervised training can more fully harness the tracking capability of video diffusion models. To this end, we propose Moaw, a framework that unleashes motion awareness for video diffusion models and leverages it to facilitate motion transfer. Specifically, we train a diffusion model for motion perception, shifting its modality from image-to-video generation to video-to-dense-tracking. We then construct a motion-labeled dataset to identify features that encode the strongest motion information, and inject them into a structurally identical video generation model. Owing to the homogeneity between the two networks, these features can be naturally adapted in a zero-shot manner, enabling motion transfer without additional adapters. Our work provides a new paradigm for bridging generative modeling and motion understanding, paving the way for more unified and controllable video learning frameworks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 30 of its 34 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

30 of 34 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Emergent Temporal Correspondences from Video Diffusion Transformers20 Jun
  2. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control7 Jan
  3. 2024Video Motion Transfer with Diffusion Transformers10 Dec
  4. 2024MoTrans: Customized Motion Transfer with Text-driven Video Diffusion Models2 Dec
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusion30 Nov
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov

Other references · 23

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  3. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  4. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  5. 2023CoTracker: It is Better to Track Togethercited by 522
  6. 2022Kubric: A scalable dataset generatorcited by 381
  7. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  8. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
  9. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
  10. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 227
  11. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
  12. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
11 more
  1. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
  2. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  3. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  4. 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
  5. 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 65
  6. 2023MFT: Long-Term Tracking of Every Pixelcited by 62
  7. 2023Dense Optical Tracking: Connecting the Dotscited by 61
  8. 2024SceneTracker: Long-term Scene Flow Estimation Networkcited by 26
  9. 2023AccFlow: Backward Accumulation for Long-Range Optical Flowcited by 19
  10. 2025Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Losscited by 15
  11. 2025Taming generative video models for zero-shot optical flow extractioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Video Diffusion Models are Training-free Motion Interpreter and Controller
  2. 2025From Image to Video: An Empirical Study of Diffusion Representations
  3. 2023MoVideo: Motion-Aware Video Generation with Diffusion Models
  4. 2025Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
  5. 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
  6. 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models
  7. 2025Target-Aware Video Diffusion Models
  8. 2025Video Diffusion Models Excel at Tracking Similar-Looking Objects Without Supervision