mlsanityData to 7 Oct 2026

MotionSpec: Spectral Trajectory Supervision for Motion-Consistent Video Generation

arXiv 2609.28095 ↗First posted 23 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in text-to-video generation have enabled high-fidelity visual synthesis, yet realistic motion remains challenging. Generated videos may exhibit temporal discontinuities, inconsistent action progression, and structural distortions during complex movements. Even when individual frames appear realistic, the underlying motion may evolve in inconsistent or implausible ways. Standard generative objectives provide limited motion-specific supervision, leaving motion evolution insufficiently constrained. In this paper, we propose MotionSpec, a motion supervision framework centered on Spectral Trajectory Consistency (STC). STC constructs dense anchor-relative motion trajectories and transforms them into motion spectral volumes via a temporal Fourier transform. By aligning the spectral amplitude and phase of predicted and target trajectories, STC constrains both motion strength across temporal frequencies and the temporal organization of motion. To complement this trajectory-level supervision, we introduce Local Flow Consistency (LFC), which aligns consecutive-frame optical flow between predicted and target videos to stabilize local motion transitions. Experiments demonstrate that MotionSpec consistently improves motion consistency, temporal coherence, and plausibility while preserving visual fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 23 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

23 of 23 references.

References · 23

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  8. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  9. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
  10. 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 112
  11. 2023Generative Image Dynamicscited by 93
  12. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 93
11 more
  1. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 48
  2. 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 42
  3. 2024AnimateAnything: Consistent and Controllable Animation for Video Generationcited by 34
  4. 2024Spectral Motion Alignment for Video Motion Transfer using Diffusion Modelscited by 20
  5. 2024Optical-Flow Guided Prompt Optimization for Coherent Video Generationcited by 17
  6. 2024MotiF: Making Text Count in Image Animation with Motion Focal Losscited by 10
  7. 2024Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioningcited by 3
  8. 2026Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2Vcited by 3
  9. 2025FREAK: Frequency-modulated High-fidelity and Real-time Audio-driven Talking Portrait Synthesiscited by 2
  10. 2025FlowLoss: Dynamic Flow-Conditioned Loss Strategy for Video Diffusion Modelscited by 1
  11. 2025Physics-Guided Motion Loss for Video Generation Modelcited by 1

Built on by

Not cited yet.