mlsanityData to 14 Oct 2026

STANCE: Motion Coherent Video Generation Via Sparse-to-Dense Anchored Encoding

arXiv 2510.14588 ↗First posted 16 Oct 2025cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Video generation has recently made striking visual progress, but maintaining coherent object motion and interactions remains difficult. We trace two practical bottlenecks: (i) human-provided motion hints (e.g., small 2D maps) often collapse to too few effective tokens after encoding, weakening guidance; and (ii) optimizing for appearance and motion in a single head can favor texture over temporal consistency. We present STANCE, an image-to-video framework that addresses both issues with two simple components. First, we introduce Instance Cues -- a pixel-aligned control signal that turns sparse, user-editable hints into a dense 2.5D (camera-relative) motion field by averaging per-instance flow and augmenting with monocular depth over the instance mask. This reduces depth ambiguity compared to 2D arrow inputs while remaining easy to use. Second, we preserve the salience of these cues in token space with Dense RoPE, which tags a small set of motion tokens (anchored on the first frame) with spatial-addressable rotary embeddings. Paired with joint RGB (+) auxiliary-map prediction (segmentation or depth), our model anchors structure while RGB handles appearance, stabilizing optimization and improving temporal coherence without requiring per-frame trajectory scripts.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

23 of 26 references.

References · 23

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  8. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  11. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  12. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
11 more
  1. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  2. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  3. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  4. 2025Do generative video models understand physical principles?cited by 161
  5. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  6. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
  7. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
  8. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  9. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
  10. 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
  11. 2025C-Drag: Chain-of-Thought Driven Motion Controller for Video Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.