mlsanityData to 14 Oct 2026

MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos

arXiv 2609.37030 ↗First posted 29 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite rapid progress in video generation models, they still exhibit obvious motion deficiencies, often manifested as incorrect object motion. However, most existing video quality evaluations focus on aesthetic quality or text-video alignment. To address this gap, we study object-centric motion fidelity assessment, evaluating target objects along object consistency, motion continuity, and physical plausibility. To achieve this, we first introduce VidMotion, a diagnostic dataset of 6,879 videos with designated moving objects and fine-grained annotations including dimension-wise scores and failure causes. We further propose MotionInsight, a diagnostic evaluator that shifts assessment from implicit RGB-frame observation to explicit motion-space diagnosis. By constructing motion-aware representations, MotionInsight makes subtle motion deficiencies more observable. We also introduce motion-specific rewards during GRPO to transform observed motion into a diagnostic assessment. Experiments demonstrate that MotionInsight provides an effective basis for diagnosing object motion deficiencies, producing human-aligned scores along three dimensions and grounded explanations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

27 of 34 references.

References · 27

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  4. 2025VACE: All-in-One Video Creation and Editingcited by 479
  5. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
  6. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  7. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  8. 2025Video models are zero-shot learners and reasonerscited by 220
  9. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  10. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  11. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  12. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
15 more
  1. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
  2. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  3. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  4. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  5. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
  6. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
  7. 2019The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object Segmentationcited by 97
  8. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 90
  9. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
  10. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
  11. 2020A Comparative Evaluation of Temporal Pooling Methods for Blind Video Quality Assessmentcited by 22
  12. 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 14
  13. 2026PerpetualWonder: Long-Horizon Action-Conditioned 4D Scene Generationcited by 9
  14. 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazingcited by 9
  15. 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Benchcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MotionSight: Boosting Fine-Grained Motion Understanding in Multimodal LLMs
  2. 2026HuM-Eval: A Coarse-to-Fine Framework for Human-Centric Video Evaluation
  3. 2026RigidBench: Evaluating Rigid-Body Physics in Video Generation Models
  4. 2025Physics-Guided Motion Loss for Video Generation Model
  5. 2025Temporal Realism Evaluation of Generated Videos Using Compressed-Domain Motion Vectors
  6. 2025ReVision: Refining Video Diffusion with Explicit 3D Motion Modeling
  7. 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos
  8. 2026MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning