mlsanityData to 14 Oct 2026

MechVerse: Evaluating Physical Motion Consistency in Video Generation Models

arXiv 2605.14843 ↗First posted 14 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text- and image-conditioned video generation models have achieved strong visual fidelity and temporal coherence, but they often fail to generate motion governed by kinematic and geometric constraints. In these settings, object parts must remain rigid, maintain contact or coupling with neighboring components, and transfer motion consistently across connected parts. These requirements are especially explicit in articulated mechanical assemblies, where motion is constrained by rigid-link geometry, contact/coupling relations, and transmission through kinematic chains. A generated video may therefore appear plausible while violating the intended mechanism, such as rotating a part that should translate, deforming a rigid component, breaking coupling between parts, or failing to move downstream components. To evaluate this gap, We introduce MechVerse, a benchmark for mechanically consistent image-to-video generation. MechVerse contains 21,156 synthetic clips from 1,357 mechanical assemblies across 141 categories, organized into three tiers of increasing kinematic complexity: independent articulation, pairwise coupling, and densely coupled multi-part mechanisms. Each clip is paired with a structured prompt describing part identities, stationary supports, moving components, motion primitives, direction, speed/extent, and inter-part dependencies. We evaluate proprietary, open-source, and fine-tuned image-to-video models using standard video metrics, instruction-following scores, and human judgments of motion correctness and kinematic coupling. Results show that current models can preserve appearance and smoothness while failing to generate mechanically admissible motion, with errors increasing as coupling complexity grows. MechVerse provides a benchmark for measuring and improving mechanism-aware video generation from image and language inputs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

39 of 46 references.

References · 39

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  7. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  10. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  11. 2023ModelScope Text-to-Video Technical Reportcited by 658
  12. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
27 more
  1. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  2. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  3. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  4. 2023Learning Interactive Real-World Simulatorscited by 458
  5. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  6. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  7. 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 250
  8. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  9. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  10. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  11. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  12. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  13. 2025Do generative video models understand physical principles?cited by 161
  14. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
  15. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
  16. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  17. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
  18. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
  19. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
  20. 2020The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Posecited by 95
  21. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  22. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 80
  23. 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 48
  24. 2022Differentiable Physics Simulation of Dynamics-Augmented Neural Objectscited by 45
  25. 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
  26. 2024IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videoscited by 12
  27. 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2

Built on by

Not cited yet.