MechVerse: Evaluating Physical Motion Consistency in Video Generation Models
Not on the map. Why?
Abstract (arXiv)
Text- and image-conditioned video generation models have achieved strong visual fidelity and temporal coherence, but they often fail to generate motion governed by kinematic and geometric constraints. In these settings, object parts must remain rigid, maintain contact or coupling with neighboring components, and transfer motion consistently across connected parts. These requirements are especially explicit in articulated mechanical assemblies, where motion is constrained by rigid-link geometry, contact/coupling relations, and transmission through kinematic chains. A generated video may therefore appear plausible while violating the intended mechanism, such as rotating a part that should translate, deforming a rigid component, breaking coupling between parts, or failing to move downstream components. To evaluate this gap, We introduce MechVerse, a benchmark for mechanically consistent image-to-video generation. MechVerse contains 21,156 synthetic clips from 1,357 mechanical assemblies across 141 categories, organized into three tiers of increasing kinematic complexity: independent articulation, pairwise coupling, and densely coupled multi-part mechanisms. Each clip is paired with a structured prompt describing part identities, stationary supports, moving components, motion primitives, direction, speed/extent, and inter-part dependencies. We evaluate proprietary, open-source, and fine-tuned image-to-video models using standard video metrics, instruction-following scores, and human judgments of motion correctness and kinematic coupling. Results show that current models can preserve appearance and smoothness while failing to generate mechanically admissible motion, with errors increasing as coupling complexity grows. MechVerse provides a benchmark for measuring and improving mechanism-aware video generation from image and language inputs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
39 of 46 references.
References · 39
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
27 more
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 250
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2025Do generative video models understand physical principles?cited by 161
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2020The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Posecited by 95
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 80
- 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 48
- 2022Differentiable Physics Simulation of Dynamics-Augmented Neural Objectscited by 45
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2024IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videoscited by 12
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
Built on by
Not cited yet.