MindWorldBench: Evaluating Mental-State-to-Behavior Reasoning in Image-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Current image-to-video models achieve visual realism and physical plausibility, but reasoning about mental states remains unexplored. Actions are driven by belief, desire, and perception, requiring inference beyond explicit instructions. We introduce MindWorldBench to evaluate mental-state-conditioned video generation. We formalize this as mental-state-to-behavior reasoning, where models generate actions from a world state and latent variables without explicit action prompts. MindWorldBench utilizes Zero-Action Prompting and a counterfactual design with 744 prompts to isolate the causal effects of mental states. An automated pipeline evaluates video quality, commonsense plausibility, and mental-state consistency. Evaluations of 11 models show that despite visual fidelity and physical reasoning, models fail to align behaviors with latent mental states. We identify a failure mode, termed Omniscient Bias, where models default to the objective world state rather than human's subjective belief. These results demonstrate a disconnect between visual generation and cognitive reasoning, suggesting a need for explicit mental-state modeling in video generation systems. Project website: https://richard2049-lee.github.io/MindWorldBench/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
21 of 42 references.
References · 21
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
- 2023Evaluating Large Language Models in Theory of Mind Taskscited by 217
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 53
9 more
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
- 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
- 2025Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Modelcited by 25
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
- 2021On the Limits of Minimal Pairs in Contrastive Evaluationcited by 15
- 2024MoRAG -- Multi-Fusion Retrieval Augmented Generation for Human Motioncited by 11
- 2025MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mindcited by 11
- 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmarkcited by 10
- 2025R^3-VQA: "Read the Room" by Video Social Reasoningcited by 6
Built on by
Not cited yet.