mlsanityData to 14 Oct 2026

Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model

arXiv 2609.18323 ↗First posted 16 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent Omni-Modal Generative Models (Omni-Models) have advanced content generation toward unified modeling of text, images, video, and audio. MiniMax-H3 exemplifies this transition by combining multimodal context understanding with joint audio-visual generation in a shared latent framework. Its unified architecture raises a fundamental question: Can multimodal alignment improve the model's world reasoning, and what new evaluation paradigms do omni-modal inputs enable? To investigate this question, this work introduces a comprehensive evaluation framework organized around four complementary dimensions of physical world reasoning. Unlike existing evaluation frameworks for video generation and world models, which are often constrained by limited input modalities and evaluation settings where prompts closely match the target video content, our evaluation is specifically designed to exploit the multimodal inputs of Omni-Model. We construct a diverse set of novel tasks that require models to integrate complementary information across modalities. Specifically, we consider four scenarios, including implicit prompts paired with multiple frames, audio-image, prefix-videos, and audio-video inputs. Every single modality provides only partial evidence about the underlying event, requiring the model to jointly reason over the complementary semantic cues to infer latent event states and future dynamics. Across 517 evaluation instances, MiniMax-H3 achieves an overall success rate of 41.97%. Video-based Decision Reasoning yields the highest success rate at 56.00%, while Audio-based Disambiguation Reasoning is the weakest, reaching only 27.40%. These results indicate that effective multimodal integration remains key to fully exploiting the benefits of diverse input modalities. The project is available at https://github.com/gulucaptain/MiniMax-H3-Reason.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

40 of 47 references.

References · 40

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  5. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  6. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  7. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  8. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  9. 2025Video models are zero-shot learners and reasonerscited by 220
  10. 2025Do generative video models understand physical principles?cited by 161
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  12. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
28 more
  1. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  2. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
  3. 2025Baichuan-Omni-1.5 Technical Reportcited by 111
  4. 2025Ola: Pushing the Frontiers of Omni-Modal Language Modelcited by 83
  5. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  6. 2025HumanOmniV2: From Understanding to Omni-Modal Reasoning with Contextcited by 55
  7. 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
  8. 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 43
  9. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
  10. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 26
  11. 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 22
  12. 2023MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editingcited by 21
  13. 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 21
  14. 2025On Path to Multimodal Generalist: General-Level and General-Benchcited by 19
  15. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 19
  16. 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
  17. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
  18. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
  19. 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 12
  20. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
  21. 2026RISE-Video: Can Video Generators Decode Implicit World Rules?cited by 10
  22. 2026Do Joint Audio-Video Generation Models Understand Physics?cited by 8
  23. 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animationcited by 7
  24. 2026CameraNoise: Enabling Faithful Camera Control in Video Diffusion through Geometry-Flow-Guided Noise Warpingcited by 4
  25. 2026HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alonecited by 4
  26. 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Trainingcited by 2
  27. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 2
  28. 2026Thinking in Video: Can Video Generators Really Reason About the Real World?cited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Omni-Judge: Can Omni-LLMs Serve as Human-Aligned Judges for Text-Conditioned Audio-Video Generation?
  2. 2024OmniBench: Towards The Future of Universal Omni-Language Models
  3. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  4. 2026Toward Native Multimodal Modeling: A Roadmap
  5. 2024OmnixR: Evaluating Omni-modality Language Models on Reasoning across Modalities
  6. 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
  7. 2026The Trinity of Consistency as a Defining Principle for General World Models
  8. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities