mlsanityData to 14 Oct 2026

Envision: Benchmarking Unified Understanding & Generation for Causal World Process Insights

arXiv 2512.01816 ↗First posted 1 Dec 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Current multimodal models aim to transcend the limitations of single-modality representations by unifying understanding and generation, often using text-to-image (T2I) tasks to calibrate semantic consistency. However, their reliance on static, single-image generation in training and evaluation leads to overfitting to static pattern matching and semantic fusion, while fundamentally hindering their ability to model dynamic processes that unfold over time. To address these constraints, we propose Envision-a causal event progression benchmark for chained text-to-multi-image generation. Grounded in world knowledge and structured by spatiotemporal causality, it reorganizes existing evaluation dimensions and includes 1,000 four-stage prompts spanning six scientific and humanities domains. To transition evaluation from single images to sequential frames and assess whether models truly internalize world knowledge while adhering to causal-temporal constraints, we introduce Envision-Score, a holistic metric integrating multi-dimensional consistency, physicality, and aesthetics. Comprehensive evaluation of 15 models (10 specialized T2I models, 5 unified models) uncovers: specialized T2I models demonstrate proficiency in aesthetic rendering yet lack intrinsic world knowledge. Unified multimodal models bridge this gap, consistently outperforming specialized counterparts in causal narrative coherence. However, even these unified architectures remain subordinate to closed-source models and struggle to overcome the core challenge of spatiotemporal consistency. This demonstrates that a focus on causally-isolated single images impedes multi-frame reasoning and generation, promoting static pattern matching over dynamic world modeling-ultimately limiting world knowledge internalization, generation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 47 of its 49 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

47 of 49 references.

References · 47

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  9. 2025Qwen-Image Technical Reportcited by 1,044
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  11. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
35 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  2. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  5. 2023Learning Interactive Real-World Simulatorscited by 458
  6. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  7. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  8. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
  9. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  10. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  11. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  12. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  13. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  14. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  15. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
  16. 2025HunyuanImage 3.0 Technical Reportcited by 149
  17. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  18. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  19. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMscited by 96
  20. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
  21. 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 82
  22. 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
  23. 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 46
  24. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
  25. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
  26. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 37
  27. 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
  28. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 34
  29. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 32
  30. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 29
  31. 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Modelscited by 24
  32. 2025VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generationcited by 23
  33. 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 19
  34. 2025Science-T2I: Addressing Scientific Illusions in Image Synthesiscited by 15
  35. 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ISO-Bench: Benchmarking Multimodal Causal Reasoning in Visual-Language Models through Procedural Plans
  2. 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models
  3. 2026WorldCast: Exploring Intelligent Visual Generation in World State Prediction
  4. 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation
  5. 2025Bridging the Gap Between Multimodal Foundation Models and World Models
  6. 2026A Model-Internal Protocol for Assessing Multimodal Models as Integrated Systems
  7. 2026IMUG-Bench: Benchmarking Unified Multimodal Models on Interleaved Understanding and Generation
  8. 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?