WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing semantically accurate, coherent, and contextually appropriate images in real-world scenarios. To address this gap, we introduce WorldGenBench, a benchmark designed to systematically evaluate T2I models' world knowledge grounding and implicit inferential capabilities, covering both the humanities and nature domains. We propose the Knowledge Checklist Score, a structured metric that measures how well generated images satisfy key semantic expectations. Experiments across 21 state-of-the-art models reveal that while diffusion models lead among open-source methods, proprietary auto-regressive models like GPT-4o exhibit significantly stronger reasoning and knowledge integration. Our findings highlight the need for deeper understanding and inference capabilities in next-generation T2I systems. Project Page: hrefhttps://dwanzhang-ai.github.io/WorldGenBench/https://dwanzhang-ai.github.io/WorldGenBench/
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 2 May 2025.
Builds on
15 of 24 references.
References · 15
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
3 more
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2024Bridging SFT and DPO for Diffusion Model Alignment with Self-Sampling Preference Optimizationcited by 8
Built on by
Citing papers per year: 2025: 9; 2026: 11.
20 papers.
Sort:
By area:
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 11
- 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generationcited by 7
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 6
- 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editingcited by 5
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
- 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledgecited by 4
8 more
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
- 2026ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generationcited by 3
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
- 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Modelscited by 1
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoningcited by 0
- 2026DriveCtrl: Conditioned Sim-to-Real Driving Video Generationcited by 0
- 2026Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Modelscited by 0
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2026Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Models2 Sep 2026
- 2026ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation5 Aug 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation27 May 2026
- 2026DriveCtrl: Conditioned Sim-to-Real Driving Video Generation14 May 2026
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoning12 May 2026
- 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation26 Mar 2026
- 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing12 Mar 2026
- 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models4 Mar 2026
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models2 Jan 2026
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation16 Dec 2025
8 more
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning10 Dec 2025
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models23 Nov 2025
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation3 Nov 2025
- 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledge5 Oct 2025
- 2025GenExam: A Multidisciplinary Text-to-Image Exam17 Sep 2025
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation24 Jul 2025
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation9 Jun 2025
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities5 May 2025
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 11
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 6
- 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editingcited by 5
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoningcited by 0
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoning12 May 2026
- 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing12 Mar 2026
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation16 Dec 2025
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learning10 Dec 2025
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
- 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generationcited by 7
- 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledgecited by 4
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
- 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Modelscited by 1
- 2026DriveCtrl: Conditioned Sim-to-Real Driving Video Generationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Models2 Sep 2026
- 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluation27 May 2026
- 2026DriveCtrl: Conditioned Sim-to-Real Driving Video Generation14 May 2026
- 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation26 Mar 2026
- 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models4 Mar 2026
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models2 Jan 2026
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models23 Nov 2025
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation3 Nov 2025
- 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledge5 Oct 2025
- 2025GenExam: A Multidisciplinary Text-to-Image Exam17 Sep 2025
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation24 Jul 2025
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation9 Jun 2025
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
- 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generation
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning
- 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
- 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
- 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoning
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation