mlsanityData to 7 Oct 2026

WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation

arXiv 2505.01490 ↗First posted 2 May 2025cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing semantically accurate, coherent, and contextually appropriate images in real-world scenarios. To address this gap, we introduce WorldGenBench, a benchmark designed to systematically evaluate T2I models' world knowledge grounding and implicit inferential capabilities, covering both the humanities and nature domains. We propose the Knowledge Checklist Score, a structured metric that measures how well generated images satisfy key semantic expectations. Experiments across 21 state-of-the-art models reveal that while diffusion models lead among open-source methods, proprietary auto-regressive models like GPT-4o exhibit significantly stronger reasoning and knowledge integration. Our findings highlight the need for deeper understanding and inference capabilities in next-generation T2I systems. Project Page: hrefhttps://dwanzhang-ai.github.io/WorldGenBench/https://dwanzhang-ai.github.io/WorldGenBench/

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 2 May 2025.

Builds on

15 of 24 references.

References · 15

  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  3. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  5. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  6. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  7. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  8. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  9. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  10. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
  11. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  12. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
3 more
  1. 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 85
  2. 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
  3. 2024Bridging SFT and DPO for Diffusion Model Alignment with Self-Sampling Preference Optimizationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 11.

20 papers.

Sort:

By area:

  1. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  2. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
  3. 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
  4. 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
  5. 2026Qwen-Image-Bench: From Generation to Creation in Text-to-Image Evaluationcited by 16
  6. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
  7. 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 11
  8. 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generationcited by 7
  9. 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 6
  10. 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editingcited by 5
  11. 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
  12. 2025World-To-Image: Grounding Text-to-Image Generation with Agent-Driven World Knowledgecited by 4
8 more
  1. 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
  2. 2026ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generationcited by 3
  3. 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
  4. 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Modelscited by 1
  5. 2026GeoR-Bench: Evaluating Geoscience Visual Reasoningcited by 0
  6. 2026DriveCtrl: Conditioned Sim-to-Real Driving Video Generationcited by 0
  7. 2026Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Modelscited by 0
  8. 2026Panoptic Scene Program Diffusion Transformercited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
  2. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
  3. 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generation
  4. 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning
  5. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
  6. 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
  7. 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoning
  8. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation