Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliability in knowledge-intensive settings remains largely unexplored. Unlike natural image generation, knowledge visualization requires not only semantic alignment but also strict adherence to domain knowledge, structural constraints, and symbolic conventions, exposing a critical gap between visual plausibility and scientific correctness. To systematically study this problem, we introduce KVBench, a curriculum-grounded benchmark for evaluating knowledge-intensive T2I generation. KVBench covers six senior high-school subjects: Biology, Chemistry, Geography, History, Mathematics, and Physics. The benchmark consists of 1,800 expert-curated prompts derived from over 30 authoritative textbooks. Using this benchmark, we evaluate 14 state-of-the-art open- and closed-source models, revealing substantial deficiencies in logical reasoning, symbolic precision, and multilingual robustness, with open-source models consistently underperforming proprietary systems. To address these limitations, we further propose KE-Check, a two-stage framework that improves scientific fidelity via (1) Knowledge Elaboration for structured prompt enrichment, and (2) Checklist-Guided Refinement for explicit constraint enforcement through violation identification and constraint-guided editing. KE-Check effectively mitigates scientific hallucinations, narrowing the performance gap between open-source and leading closed-source models. Data and codes are publicly available at https://github.com/zhaoran66/KVBench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 52 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
27 of 52 references.
References · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
15 more
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2019PlotQA: Reasoning over Scientific Plotscited by 321
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 155
- 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 94
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 87
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 73
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2023BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Modelscited by 41
- 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
- 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligencecited by 23
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 23
- 2026Think-Then-Generate: Reasoning-Aware Text-to-Image Diffusion with LLM Encoderscited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
- 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models
- 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation
- 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generation
- 2026Evaluating Reasoning Fidelity in Visual Text Generation
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visuals