BizGenEval: A Systematic Benchmark for Commercial Visual Content Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in image generation models have expanded their applications beyond aesthetic imagery toward practical visual content creation. However, existing benchmarks mainly focus on natural image synthesis and fail to systematically evaluate models under the structured and multi-constraint requirements of real-world commercial design tasks. In this work, we introduce BizGenEval, a systematic benchmark for commercial visual content generation. The benchmark spans five representative document types: slides, charts, webpages, posters, and scientific figures, and evaluates four key capability dimensions: text rendering, layout control, attribute binding, and knowledge-based reasoning, forming 20 diverse evaluation tasks. BizGenEval contains 400 carefully curated prompts and 8000 human-verified checklist questions to rigorously assess whether generated images satisfy complex visual and semantic constraints. We conduct large-scale benchmarking on 26 popular image generation systems, including state-of-the-art commercial APIs and leading open-source models. The results reveal substantial capability gaps between current generative models and the requirements of professional visual content creation. We hope BizGenEval serves as a standardized benchmark for real-world commercial visual content generation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
27 of 43 references.
References · 27
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
15 more
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025LongCat-Image Technical Reportcited by 92
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 81
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
- 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generationcited by 20
- 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
- 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 18
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoningcited by 14
- 2026IGenBench: Benchmarking the Reliability of Text-to-Infographic Generationcited by 14
- 2023Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generationcited by 13
- 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 9
- 2026SlidesGen-Bench: Evaluating Slides Generation via Computational and Quantitative Metricscited by 8
- 20257Bench: a Comprehensive Benchmark for Layout-guided Text-to-image Modelscited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
- 2026PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmarkcited by 3
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 3
- 2026VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generationcited by 1
- 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I modelscited by 0
- 2026ReDeck: Step-Level Render-Grounded Refinement for Document-to-Slide Generationcited by 0
- 2026UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generationcited by 0
- 2026UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation7 Oct 2026
- 2026VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation1 Oct 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026ReDeck: Step-Level Render-Grounded Refinement for Document-to-Slide Generation31 Aug 2026
- 2026PosterHarness: Turning Scientific Poster Generation into an Auditable Instruction-Following Benchmark3 Jul 2026
- 2026Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models4 Jun 2026
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture12 May 2026