Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
Not on the map. Why?
Abstract (arXiv)
We introduce GraphicDesignBench (GDB), the first comprehensive benchmark suite designed specifically to evaluate AI models on the full breadth of professional graphic design tasks. Unlike existing benchmarks that focus on natural-image understanding or generic text-to-image synthesis, GDB targets the unique challenges of professional design work: translating communicative intent into structured layouts, rendering typographically faithful text, manipulating layered compositions, producing valid vector graphics, and reasoning about animation. The suite comprises 50 tasks organized along five axes: layout, typography, infographics, template & design semantics and animation, each evaluated under both understanding and generation settings, and grounded in real-world design templates drawn from the LICA layered-composition dataset. We evaluate a set of frontier closed-source models using a standardized metric taxonomy covering spatial accuracy, perceptual quality, text fidelity, semantic alignment, and structural validity. Our results reveal that current models fall short on the core challenges of professional design: spatial reasoning over complex layouts, faithful vector code generation, fine-grained typographic perception, and temporal decomposition of animations remain largely unsolved. While high-level semantic understanding is within reach, the gap widens sharply as tasks demand precision, structure, and compositional awareness. GDB provides a rigorous, reproducible testbed for tracking progress toward AI systems that can function as capable design collaborators. The full evaluation framework is publicly available.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Apr 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysiscited by 1
- 2026DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editablecited by 1
- 2026Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluationcited by 1
- 2026Evaluating Design Video Generation: Metrics for Compositional Fidelitycited by 0
- 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Designcited by 0
- 2026GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Designcited by 0
- 2026Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation3 Sep 2026
- 2026GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Design2 Sep 2026
- 2026DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable1 Aug 2026
- 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design20 May 2026
- 2026Evaluating Design Video Generation: Metrics for Compositional Fidelity15 May 2026
- 2026Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents
- 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
- 2024DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models
- 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
- 2026LICA: Layered Image Composition Annotations for Graphic Design Research
- 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generation
- 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design
- 2026AECV-Bench: Benchmarking Multimodal Models on Architectural and Engineering Drawings Understanding