mlsanityData to 14 Oct 2026

PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation

arXiv 2603.24078 ↗First posted 25 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We present PosterIQ, a design-driven benchmark for poster understanding and generation, annotated across composition structure, typographic hierarchy, and semantic intent. It includes 7,765 image-annotation instances and 822 generation prompts spanning real, professional, and synthetic cases. To bridge visual design cognition and generative modeling, we define tasks for layout parsing, text-image correspondence, typography/readability and font perception, design quality assessment, and controllable, composition-aware generation with metaphor. We evaluate state-of-the-art MLLMs and diffusion-based generators, finding persistent gaps in visual hierarchy, typographic semantics, saliency control, and intention communication; commercial models lead on high-level reasoning but act as insensitive automatic raters, while generators render text well yet struggle with composition-aware synthesis. Extensive analyses show PosterIQ is both a quantitative benchmark and a diagnostic tool for design reasoning, offering reproducible, task-specific metrics. We aim to catalyze models' creativity and integrate human-centred design principles into generative vision-language systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 39 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

30 of 39 references.

References · 30

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  8. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  9. 2025Qwen-Image Technical Reportcited by 1,044
  10. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  11. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  12. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
18 more
  1. 2021InfographicVQAcited by 437
  2. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  3. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
  4. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
  5. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
  6. 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 77
  7. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  8. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
  9. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  10. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 40
  11. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
  12. 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 16
  13. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
  14. 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
  15. 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLMcited by 14
  16. 2025ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotationscited by 10
  17. 2024FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applicationscited by 8
  18. 2024DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Modelscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
  2. 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typography
  3. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
  4. 2026Any2Poster: Any-Source Poster Generation Across Modalities and Domains
  5. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models
  6. 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
  7. 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design
  8. 2026Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs