Design-o-meter: Towards Evaluating and Refining Graphic Designs
Not on the map. Why?
Abstract (arXiv)
Graphic designs are an effective medium for visual communication. They range from greeting cards to corporate flyers and beyond. Off-late, machine learning techniques are able to generate such designs, which accelerates the rate of content production. An automated way of evaluating their quality becomes critical. Towards this end, we introduce Design-o-meter, a data-driven methodology to quantify the goodness of graphic designs. Further, our approach can suggest modifications to these designs to improve its visual appeal. To the best of our knowledge, Design-o-meter is the first approach that scores and refines designs in a unified framework despite the inherent subjectivity and ambiguity of the setting. Our exhaustive quantitative and qualitative analysis of our approach against baselines adapted for the task (including recent Multimodal LLM-based approaches) brings out the efficacy of our methodology. We hope our work will usher more interest in this important and pragmatic problem setting.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 57 references that are in the map. First posted on arXiv 22 Nov 2024.
Builds on
23 of 57 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 301
- 2016Photo Aesthetics Ranking Network with Attributes and Content Adaptationcited by 122
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
11 more
- 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 60
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
- 2024Graphic Design with Large Multimodal Modelcited by 38
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
- 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
- 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
- 2023Emotionally Enhanced Talking Face Generationcited by 14
- 2024Can GPTs Evaluate Graphic Design Based on Design Principles?cited by 14
- 2024Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Modelscited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Designcited by 2
- 2025Agentic Design Review Systemcited by 2
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvementcited by 0
- 2026Towards Design Compositingcited by 0
- 2026Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designscited by 0
- 2026Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs30 May 2026
- 2026Towards Design Compositing16 Apr 2026
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvement16 Jan 2026
- 2025Agentic Design Review System14 Aug 2025
- 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Design24 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design
- 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
- 2024DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models
- 2026DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generation
- 2026GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Design
- 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
- 2024Generative Visual Communication in the Era of Vision-Language Models