mlsanityData to 14 Oct 2026

Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs

arXiv 2606.00592 ↗First posted 30 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Effective visual communication stems from the harmony of multiple design principles, such as readability, contrast, alignment, overlap, and coherence, which collectively govern clarity and intent of the communicator. While human designers reason holistically over these principles, machine agents typically condense them into a single heuristic score, offering limited interpretability and diagnostic precision. To address this gap, we introduce PRISM (PRinciple-aware, Interpretable, and Structure-guided Design Modifications), a benchmark that systematically perturbs professional layouts from the Crello dataset along measurable design principles. The benchmark comprises 100K perturbed training samples and 10K perturbed validation designs, each isolating a specific principle violation for controlled analysis of multimodal reasoning about design quality. We show that models like Qwen-2.5-VL and GPT-4o-mini are largely insensitive to targeted principle degradations, whereas GPT-4o exhibits global awareness without fine-grained disentanglement. Building on these insights, we propose a multi-scale evaluation framework that integrates lightweight scorers for quantitative assessment, instruction-tuned vision-language models for localised feedback, and prompt-based methods for global reasoning. Our framework provides interpretable explanations of design failures. Using these localised insights, we show targeted refinements that improve layout quality. Together, PRISM and our framework lay the foundation for interpretable design-literate multimodal reasoning systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 55 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

35 of 55 references.

References · 35

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  8. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  9. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  10. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  11. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  12. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
23 more
  1. 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 116
  2. 2023BuboGPT: Enabling Visual Grounding in Multi-Modal LLMscited by 114
  3. 2024A Thorough Examination of Decoding Methods in the Era of LLMscited by 114
  4. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  5. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
  6. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
  7. 2023Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Modelcited by 53
  8. 2023PG-Video-LLaVA: Pixel Grounding Large Video-Language Modelscited by 51
  9. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  10. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
  11. 2024Meerkat: Audio-Visual Large Language Model for Grounding in Space and Timecited by 26
  12. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
  13. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
  14. 2024Can GPTs Evaluate Graphic Design Based on Design Principles?cited by 14
  15. 2025MAGNET: A Multi-agent Framework for Finding Audio-Visual Needles by Reasoning over Multi-Video Haystackscited by 12
  16. 2024Demystifying Tacit Knowledge in Graphic Design: Characteristics, Instances, Approaches, and Guidelinescited by 10
  17. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
  18. 2023A Survey for Graphic Design Intelligencecited by 9
  19. 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Groundingcited by 7
  20. 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
  21. 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluationcited by 5
  22. 2024Design-o-meter: Towards Evaluating and Refining Graphic Designscited by 5
  23. 2025Agentic Design Review Systemcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
  2. 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
  3. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
  4. 2025Structured Visualization Design Knowledge for Grounding Generative Reasoning and Situated Feedback
  5. 2024DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models
  6. 2026DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generation
  7. 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Design
  8. 2025DesignerlyLoop: Forming Design Intent through Curated Reasoning for Human-LLM Alignment