mlsanityData to 7 Oct 2026

Qualitative Evaluation of LLM-Designed GUI

arXiv 2601.22759 ↗First posted 30 Jan 2026cs.HC cs.AI cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by analysing their ability to meet diverse user needs. The experiments included utilization of three state-of-the-art models from January 2025 (OpenAI GPT o3-mini-high, DeepSeek R1, and Anthropic Claude 3.5 Sonnet) generating mockups for three interface types: a chat system, a technical team panel, and a manager dashboard. Expert evaluations revealed that while LLMs are effective at creating structured layouts, they face challenges in meeting accessibility standards and providing interactive functionality. Further testing showed that LLMs could partially tailor interfaces for different user personas but lacked deeper contextual understanding. The results suggest that while LLMs are promising tools for early-stage UI prototyping, human intervention remains critical to ensure usability, accessibility, and user satisfaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 3 of its 18 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

3 of 18 references.

References · 3

  1. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
  2. 2023Low-code LLM: Graphical User Interface over Large Language Modelscited by 13
  3. 2024TextLap: Customizing Language Models for Text-to-Layout Planningcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Language Model-Brained GUI Agents: A Survey
  2. 2025GUIDE: LLM-Driven GUI Generation Decomposition for Automated Prototyping
  3. 2025Insights into User Interface Innovations from a Design Thinking Workshop at deRSE25
  4. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset
  5. 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback
  6. 2024Zero-Shot Prompting Approaches for LLM-based Graphical User Interface Generation
  7. 2024Human-Centered LLM-Agent User Interface: A Position Paper
  8. 2024GUI Agents with Foundation Models: A Comprehensive Survey