mlsanityData to 7 Oct 2026

The role of large language models in UI/UX design: A systematic literature review

arXiv 2507.04469 ↗First posted 6 Jul 2025cs.HC cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

This systematic literature review examines the role of large language models (LLMs) in UI/UX design, synthesizing findings from 38 peer-reviewed studies published between 2022 and 2025. We identify key LLMs in use, including GPT-4, Gemini, and PaLM, and map their integration across the design lifecycle, from ideation to evaluation. Common practices include prompt engineering, human-in-the-loop workflows, and multimodal input. While LLMs are reshaping design processes, challenges such as hallucination, prompt instability, and limited explainability persist. Our findings highlight LLMs as emerging collaborators in design, and we propose directions for the ethical, inclusive, and effective integration of these technologies.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 84 references that are in the map. First posted on arXiv 6 Jul 2025.

Builds on

21 of 84 references.

References · 21

  1. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  2. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  3. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  4. 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 163
  5. 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
  6. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
  7. 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 71
  8. 2021VINS: Visual Search for Mobile User Interface Designcited by 37
  9. 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
  10. 2023VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planningcited by 28
  11. 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
  12. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
9 more
  1. 2019Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learningcited by 18
  2. 2023PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers' Workflowscited by 8
  3. 2024AI Assistance for UX: A Literature Review Through Human-Centered AIcited by 7
  4. 2020Optimizing User Interface Layouts via Gradient Descentcited by 6
  5. 2024Interlinking User Stories and GUI Prototyping: A Semi-Automatic LLM-based Approachcited by 5
  6. 2024On AI-Inspired UI-Designcited by 4
  7. 2020BlackBox Toolkit: Intelligent Assistance to UI Designcited by 2
  8. 2024In Situ AI Prototyping: Infusing Multimodal Prompts into Mobile Settings with MobileMakercited by 2
  9. 2025The Influence of UX Design on User Retention and Conversion Rates in Mobile Appscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.