mlsanityData to 14 Oct 2026

UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools

arXiv 2508.20410 ↗First posted 28 Aug 2025cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

AI text-to-app tools promise high quality applications and websites in minutes, yet no public benchmark rigorously verifies those claims. We introduce UI-Bench, the first large-scale benchmark that evaluates visual excellence across competing AI text-to-app tools through expert pairwise comparison. Spanning 10 tools, 30 prompts, 300 generated sites, and 4,000+ expert judgments, UI-Bench ranks systems with a TrueSkill-derived model that yields calibrated confidence intervals. UI-Bench establishes a reproducible standard for advancing AI-driven web design. We release (i) the complete prompt set, (ii) an open-source evaluation framework, and (iii) a public leaderboard. The generated sites rated by participants will be released soon. View the UI-Bench leaderboard at https://uibench.ai/leaderboard.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

25 of 44 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  7. 2017Deep reinforcement learning from human preferencescited by 3,912
  8. 2016Improved Techniques for Training GANscited by 2,970
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  10. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  11. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  12. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
13 more
  1. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  2. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
  3. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  4. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
  5. 2023Holistic Evaluation of Text-To-Image Modelscited by 160
  6. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  7. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 72
  8. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 45
  9. 2024WebCode2M: A Real-World Dataset for Code Generation from Webpage Designscited by 44
  10. 2025FinanceQA: A Benchmark for Evaluating Financial Analysis Capabilities of Large Language Modelscited by 19
  11. 2018Do we agree on user interface aesthetics of Android apps?cited by 3
  12. 2018How Content Volume on Landing Pages Influences Consumer Behaviorcited by 2
  13. 2019A gradual approach for maximising user conversion without compromising experience with high visual intensity website elementscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspectivecited by 6
  2. 2026Cookie-Bench: Continuous On-screen Key Interaction Evaluation for Web Generationcited by 3
  3. 2026AUV-Bench: Aesthetic Understanding and Generation Evaluation for User Interfacescited by 0