Efficient Personalization of Generative User Interfaces
Not on the map. Why?
Abstract (arXiv)
Generative user interfaces (GenUIs) create new opportunities to adapt interfaces to individual users on demand. Yet personalization is difficult because it is not possible to provide settings for screens that have not yet been generated, making it necessary to learn preferences from users' feedback on generated interfaces. Such feedback is sparse, subjective, and often difficult to articulate. We study this problem through a new dataset in which 20 participants each judge the same 600 pairs of GenUIs. Their judgments differ substantially (Krippendorff's alpha = 0.25), and written rationales show that even when participants consider similar UI properties, such as color tone or hierarchy, they often make different choices and prioritize them differently. We develop a sample-efficient personalization method that uses a few pairwise judgments to weight prior users' preferences rather than relying on a fixed rubric of UI attributes. Our method outperforms a pretrained UI evaluator and a larger multimodal model offline. In an online study with 12 new users, participants preferred interfaces personalized by our method over all baselines, including shared guidelines and users' own written preferences.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 57 of its 115 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
57 of 115 references.
References · 57
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2024Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learningcited by 147
- 2023Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHFcited by 125
- 2024Personalized Language Modeling from Personalized Human Feedbackcited by 124
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
38 more
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 114
- 2024Can LLM be a Personalized Judge?cited by 99
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 60
- 2024RMB: Comprehensively Benchmarking Reward Models in LLM Alignmentcited by 60
- 2022Personalized Image Aesthetics Assessment with Rich Attributescited by 56
- 2023WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semanticscited by 45
- 2021VINS: Visual Search for Mobile User Interface Designcited by 37
- 2024Scalable Ranked Preference Optimization for Text-to-Image Generationcited by 33
- 2024User Embedding Model for Personalized Language Promptingcited by 28
- 2025From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignmentcited by 28
- 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 26
- 2024Transparent and Scrutable Recommendations Using Natural Language User Profilescited by 24
- 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 24
- 2024Generating Automatic Feedback on UI Mockups with Large Language Modelscited by 23
- 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
- 2025Morae: Proactively Pausing UI Agents for User Choicescited by 18
- 2018Ordered Preference Elicitation Strategies for Supporting Multi-Objective Decision Makingcited by 17
- 2025LAPIS: A novel dataset for personalized image aesthetic assessmentcited by 16
- 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 15
- 2025PrefPalette: Personalized Preference Modeling with Latent Attributescited by 15
- 2024UIClip: A Data-driven Model for Assessing User Interface Designcited by 14
- 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignmentcited by 14
- 2025MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfacescited by 11
- 2025AesBiasBench: Evaluating Bias and Alignment in Multimodal Language Models for Personalized Image Aesthetic Assessmentcited by 10
- 2021Say It All: Feedback for Improving Non-Visual Presentation Accessibilitycited by 9
- 2025CodeA11y: Making AI Coding Assistants Useful for Accessible Web Developmentcited by 8
- 2025CoPL: Collaborative Preference Learning for Personalizing LLMscited by 8
- 2025Capturing Individual Human Preferences with Reward Featurescited by 8
- 2025Malleable Overview-Detail Interfacescited by 7
- 2025PrefDisco: Benchmarking Proactive Personalized Reasoningcited by 7
- 2025DesignPref: Capturing Personal Preferences in Visual Design Generationcited by 6
- 2026Reaching Beyond the Mode: RL for Distributional Reasoning in Language Modelscited by 6
- 2023FeedbackMap: a tool for making sense of open-ended survey responsescited by 4
- 2024LRHP: Learning Representations for Human Preferences via Preference Pairscited by 4
- 2025Inference-Time Personalized Alignment with a Few User Preference Queriescited by 4
- 2026GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Taskscited by 4
- 2024Minimizing Live Experiments in Recommender Systems: User Simulation to Evaluate Preference Elicitation Policiescited by 3
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.