Generative Interfaces for Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response format that often makes interactions inefficient in multi-turn, information-dense, and exploratory tasks. To address these limitations, we propose Generative Interfaces for Language Models, a paradigm in which LLMs respond to user queries by proactively generating user interfaces (UIs) that enable more adaptive and interactive engagement. Our framework leverages structured interface-specific representations and iterative refinements to translate user queries into task-specific UIs. For systematic evaluation, we introduce a multidimensional assessment framework that compares generative interfaces with traditional chat-based ones across diverse tasks, interaction patterns, and query types, capturing functional, interactive, and emotional aspects of user experience. Results show that generative interfaces consistently outperform conversational ones, with up to a 72% improvement in human preference. These findings clarify when and why users favor generative interfaces, paving the way for future advancements in human-AI interaction. Data and code are available at https://github.com/SALT-NLP/GenUI.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
24 of 55 references.
References · 24
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 290
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
- 2023The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Developmentcited by 96
- 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 78
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
12 more
- 2023ClarifyGPT: Empowering LLM-based Code Generation with Intention Clarificationcited by 38
- 2024DynaVis: Dynamically Synthesized UI Widgets for Visualization Editingcited by 37
- 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototypingcited by 29
- 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 26
- 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
- 2019Sketch2code: Generating a website from a paper mockupcited by 20
- 2023Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responsescited by 18
- 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
- 2025The AI Gap: How Socioeconomic Status Affects Language Technology Interactionscited by 15
- 2024BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebookscited by 12
- 2020GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted Feedbackcited by 11
- 2024Graph4GUI: Graph Neural Networks for Representing Graphical User Interfacescited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generationcited by 4
- 2026Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRAcited by 1
- 2026EvoGenUI-Bench: Evaluating LLMs as Multi-Turn Generative UI Assistantscited by 1
- 2026How Researchers Navigate Accountability, Transparency, and Trust When Using AI Tools in Early-Stage Research: A Think-Aloud Studycited by 0
- 2026A Benchmarking Framework for Context-aware XR Interfacescited by 0
- 2026A Benchmarking Framework for Context-aware XR Interfaces24 Sep 2026
- 2026EvoGenUI-Bench: Evaluating LLMs as Multi-Turn Generative UI Assistants29 Aug 2026
- 2026Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA10 Aug 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026How Researchers Navigate Accountability, Transparency, and Trust When Using AI Tools in Early-Stage Research: A Think-Aloud Study25 Apr 2026
- 2025InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation10 Oct 2025