MenuCraft: Interactive Menu System Design with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Menu system design for user interfaces is a challenging task involving many design options and various human factors. For example, one crucial factor that designers need to consider is the semantic and systematic relation of menu commands. However, capturing these relations can be challenging due to limited available resources. Large language models can be helpful in this regard, using their pre-training knowledge to design and refine menu systems. In this paper, we propose MenuCraft, an AI-assisted designer for menu design that enables collaboration between the designer and a dialogue system to design menus. MenuCraft offers an interactive language-based menu design tool that simplifies the menu design process and enables easy customization of design options. MenuCraft supports a variety of interactions through dialog that allows performing in-context learning.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 8 Mar 2023.
Builds on
16 of 38 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
- 2020Widget Captioning: Generating Natural Language Description for Mobile User Interface Elementscited by 94
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2021Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixelscited by 57
- 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
4 more
- 2022LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexiacited by 27
- 2021Toward AI Assistants That Let Designers Designcited by 6
- 2018Predicting Human Performance in Vertical Menu Selection Using Deep Learningcited by 4
- 2020Foraging-based Optimization of Menu Systemscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 2.
4 papers.
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communicationcited by 1
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Designcited by 0
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design18 Nov 2025
- 2025GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication15 Feb 2025
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code14 Nov 2023
- 2023UI Layout Generation with LLMs Guided by UI Grammar24 Oct 2023