How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models
Not on the map. Why?
Abstract (arXiv)
Deep generative models have the potential to fundamentally change the way we create high-fidelity digital content but are often hard to control. Prompting a generative model is a promising recent development that in principle enables end-users to creatively leverage zero-shot and few-shot learning to assign new tasks to an AI ad-hoc, simply by writing them down. However, for the majority of end-users writing effective prompts is currently largely a trial and error process. To address this, we discuss the key opportunities and challenges for interactive creative applications that use prompting as a new paradigm for Human-AI interaction. Based on our analysis, we propose four design goals for user interfaces that support prompting. We illustrate these with concrete UI design sketches, focusing on the use case of creative writing. The research community in HCI and AI can take these as starting points to develop adequate user interfaces for models capable of zero- and few-shot learning.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 3 Sep 2022.
Builds on
17 of 24 references.
References · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 268
5 more
- 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
- 2018Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Contextcited by 113
- 2021What Context Features Can Transformer Language Models Use?cited by 50
- 2021SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasetscited by 18
- 2021Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2cited by 15
Built on by
Citing papers per year: 2022: 1; 2023: 10; 2024: 14; 2025: 14; 2026: 5.
44 papers.
Sort:
By area:
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 55
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
- 2024Bringing Generative AI to Adaptive Learning in Educationcited by 24
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
- 2023"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Modelscited by 17
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checkingcited by 12
- 2024Exploring Prompt Engineering Practices in the Enterprisecited by 11
- 2023An Evaluation of ChatGPT-4's Qualitative Spatial Reasoning Capabilities in RCC-8cited by 9
32 more
- 2024Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settingscited by 9
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examplescited by 5
- 2024Can Large Language Models Reason about the Region Connection Calculus?cited by 5
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 4
- 2023Trash to Treasure: Using text-to-image models to inform the design of physical artefactscited by 3
- 2023Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspectivecited by 3
- 2023Cases of EFL Secondary Students' Prompt Engineering Pathways to Complete a Writing Task with ChatGPTcited by 2
- 2025Use Me Wisely: AI-Driven Assessment for LLM Prompting Skills Developmentcited by 2
- 2025Large Language Models for Oral History Understanding with Text Classification and Sentiment Analysiscited by 2
- 2026"If You're Very Clever, No One Knows You've Used It": The Social Dynamics of Developing Generative AI Literacy in the Workplacecited by 2
- 2023Large Language Models Are Also Good Prototypical Commonsense Reasonerscited by 1
- 2024Offline Evaluation of Set-Based Text-to-Image Generationcited by 1
- 2024Generative AI in Medicinecited by 1
- 2025An Empirically-grounded tool for Automatic Prompt Linting and Repair: A Case Study on Bias, Vulnerability, and Optimization in Developer Promptscited by 1
- 2025Prompt Orchestration Markup Languagecited by 1
- 2025Synthetic Cognitive Walkthrough: Aligning Large Language Model Performance with Human Cognitive Walkthroughcited by 1
- 2024Selection of Prompt Engineering Techniques for Code Generation through Predicting Code Complexitycited by 0
- 2024Task-oriented Prompt Enhancement via Script Generationcited by 0
- 2024Key Algorithms for Keyphrase Generation: Instruction-Based LLMs for Russian Scientific Keyphrasescited by 0
- 2025Actionable AI: Enabling Non Experts to Understand and Configure AI Systemscited by 0
- 2025Automated Meta Prompt Engineering for Alignment with the Theory of Mindcited by 0
- 2025"I made this (sort of)": Negotiating authorship, confronting fraudulence, and exploring new musical spaces with prompt-based AI music generationcited by 0
- 2025Match Chat: Real Time Generative AI and Generative Computing for Tenniscited by 0
- 2025PromptPilot: Improving Human-AI Collaboration Through LLM-Enhanced Prompt Engineeringcited by 0
- 2025PustakAI: Curriculum-Aligned and Interactive Textbooks Using Large Language Modelscited by 0
- 2025AutoICE: Automatically Synthesizing Verifiable C Code via LLM-driven Evolutioncited by 0
- 2026Rewriting Video: Text-Driven Reauthoring of Video Footagecited by 0
- 2026I wanted it to feel more personal: Customization of social AI as AI individualism in practicecited by 0
- 2026Beyond the Payload: How User Invocation Shapes Coding Agent Vulnerability to Repository Poisoningcited by 0
- 2026Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimizationcited by 0
- 2026Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization10 Oct 2026
- 2026Beyond the Payload: How User Invocation Shapes Coding Agent Vulnerability to Repository Poisoning31 Aug 2026
- 2026I wanted it to feel more personal: Customization of social AI as AI individualism in practice20 Jul 2026
- 2026"If You're Very Clever, No One Knows You've Used It": The Social Dynamics of Developing Generative AI Literacy in the Workplace1 Feb 2026
- 2026Rewriting Video: Text-Driven Reauthoring of Video Footage13 Jan 2026
- 2025AutoICE: Automatically Synthesizing Verifiable C Code via LLM-driven Evolution8 Dec 2025
- 2025Synthetic Cognitive Walkthrough: Aligning Large Language Model Performance with Human Cognitive Walkthrough3 Dec 2025
- 2025PustakAI: Curriculum-Aligned and Interactive Textbooks Using Large Language Models13 Nov 2025
- 2025PromptPilot: Improving Human-AI Collaboration Through LLM-Enhanced Prompt Engineering1 Oct 2025
- 2025Match Chat: Real Time Generative AI and Generative Computing for Tennis16 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
- 2025Prompt Orchestration Markup Language19 Aug 2025
32 more
- 2025Large Language Models for Oral History Understanding with Text Classification and Sentiment Analysis8 Aug 2025
- 2025"I made this (sort of)": Negotiating authorship, confronting fraudulence, and exploring new musical spaces with prompt-based AI music generation31 Jul 2025
- 2025Automated Meta Prompt Engineering for Alignment with the Theory of Mind13 May 2025
- 2025Actionable AI: Enabling Non Experts to Understand and Configure AI Systems9 Mar 2025
- 2025Use Me Wisely: AI-Driven Assessment for LLM Prompting Skills Development4 Mar 2025
- 2025An Empirically-grounded tool for Automatic Prompt Linting and Repair: A Case Study on Bias, Vulnerability, and Optimization in Developer Prompts21 Jan 2025
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checking18 Jan 2025
- 2024Generative AI in Medicine13 Dec 2024
- 2024Can Large Language Models Reason about the Region Connection Calculus?29 Nov 2024
- 2024Key Algorithms for Keyphrase Generation: Instruction-Based LLMs for Russian Scientific Keyphrases23 Oct 2024
- 2024Offline Evaluation of Set-Based Text-to-Image Generation22 Oct 2024
- 2024Task-oriented Prompt Enhancement via Script Generation24 Sep 2024
- 2024Selection of Prompt Engineering Techniques for Code Generation through Predicting Code Complexity24 Sep 2024
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness3 Jul 2024
- 2024When Search Engine Services meet Large Language Models: Visions and Challenges28 Jun 2024
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses7 Jun 2024
- 2024Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settings27 May 2024
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examples24 Apr 2024
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedback17 Apr 2024
- 2024Exploring Prompt Engineering Practices in the Enterprise13 Mar 2024
- 2024Bringing Generative AI to Adaptive Learning in Education2 Feb 2024
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape18 Dec 2023
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agent9 Oct 2023
- 2023An Evaluation of ChatGPT-4's Qualitative Spatial Reasoning Capabilities in RCC-827 Sep 2023
- 2023Large Language Models Are Also Good Prototypical Commonsense Reasoners22 Sep 2023
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolution21 Sep 2023
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data26 Jul 2023
- 2023"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models20 Jul 2023
- 2023Cases of EFL Secondary Students' Prompt Engineering Pathways to Complete a Writing Task with ChatGPT19 Jun 2023
- 2023Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective1 Jun 2023
- 2023Trash to Treasure: Using text-to-image models to inform the design of physical artefacts1 Feb 2023
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Models18 Sep 2022
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agentcited by 34
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examplescited by 5
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulnesscited by 4
- 2026Beyond the Payload: How User Invocation Shapes Coding Agent Vulnerability to Repository Poisoningcited by 0
- 2026Beyond the Payload: How User Invocation Shapes Coding Agent Vulnerability to Repository Poisoning31 Aug 2026
- 2024Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness3 Jul 2024
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examples24 Apr 2024
- 2023CoQuest: Exploring Research Question Co-Creation with an LLM-based Agent9 Oct 2023
- 2024Bringing Generative AI to Adaptive Learning in Educationcited by 24
- 2024Bringing Generative AI to Adaptive Learning in Education2 Feb 2024
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 55
- 2023"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Modelscited by 17
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2025Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checkingcited by 12
- 2024Exploring Prompt Engineering Practices in the Enterprisecited by 11
- 2024Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settingscited by 9
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
- 2023Trash to Treasure: Using text-to-image models to inform the design of physical artefactscited by 3
12 most cited of 34 All 34 (JSON)
- 2026Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization10 Oct 2026
- 2026I wanted it to feel more personal: Customization of social AI as AI individualism in practice20 Jul 2026
- 2026"If You're Very Clever, No One Knows You've Used It": The Social Dynamics of Developing Generative AI Literacy in the Workplace1 Feb 2026
- 2026Rewriting Video: Text-Driven Reauthoring of Video Footage13 Jan 2026
- 2025AutoICE: Automatically Synthesizing Verifiable C Code via LLM-driven Evolution8 Dec 2025
- 2025PustakAI: Curriculum-Aligned and Interactive Textbooks Using Large Language Models13 Nov 2025
- 2025PromptPilot: Improving Human-AI Collaboration Through LLM-Enhanced Prompt Engineering1 Oct 2025
- 2025Match Chat: Real Time Generative AI and Generative Computing for Tennis16 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
- 2025Prompt Orchestration Markup Language19 Aug 2025
- 2025Large Language Models for Oral History Understanding with Text Classification and Sentiment Analysis8 Aug 2025
- 2025"I made this (sort of)": Negotiating authorship, confronting fraudulence, and exploring new musical spaces with prompt-based AI music generation31 Jul 2025
12 newest of 34 All 34 (JSON)