Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems
Not on the map. Why?
Abstract (arXiv)
This position paper examines potential pitfalls on the way towards achieving human-AI co-creation with generative models in a way that is beneficial to the users' interests. In particular, we collected a set of nine potential pitfalls, based on the literature and our own experiences as researchers working at the intersection of HCI and AI. We illustrate each pitfall with examples and suggest ideas for addressing it. Reflecting on all pitfalls, we discuss and conclude with implications for future research directions. With this collection, we hope to contribute to a critical and constructive discussion on the roles of humans and AI in co-creative interactions, with an eye on related assumptions and potential side-effects for creative practices and beyond.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 11 of its 33 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
11 of 33 references.
References · 11
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 254
- 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
- 2019Visual Interaction with Deep Learning Models through Collaborative Semantic Inferencecited by 24
- 2019An Interaction Framework for Studying Co-Creative AIcited by 19
- 2020Learning to See: You Are What You Seecited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 0; 2023: 5; 2024: 4; 2025: 1.
12 papers.
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
- 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
- 2023Interactive AI Alignment: Specification, Process, and Evaluation Alignmentcited by 22
- 2021SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasetscited by 18
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideationcited by 16
- 2023fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Taskscited by 10
- 2024VRCopilot: Authoring 3D Layouts with Generative AI Models in VRcited by 10
- 2023An Ontology of Co-Creative AI Systemscited by 7
- 2025Exploring the Needs of Practising Musicians in Co-Creative AI Through Co-Designcited by 3
- 2023CHAI-DT: A Framework for Prompting Conversational Generative AI Agents to Actively Participate in Co-Creationcited by 0
- 2025Exploring the Needs of Practising Musicians in Co-Creative AI Through Co-Design13 Feb 2025
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation19 Sep 2024
- 2024VRCopilot: Authoring 3D Layouts with Generative AI Models in VR18 Aug 2024
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing15 Feb 2024
- 2024Homogenization Effects of Large Language Models on Human Creative Ideation2 Feb 2024
- 2023Interactive AI Alignment: Specification, Process, and Evaluation Alignment23 Oct 2023
- 2023An Ontology of Co-Creative AI Systems11 Oct 2023
- 2023CHAI-DT: A Framework for Prompting Conversational Generative AI Agents to Actively Participate in Co-Creation5 May 2023
- 2023fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Tasks22 Feb 2023
- 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI1 Feb 2023
- 2021SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets11 Nov 2021
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts4 Oct 2021