AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Not on the map. Why?
Abstract (arXiv)
The growing availability of generative AI technologies such as large language models (LLMs) has significant implications for creative work. This paper explores twofold aspects of integrating LLMs into the creative process - the divergence stage of idea generation, and the convergence stage of evaluation and selection of ideas. We devised a collaborative group-AI Brainwriting ideation framework, which incorporated an LLM as an enhancement into the group ideation process, and evaluated the idea generation process and the resulted solution space. To assess the potential of using LLMs in the idea evaluation process, we design an evaluation engine and compared it to idea ratings assigned by three expert and six novice evaluators. Our findings suggest that integrating LLM in Brainwriting could enhance both the ideation process and its outcome. We also provide evidence that LLMs can support idea evaluation. We conclude by discussing implications for HCI education and practice.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 10 of its 88 references that are in the map. First posted on arXiv 22 Feb 2024.
Builds on
10 of 88 references.
References · 10
- 2021PopBlends: Strategies for Conceptual Blending with Large Language Modelscited by 22
- 2023ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactionscited by 22
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2023Designing Participatory AI: Creative Professionals' Worries and Expectations about Generative AIcited by 20
- 2023Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perceptioncited by 19
- 2021Towards A Process Model for Co-Creating AI Experiencescited by 18
- 2023RECIPE: How to Integrate ChatGPT into EFL Writing Educationcited by 17
- 2023Unreflected Acceptance -- Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Educationcited by 7
- 2020Domain-based Latent Personal Analysis and its use for impersonation detection in social mediacited by 3
- 2020Post-human interaction design, yes, but cautiouslycited by 2
Built on by
Citing papers per year: 2024: 14; 2025: 22; 2026: 7.
43 papers.
Sort:
By area:
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 40
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 27
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideationcited by 16
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
- 2024A Survey on Human-Centric LLMscited by 13
- 2025Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Productioncited by 9
- 2024The Extractive-Abstractive Spectrum: Uncovering Verifiability Trade-offs in LLM Generationscited by 8
- 2024Language Models as Critical Thinking Tools: A Case Study of Philosopherscited by 6
- 2024The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writingcited by 6
31 more
- 2024Ink and Individuality: Crafting a Personalised Narrative in the Age of LLMscited by 5
- 2025Co-designing Large Language Model Tools for Project-Based Learning with K12 Educatorscited by 5
- 2025AI Agent Behavioral Sciencecited by 5
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
- 2025Towards Pervasive Distributed Agentic Generative AI -- A State of The Artcited by 4
- 2024The Impact of Generative Artificial Intelligence on Ideation and the performance of Innovation Teams (Preprint)cited by 3
- 2025Human-Centered AI Communication in Co-Creativity: An Initial Framework and Insightscited by 3
- 2025Get on the Train or be Left on the Station: Using LLMs for Software Engineering Researchcited by 3
- 2025Human-AI Interactions: Cognitive, Behavioral, and Emotional Impactscited by 3
- 2025Exploring Collaborative GenAI Agents in Synchronous Group Settings: Eliciting Team Perceptions and Design Considerations for the Future of Workcited by 2
- 2025Guiding Generative Storytelling with Knowledge Graphscited by 2
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Withoutcited by 2
- 2024A Novel Mathematical Framework for Objective Characterization of Ideascited by 1
- 2024Easy Come, Easy Go? Examining the Perceptions and Learning Effects of LLM-based Chatbot in the Context of Search-as-Learningcited by 1
- 2025Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agentscited by 1
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspectivecited by 1
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Developmentcited by 1
- 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
- 2026An Expert Schema for Evaluating Large Language Model Errors in Scholarly Question-Answering Systemscited by 1
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wildcited by 1
- 2024A Culturally-Aware Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Stylescited by 0
- 2025LitLinker: Supporting the Ideation of Interdisciplinary Contexts with Large Language Models for Teaching Literature in Elementary Schoolscited by 0
- 2025FOR-Prompting: From Objection to Revision via an Asymmetric Prompting Protocolcited by 0
- 2025Can AI be Accountable?cited by 0
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Makingcited by 0
- 2026AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AIcited by 0
- 2026Magic, Madness, Heaven, Sin: LLM Output Diversity is Everything, Everywhere, All at Oncecited by 0
- 2026LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscapecited by 0
- 2026How Well Can AI Generate Backlogs from App Mockups?cited by 0
- 2026How Well Can AI Generate Backlogs from App Mockups?24 Jul 2026
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild7 May 2026
- 2026LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape3 Apr 2026
- 2026Magic, Madness, Heaven, Sin: LLM Output Diversity is Everything, Everywhere, All at Once2 Apr 2026
- 2026AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI9 Mar 2026
- 2026An Expert Schema for Evaluating Large Language Model Errors in Scholarly Question-Answering Systems24 Feb 2026
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration22 Nov 2025
- 2025Can AI be Accountable?30 Oct 2025
- 2025Human-AI Interactions: Cognitive, Behavioral, and Emotional Impacts20 Oct 2025
- 2025FOR-Prompting: From Objection to Revision via an Asymmetric Prompting Protocol2 Oct 2025
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Without15 Sep 2025
31 more
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
- 2025Towards Pervasive Distributed Agentic Generative AI -- A State of The Art16 Jun 2025
- 2025Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research15 Jun 2025
- 2025AI Agent Behavioral Science4 Jun 2025
- 2025Guiding Generative Storytelling with Knowledge Graphs30 May 2025
- 2025Creativity in LLM-based Multi-Agent Systems: A Survey27 May 2025
- 2025Human-Centered AI Communication in Co-Creativity: An Initial Framework and Insights23 May 2025
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Development12 May 2025
- 2025Exploring Collaborative GenAI Agents in Synchronous Group Settings: Eliciting Team Perceptions and Design Considerations for the Future of Work21 Apr 2025
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process16 Apr 2025
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective15 Apr 2025
- 2025Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agents23 Mar 2025
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-making18 Mar 2025
- 2025LitLinker: Supporting the Ideation of Interdisciplinary Contexts with Large Language Models for Teaching Literature in Elementary Schools22 Feb 2025
- 2025Co-designing Large Language Model Tools for Project-Based Learning with K12 Educators13 Feb 2025
- 2025Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production25 Jan 2025
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review22 Jan 2025
- 2024The Extractive-Abstractive Spectrum: Uncovering Verifiability Trade-offs in LLM Generations26 Nov 2024
- 2024A Survey on Human-Centric LLMs20 Nov 2024
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback5 Oct 2024
- 2024Easy Come, Easy Go? Examining the Perceptions and Learning Effects of LLM-based Chatbot in the Context of Search-as-Learning2 Oct 2024
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants28 Sep 2024
- 2024The Impact of Generative Artificial Intelligence on Ideation and the performance of Innovation Teams (Preprint)23 Sep 2024
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation19 Sep 2024
- 2024A Novel Mathematical Framework for Objective Characterization of Ideas11 Sep 2024
- 2024A Culturally-Aware Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles31 Jul 2024
- 2024The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writing27 Jun 2024
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design17 Jun 2024
- 2024How Far Are We From AGI: Are LLMs All We Need?16 May 2024
- 2024Language Models as Critical Thinking Tools: A Case Study of Philosophers6 Apr 2024
- 2024Ink and Individuality: Crafting a Personalised Narrative in the Age of LLMs20 Mar 2024
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2025AI Agent Behavioral Sciencecited by 5
- 2025Towards Pervasive Distributed Agentic Generative AI -- A State of The Artcited by 4
- 2025Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agentscited by 1
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspectivecited by 1
- 2025Towards Pervasive Distributed Agentic Generative AI -- A State of The Art16 Jun 2025
- 2025AI Agent Behavioral Science4 Jun 2025
- 2025Creativity in LLM-based Multi-Agent Systems: A Survey27 May 2025
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective15 Apr 2025
- 2025Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agents23 Mar 2025
- 2024Language Models as Critical Thinking Tools: A Case Study of Philosopherscited by 6
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
- 2025FOR-Prompting: From Objection to Revision via an Asymmetric Prompting Protocolcited by 0
- 2025FOR-Prompting: From Objection to Revision via an Asymmetric Prompting Protocol2 Oct 2025
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-making18 Mar 2025
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design17 Jun 2024
- 2024Language Models as Critical Thinking Tools: A Case Study of Philosophers6 Apr 2024
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 40
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 27
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideationcited by 16
- 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
- 2024A Survey on Human-Centric LLMscited by 13
- 2025Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Productioncited by 9
- 2024The Extractive-Abstractive Spectrum: Uncovering Verifiability Trade-offs in LLM Generationscited by 8
- 2024The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writingcited by 6
- 2024Ink and Individuality: Crafting a Personalised Narrative in the Age of LLMscited by 5
- 2025Co-designing Large Language Model Tools for Project-Based Learning with K12 Educatorscited by 5
12 most cited of 34 All 34 (JSON)
- 2026How Well Can AI Generate Backlogs from App Mockups?24 Jul 2026
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild7 May 2026
- 2026LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape3 Apr 2026
- 2026Magic, Madness, Heaven, Sin: LLM Output Diversity is Everything, Everywhere, All at Once2 Apr 2026
- 2026AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI9 Mar 2026
- 2026An Expert Schema for Evaluating Large Language Model Errors in Scholarly Question-Answering Systems24 Feb 2026
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration22 Nov 2025
- 2025Can AI be Accountable?30 Oct 2025
- 2025Human-AI Interactions: Cognitive, Behavioral, and Emotional Impacts20 Oct 2025
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Without15 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
12 newest of 34 All 34 (JSON)