A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
Not on the map. Why?
Abstract (arXiv)
With ChatGPT's release, conversational prompting has become the most popular form of human-LLM interaction. However, its effectiveness is limited for more complex tasks involving reasoning, creativity, and iteration. Through a systematic analysis of HCI papers published since 2021, we identified four key phases in the human-LLM interaction flow - planning, facilitating, iterating, and testing - to precisely understand the dynamics of this process. Additionally, we have developed a taxonomy of four primary interaction modes: Mode 1: Standard Prompting, Mode 2: User Interface, Mode 3: Context-based, and Mode 4: Agent Facilitator. This taxonomy was further enriched using the "5W1H" guideline method, which involved a detailed examination of definitions, participant roles (Who), the phases that happened (When), human objectives and LLM abilities (What), and the mechanics of each interaction mode (How). We anticipate this taxonomy will contribute to the future design and evaluation of human-LLM interaction.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 6; 2025: 22; 2026: 10.
38 papers.
Sort:
By area:
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 42
- 2024IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimizationcited by 31
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 19
- 2025ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programmingcited by 16
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2025CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generationcited by 15
- 2025An overview of model uncertainty and variability in LLM-based sentiment analysis. Challenges, mitigation strategies and the role of explainabilitycited by 15
- 2026CoPE-VideoLM: Leveraging Codec Primitives For Efficient Video Language Modelingcited by 11
- 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysiscited by 9
- 2025EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Modelscited by 9
26 more
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomycited by 9
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systemscited by 9
- 2026Human-AI Co-design for Clinical Prediction Modelscited by 9
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
- 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergencecited by 5
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologiescited by 5
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicitycited by 4
- 2025How to Enable Effective Cooperation Between Humans and NLP Models: A Survey of Principles, Formalizations, and Beyondcited by 4
- 2025Unraveling Human-AI Teaming: A Review and Outlookcited by 4
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2025Carbon and Silicon, Coexist or Compete? A Survey on Human-AI Interactions in Agent-based Modeling and Simulationcited by 3
- 2025Show or Tell? Modeling the evolution of request-making in Human-LLM conversationscited by 3
- 2024Assessing the Impact of Conspiracy Theories Using Large Language Modelscited by 2
- 2025Personality Matters: User Traits Predict LLM Preferences in Multi-Turn Collaborative Taskscited by 2
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Developmentcited by 1
- 2026LLM-Augmented Semantic Steering of Text Embedding Projection Spacescited by 1
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wildcited by 1
- 2025DeCoDe: Defer-and-Complement Decision-Making via Decoupled Concept Bottleneck Modelscited by 0
- 2025Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Taskscited by 0
- 2025Human-AI collaboration or obedient and often clueless AI in instruct, serve, repeat dynamics?cited by 0
- 2025Interactive In-Meeting Speaker Correction with Human Feedbackcited by 0
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Makingcited by 0
- 2026Alignment has a Fantasia Problemcited by 0
- 2026Seeking Information with RAG-Assistants: Does Model Size Matter in Human-AI Collaborations?cited by 0
- 2026Intelligent Interaction Techniques (IIxT) - Proposalcited by 0
- 2026Alignment Games: A Framework for Conceptual Repair in Human-AI Collaborationcited by 0
- 2026Alignment Games: A Framework for Conceptual Repair in Human-AI Collaboration28 Sep 2026
- 2026Intelligent Interaction Techniques (IIxT) - Proposal14 Sep 2026
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild7 May 2026
- 2026LLM-Augmented Semantic Steering of Text Embedding Projection Spaces3 May 2026
- 2026Seeking Information with RAG-Assistants: Does Model Size Matter in Human-AI Collaborations?1 May 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026CoPE-VideoLM: Leveraging Codec Primitives For Efficient Video Language Modeling13 Feb 2026
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2026Human-AI Co-design for Clinical Prediction Models14 Jan 2026
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologies25 Oct 2025
- 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactions6 Oct 2025
26 more
- 2025Interactive In-Meeting Speaker Correction with Human Feedback22 Sep 2025
- 2025Personality Matters: User Traits Predict LLM Preferences in Multi-Turn Collaborative Tasks29 Aug 2025
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Models28 Aug 2025
- 2025Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks6 Aug 2025
- 2025Human-AI collaboration or obedient and often clueless AI in instruct, serve, repeat dynamics?3 Aug 2025
- 2025Show or Tell? Modeling the evolution of request-making in Human-LLM conversations2 Aug 2025
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systems25 Jun 2025
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy11 Jun 2025
- 2025EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models10 Jun 2025
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May 2025
- 2025DeCoDe: Defer-and-Complement Decision-Making via Decoupled Concept Bottleneck Models25 May 2025
- 2025ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming22 May 2025
- 2025A Case Study Investigating the Role of Generative AI in Quality Evaluations of Epics in Agile Software Development12 May 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025Unraveling Human-AI Teaming: A Review and Outlook8 Apr 2025
- 2025An overview of model uncertainty and variability in LLM-based sentiment analysis. Challenges, mitigation strategies and the role of explainability6 Apr 2025
- 2025CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation5 Mar 2025
- 2025Carbon and Silicon, Coexist or Compete? A Survey on Human-AI Interactions in Agent-based Modeling and Simulation25 Feb 2025
- 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysis17 Feb 2025
- 2025How to Enable Effective Cooperation Between Humans and NLP Models: A Survey of Principles, Formalizations, and Beyond10 Jan 2025
- 2024Assessing the Impact of Conspiracy Theories Using Large Language Models9 Dec 2024
- 2024IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization9 Nov 2024
- 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergence10 Sep 2024
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicity8 Jul 2024
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses7 Jun 2024
- 2024Towards interactive evaluations for interaction harms in human-AI systems17 May 2024
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 42
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomycited by 9
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systemscited by 9
- 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergencecited by 5
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologiescited by 5
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2025Carbon and Silicon, Coexist or Compete? A Survey on Human-AI Interactions in Agent-based Modeling and Simulationcited by 3
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologies25 Oct 2025
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systems25 Jun 2025
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy11 Jun 2025
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025Carbon and Silicon, Coexist or Compete? A Survey on Human-AI Interactions in Agent-based Modeling and Simulation25 Feb 2025
- 2024Can Agents Spontaneously Form a Society? Introducing a Novel Architecture for Generative Multi-Agents to Elicit Social Emergence10 Sep 2024
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
- 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 19
- 2025ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programmingcited by 16
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2025CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generationcited by 15
- 2025An overview of model uncertainty and variability in LLM-based sentiment analysis. Challenges, mitigation strategies and the role of explainabilitycited by 15
- 2026CoPE-VideoLM: Leveraging Codec Primitives For Efficient Video Language Modelingcited by 11
- 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysiscited by 9
- 2025EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Modelscited by 9
- 2026Human-AI Co-design for Clinical Prediction Modelscited by 9
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
- 2024Exploring Human-LLM Conversations: Mental Models and the Originator of Toxicitycited by 4
12 most cited of 29 All 29 (JSON)
- 2026Alignment Games: A Framework for Conceptual Repair in Human-AI Collaboration28 Sep 2026
- 2026Intelligent Interaction Techniques (IIxT) - Proposal14 Sep 2026
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild7 May 2026
- 2026LLM-Augmented Semantic Steering of Text Embedding Projection Spaces3 May 2026
- 2026Seeking Information with RAG-Assistants: Does Model Size Matter in Human-AI Collaborations?1 May 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026CoPE-VideoLM: Leveraging Codec Primitives For Efficient Video Language Modeling13 Feb 2026
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2026Human-AI Co-design for Clinical Prediction Models14 Jan 2026
- 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactions6 Oct 2025
- 2025Interactive In-Meeting Speaker Correction with Human Feedback22 Sep 2025
- 2025Personality Matters: User Traits Predict LLM Preferences in Multi-Turn Collaborative Tasks29 Aug 2025
12 newest of 29 All 29 (JSON)