Human-AI collaboration is not very collaborative yet: A taxonomy of interaction patterns in AI-assisted decision making from a systematic review
Not on the map. Why?
Abstract (arXiv)
Leveraging Artificial Intelligence (AI) in decision support systems has disproportionately focused on technological advancements, often overlooking the alignment between algorithmic outputs and human expectations. A human-centered perspective attempts to alleviate this concern by designing AI solutions for seamless integration with existing processes. Determining what information AI should provide to aid humans is vital, a concept underscored by explainable AI's efforts to justify AI predictions. However, how the information is presented, e.g., the sequence of recommendations and solicitation of interpretations, is equally crucial as complex interactions may emerge between humans and AI. While empirical studies have evaluated human-AI dynamics across domains, a common vocabulary for human-AI interaction protocols is lacking. To promote more deliberate consideration of interaction designs, we introduce a taxonomy of interaction patterns that delineate various modes of human-AI interactivity. We summarize the results of a systematic review of AI-assisted decision making literature and identify trends and opportunities in existing interactions across application domains from 105 articles. We find that current interactions are dominated by simplistic collaboration paradigms, leading to little support for truly interactive functionality. Our taxonomy offers a tool to understand interactivity with AI in decision-making and foster interaction designs for achieving clear communication, trustworthiness, and collaboration.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 32 of its 134 references that are in the map. First posted on arXiv 30 Oct 2023.
Builds on
32 of 134 references.
References · 32
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 139
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
- 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 83
- 2022Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderationcited by 67
- 2020Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingcited by 59
- 2021Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Makingcited by 58
- 2020Does Explainable Artificial Intelligence Improve Human Decision-Making?cited by 49
- 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
- 2021Modular Design Patterns for Hybrid Learning and Reasoning Systems: a taxonomy, patterns and use casescited by 39
20 more
- 2023Improving Human-AI Collaboration With Descriptions of AI Behaviorcited by 36
- 2021Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactionscited by 35
- 2021Role of Human-AI Interaction in Selective Predictioncited by 35
- 2020The Role of Domain Expertise in User Trust and the Impact of First Impressions with Intelligent Systemscited by 34
- 2022Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imagingcited by 32
- 2023Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfactioncited by 32
- 2021Explainable Medical Imaging AI Needs Human-Centered Design: Guidelines and Evidence from a Systematic Reviewcited by 30
- 2021Towards Relatable Explainable AI with the Perceptual Processcited by 27
- 2020Misplaced Trust: Measuring the Interference of Machine Learning in Human Decision-Makingcited by 25
- 2021Increasing the Speed and Accuracy of Data LabelingThrough an AI Assisted Interfacecited by 21
- 2021Sibyl: Understanding and Addressing the Usability Challenges of Machine Learning In High-Stakes Decision Makingcited by 19
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservablescited by 19
- 2023Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorationscited by 18
- 2022Investigations of Performance and Bias in Human-AI Teamwork in Hiringcited by 16
- 2022Mapping the Design Space of Human-AI Interaction in Text Summarizationcited by 15
- 2019Discovering the Sweet Spot of Human-Computer Configurations: A Case Study in Information Extractioncited by 11
- 2020Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in Pathologycited by 9
- 2021Intuitively Assessing ML Model Reliability through Example-Based Explanations and Editing Model Inputscited by 9
- 2022An Empirical Evaluation of Predicted Outcomes as Explanations in Human-AI Decision-Makingcited by 7
- 2022Painting the black box white: experimental findings from applying XAI to an ECG reading settingcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 9.
18 papers.
Sort:
By area:
- 2025AI-Assisted Decision Making with Human Learningcited by 6
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnershipcited by 5
- 2025Collaborative Causal Sensemaking: Closing the Complementarity Gap in Human-AI Decision Supportcited by 2
- 2026Measuring (some aspects of) the metacognition of AIcited by 2
- 2025Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisionscited by 1
- 2025Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Modelscited by 1
- 2024Let people fail! Exploring the influence of explainable virtual and robotic agents in learning-by-doing taskscited by 0
- 2025Human-Centered Human-AI Collaboration (HCHAC)cited by 0
- 2025Human-AI Use Patterns for Decision-Making in Disaster Scenarios: A Systematic Reviewcited by 0
- 2025AI for Requirements Engineering: Industry adoption and Practitioner perspectivescited by 0
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisionscited by 0
- 2026The Competence Shadow: Theory and Bounds of AI Assistance in Safety Engineeringcited by 0
6 more
- 2026A Workflow-Oriented Framework for Asynchronous Human-AI Collaboration in Hybrid and Compute-Intensive HPC Environmentscited by 0
- 2026Humanwashing -- It Should Leave You Feeling Dirtycited by 0
- 2026Addressing the Synergy Gap: The Six Elements of the Design Spacecited by 0
- 2026When AI Blurs the Boundaries of Contribution: An Empirical Study of Authorship Calibrationcited by 0
- 2026ForkSCOPE: Charting the Agentic Garden of Forking Pathscited by 0
- 2026Defining and Categorising Human-AI Interactions in Clinical Trials: A Multidimensional Human-AI Classification Approachcited by 0
- 2026Defining and Categorising Human-AI Interactions in Clinical Trials: A Multidimensional Human-AI Classification Approach29 Sep 2026
- 2026ForkSCOPE: Charting the Agentic Garden of Forking Paths11 Sep 2026
- 2026When AI Blurs the Boundaries of Contribution: An Empirical Study of Authorship Calibration16 Jul 2026
- 2026Addressing the Synergy Gap: The Six Elements of the Design Space20 May 2026
- 2026Humanwashing -- It Should Leave You Feeling Dirty13 May 2026
- 2026A Workflow-Oriented Framework for Asynchronous Human-AI Collaboration in Hybrid and Compute-Intensive HPC Environments5 May 2026
- 2026Measuring (some aspects of) the metacognition of AI31 Mar 2026
- 2026The Competence Shadow: Theory and Bounds of AI Assistance in Safety Engineering26 Mar 2026
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisions30 Jan 2026
- 2025Collaborative Causal Sensemaking: Closing the Complementarity Gap in Human-AI Decision Support8 Dec 2025
- 2025AI for Requirements Engineering: Industry adoption and Practitioner perspectives3 Nov 2025
- 2025Human-AI Use Patterns for Decision-Making in Disaster Scenarios: A Systematic Review15 Sep 2025
6 more
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnership21 Jul 2025
- 2025Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Models24 Jun 2025
- 2025Human-Centered Human-AI Collaboration (HCHAC)28 May 2025
- 2025Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisions2 May 2025
- 2025AI-Assisted Decision Making with Human Learning18 Feb 2025
- 2024Let people fail! Exploring the influence of explainable virtual and robotic agents in learning-by-doing tasks15 Nov 2024
- 2025AI-Assisted Decision Making with Human Learningcited by 6
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnershipcited by 5
- 2026Measuring (some aspects of) the metacognition of AIcited by 2
- 2025Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisionscited by 1
- 2025Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Modelscited by 1
- 2024Let people fail! Exploring the influence of explainable virtual and robotic agents in learning-by-doing taskscited by 0
- 2025Human-Centered Human-AI Collaboration (HCHAC)cited by 0
- 2025Human-AI Use Patterns for Decision-Making in Disaster Scenarios: A Systematic Reviewcited by 0
- 2025AI for Requirements Engineering: Industry adoption and Practitioner perspectivescited by 0
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisionscited by 0
- 2026The Competence Shadow: Theory and Bounds of AI Assistance in Safety Engineeringcited by 0
- 2026A Workflow-Oriented Framework for Asynchronous Human-AI Collaboration in Hybrid and Compute-Intensive HPC Environmentscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Defining and Categorising Human-AI Interactions in Clinical Trials: A Multidimensional Human-AI Classification Approach29 Sep 2026
- 2026When AI Blurs the Boundaries of Contribution: An Empirical Study of Authorship Calibration16 Jul 2026
- 2026Addressing the Synergy Gap: The Six Elements of the Design Space20 May 2026
- 2026Humanwashing -- It Should Leave You Feeling Dirty13 May 2026
- 2026A Workflow-Oriented Framework for Asynchronous Human-AI Collaboration in Hybrid and Compute-Intensive HPC Environments5 May 2026
- 2026Measuring (some aspects of) the metacognition of AI31 Mar 2026
- 2026The Competence Shadow: Theory and Bounds of AI Assistance in Safety Engineering26 Mar 2026
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisions30 Jan 2026
- 2025AI for Requirements Engineering: Industry adoption and Practitioner perspectives3 Nov 2025
- 2025Human-AI Use Patterns for Decision-Making in Disaster Scenarios: A Systematic Review15 Sep 2025
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnership21 Jul 2025
- 2025Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Models24 Jun 2025
12 newest of 16 All 16 (JSON)