mlsanityData to 7 Oct 2026

Unpacking Human-AI interactions: From interaction primitives to a design space

arXiv 2401.05115 ↗First posted 10 Jan 2024cs.HC cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper aims to develop a semi-formal design space for Human-AI interactions, by building a set of interaction primitives which specify the communication between users and AI systems during their interaction. We show how these primitives can be combined into a set of interaction patterns which can provide an abstract specification for exchanging messages between humans and AI/ML models to carry out purposeful interactions. The motivation behind this is twofold: firstly, to provide a compact generalisation of existing practices, that highlights the similarities and differences between systems in terms of their interaction behaviours; and secondly, to support the creation of new systems, in particular by opening the space of possibilities for interactions with models. We present a short literature review on frameworks, guidelines and taxonomies related to the design and implementation of HAI interactions, including human-in-the-loop, explainable AI, as well as hybrid intelligence and collaborative learning approaches. From the literature review, we define a vocabulary for describing information exchanges in terms of providing and requesting particular model-specific data types. Based on this vocabulary, a message passing model for interactions between humans and models is presented, which we demonstrate can account for existing systems and approaches. Finally, we build this into design patterns as mid-level constructs that capture common interactional structures. We discuss how this approach can be used towards a design space for Human-AI interactions that creates new possibilities for designs as well as keeping track of implementation issues and concerns.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 31 of its 121 references that are in the map. First posted on arXiv 10 Jan 2024.

Builds on

31 of 121 references.

References · 31

  1. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  3. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  4. 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
  5. 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
  6. 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 182
  7. 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 128
  8. 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
  9. 2020Human-centered Explainable AI: Towards a Reflective Sociotechnical Approachcited by 90
  10. 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 90
  11. 2022Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systemscited by 59
  12. 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
19 more
  1. 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
  2. 2020A systematic review and taxonomy of explanations in decision support and recommender systemscited by 45
  3. 2021Modular Design Patterns for Hybrid Learning and Reasoning Systems: a taxonomy, patterns and use casescited by 39
  4. 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
  5. 2021Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AIcited by 38
  6. 2021Towards A Process Model for Co-Creating AI Experiencescited by 18
  7. 2021Meaningful human control: actionable properties for AI system developmentcited by 18
  8. 2022Mapping the Design Space of Human-AI Interaction in Text Summarizationcited by 15
  9. 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
  10. 2019FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventionscited by 13
  11. 2022Towards a multi-stakeholder value-based assessment framework for algorithmic systemscited by 12
  12. 2022A domain-specific language for describing machine learning datasetscited by 12
  13. 2020Should We Trust (X)AI? Design Dimensions for Structured Experimental Evaluationscited by 8
  14. 2020Human Engagement Providing Evaluative and Informative Advice for Interactive Reinforcement Learningcited by 7
  15. 2020Designing AI Learning Experiences for K-12: Emerging Works, Future Opportunities and a Design Frameworkcited by 7
  16. 2022Perspectives on Incorporating Expert Feedback into Model Updatescited by 7
  17. 2023Mapping the Design Space of Interactions in Human-AI Text Co-creation Taskscited by 6
  18. 2020On Interactive Machine Learning and the Potential of Cognitive Feedbackcited by 5
  19. 2019Artificial Intelligence in Intelligent Tutoring Robots: A Systematic Review and Design Guidelinescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 4.

7 papers.