# Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AI arXiv: https://arxiv.org/abs/2105.05424 ยท HTML: https://mlsanity.com/paper/2105.05424/ ## Key facts - Cited by 38 papers in the map (data through 14 Oct 2026). - Builds on 17 of its 210 references that are in the map. - First posted on arXiv 12 May 2021. ## Builds on (most cited first, 17 of 17) - ["Why Should I Trust You?": Explaining the Predictions of Any Classifier](https://mlsanity.com/paper/1602.04938/) (2016) - [Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings](https://mlsanity.com/paper/1607.06520/) (2016) - [Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy](https://mlsanity.com/paper/2002.04087/) (2020) - [The Ethics of AI Ethics -- An Evaluation of Guidelines](https://mlsanity.com/paper/1903.03425/) (2019) - [Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++](https://mlsanity.com/paper/1803.09693/) (2018) - [Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach](https://mlsanity.com/paper/2002.01092/) (2020) - [Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences](https://mlsanity.com/paper/1712.00547/) (2017) - [Research Priorities for Robust and Beneficial Artificial Intelligence](https://mlsanity.com/paper/1602.03506/) (2016) - [Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI](https://mlsanity.com/paper/1902.01876/) (2019) - [Hybrid Intelligence](https://mlsanity.com/paper/2105.00691/) (2021) - [Human-in-the-loop Artificial Intelligence](https://mlsanity.com/paper/1710.08191/) (2017) - [Cooperating with Machines](https://mlsanity.com/paper/1703.06207/) (2017) - [The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems](https://mlsanity.com/paper/2105.03354/) (2021) - [Human-Centered Artificial Intelligence and Machine Learning](https://mlsanity.com/paper/1901.11184/) (2019) - [Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents](https://mlsanity.com/paper/1801.08116/) (2018) - [The Challenges and Opportunities of Human-Centered AI for Trustworthy Robots and Autonomous Systems](https://mlsanity.com/paper/2105.04408/) (2021) - [Closing the AI Knowledge Gap](https://mlsanity.com/paper/1803.07233/) (2018) ## Built on by (most cited first, 30 of 38) - [A Survey of Human-in-the-loop for Machine Learning](https://mlsanity.com/paper/2108.00941/) (2021) - [Interactive AI with Retrieval-Augmented Generation for Next Generation Networking](https://mlsanity.com/paper/2401.11391/) (2024) - [LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey](https://mlsanity.com/paper/2505.00753/) (2025) - [AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depression](https://mlsanity.com/paper/2504.18932/) (2025) - [Challenges in Human-Agent Communication](https://mlsanity.com/paper/2412.10380/) (2024) - [Human-Centred Learning Analytics and AI in Education: a Systematic Literature Review](https://mlsanity.com/paper/2312.12751/) (2023) - [Unpacking Human-AI interactions: From interaction primitives to a design space](https://mlsanity.com/paper/2401.05115/) (2024) - [SCALE: Towards Collaborative Content Analysis in Social Science with Large Language Model Agents and Human Intervention](https://mlsanity.com/paper/2502.10937/) (2025) - [BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Web](https://mlsanity.com/paper/2508.13787/) (2025) - [Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond](https://mlsanity.com/paper/2309.00064/) (2023) - [A-Eye: Driving with the Eyes of AI for Corner Case Generation](https://mlsanity.com/paper/2202.10803/) (2022) - [May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainability](https://mlsanity.com/paper/2309.13965/) (2023) - [Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPT](https://mlsanity.com/paper/2401.08405/) (2024) - [ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale](https://mlsanity.com/paper/2404.02990/) (2024) - [GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design](https://mlsanity.com/paper/2508.15227/) (2025) - [Adoption of AI Technology in the Music Mixing Workflow: An Investigation](https://mlsanity.com/paper/2304.03407/) (2023) - [EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention](https://mlsanity.com/paper/2508.16771/) (2025) - [Agent Teaming Situation Awareness (ATSA): A Situation Awareness Framework for Human-AI Teaming](https://mlsanity.com/paper/2308.16785/) (2023) - [Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review](https://mlsanity.com/paper/2310.03392/) (2023) - [Advancing Responsible Innovation in Agentic AI: A study of Ethical Frameworks for Household Automation](https://mlsanity.com/paper/2507.15901/) (2025) - [Applying HCAI in developing effective human-AI teaming: A perspective from human-AI joint cognitive systems](https://mlsanity.com/paper/2307.03913/) (2023) - [AI Thinking: A framework for rethinking artificial intelligence in practice](https://mlsanity.com/paper/2409.12922/) (2024) - [A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health](https://mlsanity.com/paper/2411.02594/) (2024) - [AI-Driven Human-Autonomy Teaming in Tactical Operations: Proposed Framework, Challenges, and Future Directions](https://mlsanity.com/paper/2411.09788/) (2024) - [When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma](https://mlsanity.com/paper/2503.07320/) (2025) - [AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration](https://mlsanity.com/paper/2511.17906/) (2025) - [User Centered Design (VI): Human Factors Approaches for Intelligent Human-Computer Interaction](https://mlsanity.com/paper/2111.04880/) (2021) - [Participation Interfaces for Human-Centered AI](https://mlsanity.com/paper/2211.08419/) (2022) - [Towards Real Smart Apps: Investigating Human-AI Interactions in Smartphone On-Device AI Apps](https://mlsanity.com/paper/2307.00756/) (2023) - [Enabling Human-Centered AI: A Methodological Perspective](https://mlsanity.com/paper/2311.06703/) (2023) ## Abstract (arXiv) While AI has benefited humans, it may also harm humans if not appropriately developed. The focus of HCI work is transiting from conventional human interaction with non-AI computing systems to interaction with AI systems. We conducted a high-level literature review and a holistic analysis of current work in developing AI systems from an HCI perspective. Our review and analysis highlight the new changes introduced by AI technology and the new challenges that HCI professionals face when applying the human-centered AI (HCAI) approach in the development of AI systems. We also identified seven main issues in human interaction with AI systems, which HCI professionals did not encounter when developing non-AI computing systems. To further enable the implementation of the HCAI approach, we identified new HCI opportunities tied to specific HCAI-driven design goals to guide HCI professionals in addressing these new issues. Finally, our assessment of current HCI methods shows the limitations of these methods in support of developing AI systems. We propose alternative methods that can help overcome these limitations and effectively help HCI professionals apply the HCAI approach to the development of AI systems. We also offer strategic recommendations for HCI professionals to effectively influence the development of AI systems with the HCAI approach, eventually developing HCAI systems.