Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making
Not on the map. Why?
Abstract (arXiv)
Existing research on human-AI collaborative decision-making focuses mainly on the interaction between AI and individual decision-makers. There is a limited understanding of how AI may perform in group decision-making. This paper presents a wizard-of-oz study in which two participants and an AI form a committee to rank three English essays. One novelty of our study is that we adopt a speculative design by endowing AI equal power to humans in group decision-making.We enable the AI to discuss and vote equally with other human members. We find that although the voice of AI is considered valuable, AI still plays a secondary role in the group because it cannot fully follow the dynamics of the discussion and make progressive contributions. Moreover, the divergent opinions of our participants regarding an "equal AI" shed light on the possible future of human-AI relations.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 33 of its 104 references that are in the map. First posted on arXiv 17 Feb 2023.
Builds on
33 of 104 references.
References · 33
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2018On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detectioncited by 159
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
21 more
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
- 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 85
- 2022Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderationcited by 66
- 2019Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processescited by 53
- 2020Factors Influencing Perceived Fairness in Algorithmic Decision-Making: Algorithm Outcomes, Development Procedures, and Individual Differencescited by 41
- 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 37
- 2020The Role of Domain Expertise in User Trust and the Impact of First Impressions with Intelligent Systemscited by 34
- 2021AutoDS: Towards Human-Centered Automation of Data Sciencecited by 32
- 2019How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?cited by 30
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
- 2021Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiativecited by 28
- 2021Many Hands Make Light Work: Using Essay Traits to Automatically Score Essayscited by 25
- 2021Documentation Matters: Human-Centered AI System to Assist Data Science Code Documentation in Computational Notebookscited by 17
- 2022Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science Workcited by 15
- 2021"Look! It's a Computer Program! It's an Algorithm! It's AI!": Does Terminology Affect Human Perceptions and Evaluations of Algorithmic Decision-Making Systems?cited by 13
- 2021"Grip-that-there": An Investigation of Explicit and Implicit Task Allocation Techniques for Human-Robot Collaborationcited by 2
- 2021Empathosphere: Promoting Constructive Communication in Ad-hoc Virtual Teams through Perspective-taking Spacescited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 2.
11 papers.
- 2024Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Makingcited by 38
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biasescited by 16
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systemscited by 9
- 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Studentscited by 8
- 2025Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaborationcited by 4
- 2025MeetMap: Real-Time Collaborative Dialogue Mapping with LLMs in Online Meetingscited by 3
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspectivecited by 1
- 2024ARTiST: Automated Text Simplification for Task Guidance in Augmented Realitycited by 0
- 2026Exploring Teachers' Perspectives on Using Conversational AI Agents for Group Collaborationcited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents24 Sep 2026
- 2026Exploring Teachers' Perspectives on Using Conversational AI Agents for Group Collaboration6 Feb 2026
- 2025Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration22 Sep 2025
- 2025From Conversation to Orchestration: HCI Challenges and Opportunities in Interactive Multi-Agentic Systems25 Jun 2025
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective15 Apr 2025
- 2025MeetMap: Real-Time Collaborative Dialogue Mapping with LLMs in Online Meetings3 Feb 2025
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
- 2024Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making25 Mar 2024
- 2024ARTiST: Automated Text Simplification for Task Guidance in Augmented Reality29 Feb 2024
- 2024Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students26 Jan 2024
- 2024The "Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based Biases19 Jan 2024