AI, Help Me Thinkunicodex2014but for Myself: Assisting People in Complex Decision-Making by Providing Different Kinds of Cognitive Support
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
How can we design AI tools that effectively support human decision-making by complementing and enhancing users' reasoning processes? Common recommendation-centric approaches face challenges such as inappropriate reliance or a lack of integration with users' decision-making processes. Here, we explore an alternative interaction model in which the AI outputs build upon users' own decision-making rationales. We compare this approach, which we call ExtendAI, with a recommendation-based AI. Participants in our mixed-methods user study interacted with both AIs as part of an investment decision-making task. We found that the AIs had different impacts, with ExtendAI integrating better into the decision-making process and people's own thinking and leading to slightly better outcomes. RecommendAI was able to provide more novel insights while requiring less cognitive effort. We discuss the implications of these and other findings along with three tensions of AI-assisted decision-making which our study revealed.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 71 references that are in the map. First posted on arXiv 9 Apr 2025.
Builds on
27 of 71 references.
References · 27
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2018On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detectioncited by 159
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 139
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 83
- 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 66
15 more
- 2024Determinants of LLM-assisted Decision-Makingcited by 56
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2023In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Makingcited by 50
- 2024Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiologycited by 45
- 2024Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Makingcited by 38
- 2021Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lenscited by 35
- 2023Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosiscited by 30
- 2023A Systematic Review on Fostering Appropriate Trust in Human-AI Interactioncited by 21
- 2024XAI for All: Can Large Language Models Simplify Explainable AI?cited by 21
- 2023Effective Human-AI Teams via Learned Natural Language Rules and Onboardingcited by 20
- 2024Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactionscited by 20
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservablescited by 19
- 2023Overcoming Algorithm Aversion: A Comparison between Process and Outcome Controlcited by 12
- 2024Beyond Recommender: An Exploratory Study of the Effects of Different AI Roles in AI-Assisted Decision Makingcited by 5
- 2024Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Processcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interactioncited by 6
- 2026Augmenting Clinical Decision-Making with an Interactive and Interpretable AI Copilot: A Real-World User Study with Clinicians in Nephrology and Obstetricscited by 1
- 2026Reflecti-Mate: A Conversational Agent for Adaptive Decision-Making Support Through System 1 and System 2 Thinkingcited by 1
- 2025Hybrid Reasoning Systems That Prioritize and Enhance Human Intelligencecited by 0
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaborationcited by 0
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisionscited by 0
- 2026SCAN: A Decision-Making Framework for Effective Task Allocation with Generative AIcited by 0
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agentscited by 0
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistantscited by 0
- 2026Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Makingcited by 0
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focuscited by 0
- 2026AI Agents are Vulnerable to Radicalizationcited by 0
- 2026AI Agents are Vulnerable to Radicalization29 Sep 2026
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Making21 Sep 2026
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants17 Sep 2026
- 2026Plans Work in Mysterious Ways: Evaluating a Plan Mode for Spreadsheet Agents26 Jul 2026
- 2026SCAN: A Decision-Making Framework for Effective Task Allocation with Generative AI14 Jun 2026
- 2026Reflecti-Mate: A Conversational Agent for Adaptive Decision-Making Support Through System 1 and System 2 Thinking21 May 2026
- 2026Augmenting Clinical Decision-Making with an Interactive and Interpretable AI Copilot: A Real-World User Study with Clinicians in Nephrology and Obstetrics31 Jan 2026
- 2026Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisions30 Jan 2026
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction29 Jan 2026
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaboration16 Nov 2025
- 2025Hybrid Reasoning Systems That Prioritize and Enhance Human Intelligence18 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025Human aversion? Do AI Agents Judge Identity More Harshly Than Performance
- 2022Algorithmic Decision-Making Safeguarded by Human Knowledge
- 2025Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignment
- 2026From Information to Delegation: Mapping Human-AI Financial Decision Making
- 2025Collaborative Causal Sensemaking: Closing the Complementarity Gap in Human-AI Decision Support
- 2026Supporting Reflection and Forward-Looking Reasoning With Data-Driven Questions
- 2024ADESSE: Advice Explanations in Complex Repeated Decision-Making Environments
- 2026Human-Centric Reflective Architecture for Human-AI Collaborative Decision-Making