mlsanityData to 13 Oct 2026

Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work

arXiv 2609.17065 ↗First posted 15 Sep 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

AI assistance places a metacognitive demand on users, who must judge their own competence and the system's. Yet designers lack comparative evidence on which interventions to choose, where to place them, and how to tell whether they worked. We elicited 30 interventions from 11 experts and, with prior work, organized them into a design space of time (when an intervention acts), level (whose competence is judged), and source (who supplies the monitoring cue). A between-subjects experiment (N = 917; 12 planning-and-organizing problems) compared a per-task reliability card, contrasting replies, pause points, and post-problem reflection against a baseline LLM assistant. Reliability cards and contrasting replies reduced estimation error and overconfidence and increased aggregate confidence discrimination. No task-performance improvement or average within-item discrimination gain was established. We contribute a shared vocabulary, a design space, and evidence that measured monitoring and task performance are separable design targets.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 29 of its 105 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

29 of 105 references.

References · 29

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  2. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
  3. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  4. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 252
  5. 2023The Metacognitive Demands and Opportunities of Generative AIcited by 87
  6. 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
  7. 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 83
  8. 2024CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needscited by 82
  9. 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
  10. 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
  11. 2023In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Makingcited by 50
  12. 2024Need Help? Designing Proactive AI Assistants for Programmingcited by 43
17 more
  1. 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 41
  2. 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistenciescited by 39
  3. 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMscited by 35
  4. 2023Effective Human-AI Teams via Learned Natural Language Rules and Onboardingcited by 20
  5. 2024Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactionscited by 20
  6. 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skillscited by 14
  7. 2023"AI enhances our performance, I have no doubt this one will do the same": The Placebo effect is robust to negative descriptions of AIcited by 11
  8. 2026Causal Evidence that Language Models use Confidence to Drive Behaviorcited by 10
  9. 2025Enhancing Critical Thinking in Generative AI Search with Metacognitive Promptscited by 8
  10. 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
  11. 2025Beyond Accuracy: How AI Metacognitive Sensitivity improves AI-assisted Decision Makingcited by 2
  12. 2025The AI Memory Gap: Users Misremember What They Created With AI or Withoutcited by 2
  13. 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
  14. 2026Boosting metacognition in entangled human-AI interaction to navigate cognitive-behavioral driftcited by 1
  15. 2026LearnMate^2: Design and Evaluation of an LLM-powered Personalized and Adaptive Support System for Online Learningcited by 1
  16. 2026Explaining Too Much? Understanding How Large Language Model Reasoning Traces Influence Performance and Metacognitioncited by 1
  17. 2026When AI Is Wrong on Purpose: How Students Respond to Buggy GenAI Codecited by 1

Built on by

Not cited yet.