The Metacognitive Demands and Opportunities of Generative AI
Not on the map. Why?
Abstract (arXiv)
Generative AI (GenAI) systems offer unprecedented opportunities for transforming professional and personal work, yet present challenges around prompting, evaluating and relying on outputs, and optimizing workflows. We argue that metacognitionunicodex2013the psychological ability to monitor and control one's thoughts and behaviorunicodex2013offers a valuable lens to understand and design for these usability challenges. Drawing on research in psychology and cognitive science, and recent GenAI user studies, we illustrate how GenAI systems impose metacognitive demands on users, requiring a high degree of metacognitive monitoring and control. We propose these demands could be addressed by integrating metacognitive support strategies into GenAI systems, and by designing GenAI systems to reduce their metacognitive demand by targeting explainability and customizability. Metacognition offers a coherent framework for understanding the usability challenges posed by GenAI, and provides novel research and design directions to advance human-AI interaction.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 15; 2025: 36; 2026: 34.
85 papers.
Sort:
By area:
- 2024The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmerscited by 46
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2024Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decompositioncited by 29
- 2024On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbotscited by 23
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Waycited by 19
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Exploring the Design Space of Cognitive Engagement Techniques with AI-Generated Code for Enhanced Learningcited by 16
- 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agentcited by 14
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Toolscited by 13
- 2024Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Toolscited by 13
- 2025Truly Self-Improving Agents Require Intrinsic Metacognitive Learningcited by 13
- 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creationcited by 9
38 more
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
- 2026Computational Hermeneutics: Evaluating generative AI as a cultural technologycited by 7
- 2024Data Analysis in the Era of Generative AIcited by 6
- 2025Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflowscited by 6
- 2025Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creationcited by 6
- 2025Helping Johnny Make Sense of Privacy Policies with LLMscited by 5
- 2025TableTalk: Scaffolding Spreadsheet Development with a Language Agentcited by 5
- 2025CorpusStudio: Surfacing Emergent Patterns in a Corpus of Prior Work while Writingcited by 5
- 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5
- 2025From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactionscited by 4
- 2025The Future of Generative AI in Software Engineering: A Vision from Industry and Academia in the European GENIUS Projectcited by 4
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
- 2025MeetMap: Real-Time Collaborative Dialogue Mapping with LLMs in Online Meetingscited by 3
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025From Consumption to Collaboration: Measuring Interaction Patterns to Augment Human Cognition in Open-Ended Taskscited by 3
- 2025Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scalecited by 3
- 2025NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modificationcited by 3
- 2024Understanding Help-Seeking Behavior of Students Using LLMs vs. Web Search for Writing SQL Queriescited by 2
- 2025Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AIcited by 2
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Withoutcited by 2
- 2025Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implicationscited by 2
- 2025Coding With AI: From a Reflection on Industrial Practices to Future Computer Science and Software Engineering Educationcited by 2
- 2026"If You're Very Clever, No One Knows You've Used It": The Social Dynamics of Developing Generative AI Literacy in the Workplacecited by 2
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaborationcited by 2
- 2024Judgment of Learning: A Human Ability Beyond Generative Artificial Intelligencecited by 1
- 2024Generative AI in Medicinecited by 1
- 2025Lessons for GenAI Literacy From a Field Study of Human-GenAI Augmentation in the Workplacecited by 1
- 2025Supporting Students' Reading and Cognition with AIcited by 1
- 2025Steerable Chatbots: Exploring Personalization Control Interfaces via LLM Activation Steeringcited by 1
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writingcited by 1
- 2025AI That Helps Us Help Each Other: A Proactive System for Scaffolding Mentor-Novice Collaboration in Entrepreneurship Coachingcited by 1
- 2025Orchid: Orchestrating Context Across Creative Workflows with Generative AIcited by 1
- 2025User Misconceptions of LLM-Based Conversational Programming Assistantscited by 1
- 2025Demystify, Use, Reflect: Preparing students to be informed LLM-userscited by 1
- 2026Understanding Users' Privacy Reasoning and Behaviors During Chatbot Use to Support Meaningful Agency in Privacycited by 1
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agentscited by 1
50 most cited of 85 All 85 (JSON)
- 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows22 Sep 2026
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants17 Sep 2026
- 2026Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work15 Sep 2026
- 2026Personalizing Personal Health Interfaces: Co-Design with Generative AI14 Sep 2026
- 2026LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions13 Sep 2026
- 2026Plans They Abandon, Reports They Author: The Narrative Layer of Autonomous Agents10 Sep 2026
- 2026AI Soccer Analyst: Stage-Aware and Verifiable Human-AI Collaboration for Soccer Data Analysis10 Sep 2026
- 2026RecalibrateGPT: AI Fatigue Resilient Conversational Interfaces1 Sep 2026
- 2026Q&A or Document-Based? The Effects of Interface Type on How Screen Reader Users Access Interconnected Documents26 Aug 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI3 Aug 2026
38 more
- 2026Is Solving Better Than Evaluating GenAI Solutions?30 Jul 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Co-Construction Blindness and Asymmetric Epistemic Vulnerability in Human-LLM Interaction18 Jun 2026
- 2026SCAN: A Decision-Making Framework for Effective Task Allocation with Generative AI14 Jun 2026
- 2026Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI4 Jun 2026
- 2026Access Timing as Scaffolding: A Reinforcement Learning Approach to GenAI in Education15 May 2026
- 2026Conversations in Space: Non-Linear LLM Interaction in Everyday Use15 May 2026
- 2026Position: Artificial Intelligence Needs Meta Intelligence -- the Case for Metacognitive AI15 May 2026
- 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wild7 May 2026
- 2026Co-Writing with AI: An Empirical Study of Diverse Academic Writing Workflows28 Apr 2026
- 2026CogInstrument: Modeling Cognitive Processes for Bidirectional Human-LLM Alignment in Planning Tasks12 Apr 2026
- 2026From Binary Groundedness to Support Relations: Towards a Reader-Centred Taxonomy for Comprehension of AI Output9 Apr 2026
- 2026Effects of Generative AI Errors on User Reliance Across Task Difficulty5 Apr 2026
- 2026Human Thinking under Plural LLM Assistance: Mathematical Problem Solving and Open-Ended Writing3 Apr 2026
- 2026Computational Hermeneutics: Evaluating generative AI as a cultural technology31 Mar 2026
- 2026MetaCues: Enabling Critical Engagement with Generative AI for Information Seeking and Sensemaking20 Mar 2026
- 2026Human-AI Collaboration in Large Language Model-Integrated Building Energy Management Systems: The Role of User Domain Knowledge and AI Literacy18 Feb 2026
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaboration13 Feb 2026
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agents2 Feb 2026
- 2026"If You're Very Clever, No One Knows You've Used It": The Social Dynamics of Developing Generative AI Literacy in the Workplace1 Feb 2026
- 2026Understanding Users' Privacy Reasoning and Behaviors During Chatbot Use to Support Meaningful Agency in Privacy26 Jan 2026
- 2026Exploring Learners' Expectations and Engagement When Collaborating with Constructively Controversial Peer Agents20 Jan 2026
- 2025Coding With AI: From a Reflection on Industrial Practices to Future Computer Science and Software Engineering Education30 Dec 2025
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaboration16 Nov 2025
- 2025Demystify, Use, Reflect: Preparing students to be informed LLM-users14 Nov 2025
- 2025Owlgorithm: Supporting Self-Regulated Learning in Competitive Programming through LLM-Driven Reflection13 Nov 2025
- 2025Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implications6 Nov 2025
- 2025The Future of Generative AI in Software Engineering: A Vision from Industry and Academia in the European GENIUS Project3 Nov 2025
- 2025User Misconceptions of LLM-Based Conversational Programming Assistants29 Oct 2025
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Without15 Sep 2025
- 2025Collaborative Document Editing with Multiple Users and AI Agents15 Sep 2025
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Models28 Aug 2025
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshop28 Aug 2025
- 2025Orchid: Orchestrating Context Across Creative Workflows with Generative AI27 Aug 2025
- 2025AI That Helps Us Help Each Other: A Proactive System for Scaffolding Mentor-Novice Collaboration in Entrepreneurship Coaching14 Aug 2025
- 2025NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification5 Aug 2025
- 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agent24 Jul 2025
- 2025Exploring Artificial Intelligence Tutor Teammate Adaptability to Harness Discovery Curiosity and Promote Learning in the Context of Interactive Molecular Dynamics26 Jun 2025
50 newest of 85 All 85 (JSON)
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agentcited by 14
- 2025TableTalk: Scaffolding Spreadsheet Development with a Language Agentcited by 5
- 2025Coding With AI: From a Reflection on Industrial Practices to Future Computer Science and Software Engineering Educationcited by 2
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaborationcited by 2
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agentscited by 1
- 2026Plans They Abandon, Reports They Author: The Narrative Layer of Autonomous Agentscited by 1
- 2025VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agentscited by 0
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaborationcited by 0
- 2026Exploring Learners' Expectations and Engagement When Collaborating with Constructively Controversial Peer Agentscited by 0
- 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AIcited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026Plans They Abandon, Reports They Author: The Narrative Layer of Autonomous Agents10 Sep 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI3 Aug 2026
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaboration13 Feb 2026
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agents2 Feb 2026
- 2026Exploring Learners' Expectations and Engagement When Collaborating with Constructively Controversial Peer Agents20 Jan 2026
- 2025Coding With AI: From a Reflection on Industrial Practices to Future Computer Science and Software Engineering Education30 Dec 2025
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaboration16 Nov 2025
- 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agent24 Jul 2025
- 2025VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agents17 Jun 2025
- 2025TableTalk: Scaffolding Spreadsheet Development with a Language Agent13 Feb 2025
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization3 Aug 2024
- 2024The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmerscited by 46
- 2024Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decompositioncited by 29
- 2024On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbotscited by 23
- 2024Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Waycited by 19
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Exploring the Design Space of Cognitive Engagement Techniques with AI-Generated Code for Enhanced Learningcited by 16
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Toolscited by 13
- 2024Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Toolscited by 13
- 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creationcited by 9
- 2025Generative AI in Knowledge Work: Design Implications for Data Navigation and Decision-Makingcited by 9
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
- 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
12 most cited of 69 All 69 (JSON)
- 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows22 Sep 2026
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants17 Sep 2026
- 2026Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work15 Sep 2026
- 2026Personalizing Personal Health Interfaces: Co-Design with Generative AI14 Sep 2026
- 2026LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions13 Sep 2026
- 2026AI Soccer Analyst: Stage-Aware and Verifiable Human-AI Collaboration for Soccer Data Analysis10 Sep 2026
- 2026RecalibrateGPT: AI Fatigue Resilient Conversational Interfaces1 Sep 2026
- 2026Q&A or Document-Based? The Effects of Interface Type on How Screen Reader Users Access Interconnected Documents26 Aug 2026
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026Is Solving Better Than Evaluating GenAI Solutions?30 Jul 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Co-Construction Blindness and Asymmetric Epistemic Vulnerability in Human-LLM Interaction18 Jun 2026
12 newest of 69 All 69 (JSON)