# Enhancing Critical Thinking in Generative AI Search with Metacognitive Prompts

arXiv: https://arxiv.org/abs/2505.24014 · HTML: https://mlsanity.com/paper/2505.24014/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 May 2025.

## Built on by (most cited first, 8 of 8)

- [AI Agents Push Humans Out of the Loop](https://mlsanity.com/paper/2608.23642/) (2026)
- [Orality: A Semantic Canvas for Externalizing and Clarifying Thoughts with Speech](https://mlsanity.com/paper/2603.02544/) (2026)
- [Metacognition in LLMs: Foundations, Progress, and Opportunities](https://mlsanity.com/paper/2607.11881/) (2026)
- [MetaCues: Enabling Critical Engagement with Generative AI for Information Seeking and Sensemaking](https://mlsanity.com/paper/2603.19634/) (2026)
- [Impact of Multimodal and Conversational AI on Learning Outcomes and Experience](https://mlsanity.com/paper/2604.02221/) (2026)
- [Access Timing as Scaffolding: A Reinforcement Learning Approach to GenAI in Education](https://mlsanity.com/paper/2605.15850/) (2026)
- [Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work](https://mlsanity.com/paper/2609.17065/) (2026)
- [Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants](https://mlsanity.com/paper/2609.20143/) (2026)

## Abstract (arXiv)

The growing use of Generative AI (GenAI) conversational search tools has raised concerns about their effects on people's metacognitive engagement, critical thinking, and learning. As people increasingly rely on GenAI to perform tasks such as analyzing and applying information, they may become less actively engaged in thinking and learning. This study examines whether metacognitive prompts - designed to encourage people to pause, reflect, assess their understanding, and consider multiple perspectives - can support critical thinking during GenAI-based search. We conducted a user study (N=40) with university students to investigate the impact of metacognitive prompts on their thought processes and search behaviors while searching with a GenAI tool. We found that these prompts led to more active engagement, prompting students to explore a broader range of topics and engage in deeper inquiry through follow-up queries. Students reported that the prompts were especially helpful for considering overlooked perspectives, promoting evaluation of AI responses, and identifying key takeaways. Additionally, the effectiveness of these prompts was influenced by students' metacognitive flexibility. Our findings highlight the potential of metacognitive prompts to foster critical thinking and provide insights for designing and implementing metacognitive support in human-AI interactions.