Bridging the AI Adoption Gap: Designing an Interactive Pedagogical Agent for Higher Education Instructors
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
Instructors play a pivotal role in integrating AI into education, yet their adoption of AI-powered tools remains inconsistent. Despite this, limited research explores how to design AI tools that support broader instructor adoption. This study applies a human-centered design approach, incorporating qualitative methods, to investigate the design of interactive pedagogical agents that provide instructional suggestions in response to instructors' questions. We conducted a formative study involving interviews with five pedagogy experts to examine existing strategies for supporting instructors' pedagogical needs. Building on these insights, we facilitated a participatory design session with ten pedagogy experts, where participants reviewed a storyboard depicting a chatbot designed for instructors with varying levels of AI literacy and differing attitudes toward AI. Experts also evaluated the quality of LLM-generated suggestions based on common teaching challenges. Our findings highlight the need for chatbot interactions that foster trust, especially for AI-conservative instructors. Experts emphasized the importance of social transparency (for example, showing how peers use the tool) and allowing instructors to flexibly control how much or how little they engage with the system. We also propose design recommendations to enhance the quality of AI-generated teaching suggestions, such as adapting them to reflect instructors' prior teaching experience. This work underscores the urgent need to support AI-conservative instructors, as AI literacy and attitudes are closely intertwined. Without thoughtful design, there is a risk of widening pedagogical divides and reducing students' learning opportunities.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 13 of its 34 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
13 of 34 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testingcited by 88
- 2023Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Reviewcited by 83
- 2023EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteriacited by 73
- 2024Generative Students: Using LLM-Simulated Student Profiles to Support Question Item Evaluationcited by 56
- 2024Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytellingcited by 21
- 2020Engaging Teachers to Co-Design Integrated AI Curriculum for K-12 Classroomscited by 14
- 2024LLM-Driven Learning Analytics Dashboard for Teachers in EFL Writing Educationcited by 5
- 2023Adoption of Artificial Intelligence in Schools: Unveiling Factors Influencing Teachers Engagementcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Building Scaffolding Dialogue Data with LLM-Simulated Novicescited by 2
- 2025Exploring Conversational Design Choices in LLMs for Pedagogical Purposes: Socratic and Narrative Approaches for Improving Instructor's Teaching Practicecited by 1
- 2026TeachingCoach: A Fine-Tuned Scaffolding Chatbot for Instructional Guidance to Instructorscited by 0
- 2026Agentic AI Ecosystems in Higher Education: A Perspective on AI Agents to Emerging Inclusive, Agentic Multi-Agent AI Framework for Learning, Teaching and Institutional Intelligencecited by 0
- 2026Agentic AI Ecosystems in Higher Education: A Perspective on AI Agents to Emerging Inclusive, Agentic Multi-Agent AI Framework for Learning, Teaching and Institutional Intelligence14 May 2026
- 2026TeachingCoach: A Fine-Tuned Scaffolding Chatbot for Instructional Guidance to Instructors18 Mar 2026
- 2025Exploring Conversational Design Choices in LLMs for Pedagogical Purposes: Socratic and Narrative Approaches for Improving Instructor's Teaching Practice15 Sep 2025
- 2025Building Scaffolding Dialogue Data with LLM-Simulated Novices6 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Towards AI Agents for Course Instruction in Higher Education: Early Experiences from the Field
- 2025Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
- 2026Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning
- 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practice
- 2026Addressing the Reality Gap: A Three-Tension Framework for Agentic AI Adoption
- 2026Modularizing Educational LLM-Agency for Fostering Responsible Learning Assistance
- 2026Tutor, Not Solver: Designing a Guardrailed AI Assistant for Learning in Higher Education: A Design Case of PeteChat ↗
- 2025From Passive Tool to Socio-cognitive Teammate: A Conceptual Framework for Agentic AI in Human-AI Collaborative Learning