mlsanityData to 7 Oct 2026

Bridging the AI Adoption Gap: Designing an Interactive Pedagogical Agent for Higher Education Instructors

arXiv 2503.05039 ↗First posted 6 Mar 2025cs.HCcited by 4

On the map: LLM agents and tool use → Educational agents and math problem solving

Abstract (arXiv)

Instructors play a pivotal role in integrating AI into education, yet their adoption of AI-powered tools remains inconsistent. Despite this, limited research explores how to design AI tools that support broader instructor adoption. This study applies a human-centered design approach, incorporating qualitative methods, to investigate the design of interactive pedagogical agents that provide instructional suggestions in response to instructors' questions. We conducted a formative study involving interviews with five pedagogy experts to examine existing strategies for supporting instructors' pedagogical needs. Building on these insights, we facilitated a participatory design session with ten pedagogy experts, where participants reviewed a storyboard depicting a chatbot designed for instructors with varying levels of AI literacy and differing attitudes toward AI. Experts also evaluated the quality of LLM-generated suggestions based on common teaching challenges. Our findings highlight the need for chatbot interactions that foster trust, especially for AI-conservative instructors. Experts emphasized the importance of social transparency (for example, showing how peers use the tool) and allowing instructors to flexibly control how much or how little they engage with the system. We also propose design recommendations to enhance the quality of AI-generated teaching suggestions, such as adapting them to reflect instructors' prior teaching experience. This work underscores the urgent need to support AI-conservative instructors, as AI literacy and attitudes are closely intertwined. Without thoughtful design, there is a risk of widening pedagogical divides and reducing students' learning opportunities.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 13 of its 34 references that are in the map. First posted on arXiv 6 Mar 2025.

Builds on

13 of 34 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  5. 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testingcited by 88
  6. 2023Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Reviewcited by 83
  7. 2023EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteriacited by 73
  8. 2024Generative Students: Using LLM-Simulated Student Profiles to Support Question Item Evaluationcited by 56
  9. 2024Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytellingcited by 21
  10. 2020Engaging Teachers to Co-Design Integrated AI Curriculum for K-12 Classroomscited by 14
  11. 2024LLM-Driven Learning Analytics Dashboard for Teachers in EFL Writing Educationcited by 5
  12. 2023Adoption of Artificial Intelligence in Schools: Unveiling Factors Influencing Teachers Engagementcited by 4
1 more
  1. 2024Who is Helping Whom? Student Concerns about AI- Teacher Collaboration in Higher Education Classroomscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards AI Agents for Course Instruction in Higher Education: Early Experiences from the Field
  2. 2025Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
  3. 2026Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning
  4. 2025Feed-O-Meter: Investigating AI-Generated Mentee Personas as Interactive Agents for Scaffolding Design Feedback Practice
  5. 2026Addressing the Reality Gap: A Three-Tension Framework for Agentic AI Adoption
  6. 2026Modularizing Educational LLM-Agency for Fostering Responsible Learning Assistance
  7. 2026Tutor, Not Solver: Designing a Guardrailed AI Assistant for Learning in Higher Education: A Design Case of PeteChat ↗
  8. 2025From Passive Tool to Socio-cognitive Teammate: A Conceptual Framework for Agentic AI in Human-AI Collaborative Learning