Beyond Automation: Socratic AI, Epistemic Agency, and the Implications of the Emergence of Orchestrated Multi-Agent Learning Architectures
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
Generative AI is no longer a peripheral tool in higher education. It is rapidly evolving into a general-purpose infrastructure that reshapes how knowledge is generated, mediated, and validated. This paper presents findings from a controlled experiment evaluating a Socratic AI Tutor, a large language model designed to scaffold student research question development through structured dialogue grounded in constructivist theory. Conducted with 65 pre-service teacher students in Germany, the study compares interaction with the Socratic Tutor to engagement with an uninstructed AI chatbot. Students using the Socratic Tutor reported significantly greater support for critical, independent, and reflective thinking, suggesting that dialogic AI can stimulate metacognitive engagement and challenging recent narratives of de-skilling due to generative AI usage. These findings serve as a proof of concept for a broader pedagogical shift: the use of multi-agent systems (MAS) composed of specialised AI agents. To conceptualise this, we introduce the notion of orchestrated MAS, modular, pedagogically aligned agent constellations, curated by educators, that support diverse learning trajectories through differentiated roles and coordinated interaction. To anchor this shift, we propose an adapted offer-and-use model, in which students appropriate instructional offers from these agents. Beyond technical feasibility, we examine system-level implications for higher education institutions and students, including funding necessities, changes to faculty roles, curriculars, competencies and assessment practices. We conclude with a comparative cost-effectiveness analysis highlighting the scalability of such systems. In sum, this study contributes both empirical evidence and a conceptual roadmap for hybrid learning ecosystems that embed human-AI co-agency and pedagogical alignment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 18 of its 91 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
18 of 91 references.
References · 18
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
- 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 286
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 109
- 2023Testing of Detection Tools for AI-Generated Textcited by 90
- 2024Large language models surpass human experts in predicting neuroscience resultscited by 69
- 2024Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performancecited by 58
- 2023Students' Voices on Generative AI: Perceptions, Benefits, and Challenges in Higher Educationcited by 41
- 2020Bias and Discrimination in AI: a cross-disciplinary perspectivecited by 24
- 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
- 2022The Brussels Effect and Artificial Intelligence: How EU regulation will impact the global AI marketcited by 18
- 2025MARS: Multi-Agent Adaptive Reasoning with Socratic Guidance for Automated Prompt Optimizationcited by 15
- 2025De-skilling, Cognitive Offloading, and Misplaced Responsibilities: Potential Ironies of AI-Assisted Designcited by 11
6 more
- 2023Better by you, better than me, chatgpt3 as writing assistance in students essayscited by 9
- 2024On Prompt Sensitivity of ChatGPT in Affective Computingcited by 7
- 2025Beyond Tools: Generative AI as Epistemic Infrastructure in Educationcited by 4
- 2025Neural Orchestration for Multi-Agent Systems: A Deep Learning Framework for Optimal Agent Selection in Multi-Domain Task Environmentscited by 3
- 2025IntelliChain: An Integrated Framework for Enhanced Socratic Method Dialogue with LLMs and Knowledge Graphscited by 2
- 2024Delegating Responsibilities to Intelligent Autonomous Systems: Challenges and Benefitscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Resurrecting Socrates in the Age of AI: A Study Protocol for Evaluating a Socratic Tutor to Support Research Question Development in Higher Education
- 2025Agentic AI as Undercover Teammates: Argumentative Knowledge Construction in Hybrid Human-AI Collaborative Learning
- 2026Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning
- 2025AI Pedagogy: Dialogic Social Learning for Artificial Agents
- 2025Enabling Multi-Agent Systems as Learning Designers: Applying Learning Sciences to AI Instructional Design
- 2026A Theory-Guided LLM Pedagogical Agent for STEM+C Scaffolding Without Over-Reliance
- 2025Interactionalism: Re-Designing Higher Learning for the Large Language Agent Era
- 2025A Theory of Adaptive Scaffolding for LLM-Based Pedagogical Agents