# Beyond Automation: Socratic AI, Epistemic Agency, and the Implications of the Emergence of Orchestrated Multi-Agent Learning Architectures

arXiv: https://arxiv.org/abs/2508.05116 · HTML: https://mlsanity.com/paper/2508.05116/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use.
- Builds on 18 of its 91 references that are in the map.
- First posted on arXiv 7 Aug 2025.

## Placed in

- LLM agents and tool use / [Educational agents and math problem solving](https://mlsanity.com/agents/educational-agents-and-math-problem-solving/)

## Builds on (most cited first, 18 of 18)

- [Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models](https://mlsanity.com/paper/2309.01219/) (2023)
- [MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data](https://mlsanity.com/paper/2304.08247/) (2023)
- [On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial](https://mlsanity.com/paper/2403.14380/) (2024)
- [Testing of Detection Tools for AI-Generated Text](https://mlsanity.com/paper/2306.15666/) (2023)
- [Large language models surpass human experts in predicting neuroscience results](https://mlsanity.com/paper/2403.03230/) (2024)
- [Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performance](https://mlsanity.com/paper/2412.09315/) (2024)
- [Students' Voices on Generative AI: Perceptions, Benefits, and Challenges in Higher Education](https://mlsanity.com/paper/2305.00290/) (2023)
- [Bias and Discrimination in AI: a cross-disciplinary perspective](https://mlsanity.com/paper/2008.07309/) (2020)
- [Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativity](https://mlsanity.com/paper/2303.12003/) (2023)
- [The Brussels Effect and Artificial Intelligence: How EU regulation will impact the global AI market](https://mlsanity.com/paper/2208.12645/) (2022)
- [MARS: Multi-Agent Adaptive Reasoning with Socratic Guidance for Automated Prompt Optimization](https://mlsanity.com/paper/2503.16874/) (2025)
- [De-skilling, Cognitive Offloading, and Misplaced Responsibilities: Potential Ironies of AI-Assisted Design](https://mlsanity.com/paper/2503.03924/) (2025)
- [Better by you, better than me, chatgpt3 as writing assistance in students essays](https://mlsanity.com/paper/2302.04536/) (2023)
- [On Prompt Sensitivity of ChatGPT in Affective Computing](https://mlsanity.com/paper/2403.14006/) (2024)
- [Beyond Tools: Generative AI as Epistemic Infrastructure in Education](https://mlsanity.com/paper/2504.06928/) (2025)
- [Neural Orchestration for Multi-Agent Systems: A Deep Learning Framework for Optimal Agent Selection in Multi-Domain Task Environments](https://mlsanity.com/paper/2505.02861/) (2025)
- [IntelliChain: An Integrated Framework for Enhanced Socratic Method Dialogue with LLMs and Knowledge Graphs](https://mlsanity.com/paper/2502.00010/) (2025)
- [Delegating Responsibilities to Intelligent Autonomous Systems: Challenges and Benefits](https://mlsanity.com/paper/2411.15147/) (2024)

## Built on by (most cited first, 1 of 1)

- [Agentic AI Ecosystems in Higher Education: A Perspective on AI Agents to Emerging Inclusive, Agentic Multi-Agent AI Framework for Learning, Teaching and Institutional Intelligence](https://mlsanity.com/paper/2605.14266/) (2026)

## Abstract (arXiv)

Generative AI is no longer a peripheral tool in higher education. It is rapidly evolving into a general-purpose infrastructure that reshapes how knowledge is generated, mediated, and validated. This paper presents findings from a controlled experiment evaluating a Socratic AI Tutor, a large language model designed to scaffold student research question development through structured dialogue grounded in constructivist theory. Conducted with 65 pre-service teacher students in Germany, the study compares interaction with the Socratic Tutor to engagement with an uninstructed AI chatbot. Students using the Socratic Tutor reported significantly greater support for critical, independent, and reflective thinking, suggesting that dialogic AI can stimulate metacognitive engagement and challenging recent narratives of de-skilling due to generative AI usage. These findings serve as a proof of concept for a broader pedagogical shift: the use of multi-agent systems (MAS) composed of specialised AI agents. To conceptualise this, we introduce the notion of orchestrated MAS, modular, pedagogically aligned agent constellations, curated by educators, that support diverse learning trajectories through differentiated roles and coordinated interaction. To anchor this shift, we propose an adapted offer-and-use model, in which students appropriate instructional offers from these agents. Beyond technical feasibility, we examine system-level implications for higher education institutions and students, including funding necessities, changes to faculty roles, curriculars, competencies and assessment practices. We conclude with a comparative cost-effectiveness analysis highlighting the scalability of such systems. In sum, this study contributes both empirical evidence and a conceptual roadmap for hybrid learning ecosystems that embed human-AI co-agency and pedagogical alignment.