Enhancing LLM Problem Solving via Tutor-Student Multi-Agent Interaction
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
Human cognitive development is shaped not only by individual effort but by structured social interaction, where role-based exchanges such as those between a tutor and a learner, enable solutions that neither could achieve alone. Inspired by these developmental principles, we ask the question whether a tutor-student multi-agent system can create a synergistic effect by pushing Large Language Model (LLM) beyond what it can do within existing frameworks. To test the idea, we adopt autonomous coding problem domain where two agents instantiated from the same LLM assigned asymmetric roles: a student agent generates and iteratively refines solutions, while a tutor agent provides structured evaluative feedback without access to ground-truth answers. In our proposed framework (PETITE), we aim to extract better problem-solving performance from one model by structuring its interaction through complementary roles, rather than relying on stronger supervisory models or heterogeneous ensembles. Our model is evaluated on the APPS coding benchmark against state-of-the-art approaches of Self-Consistency, Self-Refine, Multi-Agent Debate, and Multi-Agent Review. The results show that our model achieves similar or higher accuracy while consuming significantly fewer tokens. These results suggest that developmentally grounded role-differentiated interaction structures provide a principled and resource-efficient paradigm for enhancing LLM problem-solving through structured peer-like interactions. Index Terms- Peer Tutoring, Scaffolding, Large Language Models, Multi-Agent Systems, Code Generation
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 10 of its 21 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
10 of 21 references.
References · 10
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors
- 2025IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling
- 2025A Theory of Adaptive Scaffolding for LLM-Based Pedagogical Agents
- 2025Enhancing LLM Performance Through Debate: An Empirical Study on Multi-Agent Debate for Coding Tasks
- 2025LLM Agents for Education: Advances and Applications
- 2025Exploring Communication Strategies for Collaborative LLM Agents in Mathematical Problem-Solving
- 2024Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models
- 2025Interactive Learning for LLM Reasoning