Multi-Agent Collaborative Framework For Math Problem Generation
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language generation, they often struggle to precisely control problem complexity and cognitive demands. In this paper, we introduce a collaborative multi-agent framework as a novel method of incorporating inference-time computation into AQG. This approach leverages multiple agents that iteratively refine generated question-answer pairs to better balance complexity and cognitive demand. We evaluate the generated questions on five meta-evaluation criteria: relevance, importance, clarity, difficulty matching, answerability, to assess the system's ability to control the required complexity and quality of the questions. Preliminary evaluations show that this collaborative multi-agent framework elevates the quality of generated educational content by fostering a more nuanced balance between cognitive challenge and clarity. These promising outcomes suggest that integrating collaborative multi-agent workflows can yield more controlled, pedagogically valuable content that can help advance automated educational content generation and adaptive learning environments.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 16 of its 22 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
16 of 22 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 150
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 145
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 48
- 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
4 more
- 2021Math Word Problem Generation with Mathematical Consistency and Problem Context Constraintscited by 27
- 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generationcited by 17
- 2024DHP Benchmark: Are LLMs Good NLG Evaluators?cited by 12
- 2025A Novel Approach to Scalable and Automatic Topic-Controlled Question Generation in Educationcited by 11
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Enhancing Diversity of LLM-Generated Educational Taskscited by 2
- 2026Latent-DARM: Bridging Discrete Diffusion And Autoregressive Models For Reasoningcited by 1
- 2026A self-evolving multi-role collaborative framework with fine-grained difficulty guidance for innovative mathematical problem generationcited by 0
- 2026A Multi-Agent Approach to Validate and Refine LLM-Generated Personalized Math Problemscited by 0
- 2026Lect=uraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teachingcited by 0
- 2026Lect=uraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching15 Jun 2026
- 2026A Multi-Agent Approach to Validate and Refine LLM-Generated Personalized Math Problems6 Apr 2026
- 2026Latent-DARM: Bridging Discrete Diffusion And Autoregressive Models For Reasoning10 Mar 2026
- 2026A self-evolving multi-role collaborative framework with fine-grained difficulty guidance for innovative mathematical problem generation16 Jan 2026
- 2025Enhancing Diversity of LLM-Generated Educational Tasks29 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025EduAgentQG: Multi-Agent Personalized Mathematics Question Generation with Explicit Diversity and Objective-Aware Evaluation
- 2025A LLM-Driven Multi-Agent Systems for Professional Development of Mathematics Teachers
- 2025AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation
- 2026Bidirectional Curriculum Generation: A Multi-Agent Framework for Data-Efficient Mathematical Reasoning
- 2025V-Math: An Agentic Approach to the Vietnamese National High School Graduation Mathematics Exams
- 2026GamED.AI: A Hierarchical Multi-Agent Framework for Automated Educational Game Generation
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problems
- 2025Agentic Workflow for Education: Concepts and Applications