mlsanityData to 14 Oct 2026

Multi-Agent Collaborative Framework For Math Problem Generation

arXiv 2511.03958 ↗First posted 6 Nov 2025cs.MA cs.CL cs.HCcited by 5

On the map: LLM agents and tool use → Educational agents and math problem solving

Abstract (arXiv)

Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language generation, they often struggle to precisely control problem complexity and cognitive demands. In this paper, we introduce a collaborative multi-agent framework as a novel method of incorporating inference-time computation into AQG. This approach leverages multiple agents that iteratively refine generated question-answer pairs to better balance complexity and cognitive demand. We evaluate the generated questions on five meta-evaluation criteria: relevance, importance, clarity, difficulty matching, answerability, to assess the system's ability to control the required complexity and quality of the questions. Preliminary evaluations show that this collaborative multi-agent framework elevates the quality of generated educational content by fostering a more nuanced balance between cognitive challenge and clarity. These promising outcomes suggest that integrating collaborative multi-agent workflows can yield more controlled, pedagogically valuable content that can help advance automated educational content generation and adaptive learning environments.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 16 of its 22 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

16 of 22 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  6. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  8. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  9. 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 150
  10. 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 145
  11. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 48
  12. 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
4 more
  1. 2021Math Word Problem Generation with Mathematical Consistency and Problem Context Constraintscited by 27
  2. 2024QGEval: Benchmarking Multi-dimensional Evaluation for Question Generationcited by 17
  3. 2024DHP Benchmark: Are LLMs Good NLG Evaluators?cited by 12
  4. 2025A Novel Approach to Scalable and Automatic Topic-Controlled Question Generation in Educationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EduAgentQG: Multi-Agent Personalized Mathematics Question Generation with Explicit Diversity and Objective-Aware Evaluation
  2. 2025A LLM-Driven Multi-Agent Systems for Professional Development of Mathematics Teachers
  3. 2025AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation
  4. 2026Bidirectional Curriculum Generation: A Multi-Agent Framework for Data-Efficient Mathematical Reasoning
  5. 2025V-Math: An Agentic Approach to the Vietnamese National High School Graduation Mathematics Exams
  6. 2026GamED.AI: A Hierarchical Multi-Agent Framework for Automated Educational Game Generation
  7. 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problems
  8. 2025Agentic Workflow for Education: Concepts and Applications