mlsanityData to 7 Oct 2026

MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathematical Problems

arXiv 2404.04735 ↗First posted 6 Apr 2024cs.AI cs.CL cs.MAcited by 41

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Recent advancements in large language models, such as GPT-4, have demonstrated remarkable capabilities in processing standard queries. Despite these advancements, their performance substantially declines in advanced mathematical problems requiring complex, multi-step logical reasoning. To enhance their inferential capabilities, current research has delved into textitprompting engineering, exemplified by methodologies such as the Tree of Thought and Graph of Thought. Nonetheless, these existing approaches encounter two significant limitations. Firstly, their effectiveness in tackling complex mathematical problems is somewhat constrained. Secondly, the necessity to design distinct prompts for individual problems hampers their generalizability. In response to these limitations, this paper introduces the textitMulti-Agent System for conditional Mining (MACM) prompting method. It not only resolves intricate mathematical problems but also demonstrates strong generalization capabilities across various mathematical contexts. With the assistance of MACM, the accuracy of GPT-4 Turbo on the most challenging level five mathematical problems in the MATH dataset increase from 54.68% to 76.73%. The code is available in urlhttps://github.com/bin123apple/MACM.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 23 references that are in the map. First posted on arXiv 6 Apr 2024.

Builds on

18 of 23 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification15 Aug
  2. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models20 Jul

Other references · 16

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  10. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  11. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  12. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
4 more
  1. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
  2. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
  3. 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 106
  4. 2023Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thoughtcited by 41

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 23; 2026: 14.

41 papers.

Sort:

By area:

  1. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
  2. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  3. 2025LLM Agents for Education: Advances and Applicationscited by 59
  4. 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
  5. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
  6. 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
  7. 2025KLASS: KL-Guided Fast Inference in Masked Diffusion Modelscited by 44
  8. 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 37
  9. 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Modelscited by 33
  10. 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMscited by 33
  11. 2025ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Taskscited by 30
  12. 2025Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systemscited by 22
29 more
  1. 2024Deliberate Reasoning in Language Models as Structure-Aware Planning with an Accurate World Modelcited by 20
  2. 2025MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systemscited by 14
  3. 2024Infant Agent: A Tool-Integrated, Logic-Driven Agent with Cost-Effective API Usagecited by 11
  4. 2025Synergizing Logical Reasoning, Knowledge Management and Collaboration in Multi-Agent LLM Systemcited by 10
  5. 2025CMCTS: A Constrained Monte Carlo Tree Search Framework for Mathematical Reasoning in Large Language Modelcited by 9
  6. 2025Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMscited by 9
  7. 2025ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Modelscited by 8
  8. 2025To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systemscited by 6
  9. 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 5
  10. 2025A Survey of Deep Learning for Geometry Problem Solvingcited by 4
  11. 2026From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Searchcited by 4
  12. 2025Reducing Cognitive Overhead in Tool Use via Multi-Small-Agent Reinforcement Learningcited by 3
  13. 2025MAS-Shield: A Defense Framework for Secure and Efficient LLM MAScited by 3
  14. 2026TopoDIM: One-shot Topology Generation of Diverse Interaction Modes for Multi-Agent Systemscited by 3
  15. 2025Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMscited by 2
  16. 2025Tool-RoCo: An Agent-as-Tool Self-organization Large Language Model Benchmark in Multi-robot Cooperationcited by 2
  17. 2026Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energycited by 2
  18. 2026Agent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learningcited by 2
  19. 2025A Physics-Informed Learning Framework to Solve the Infinite-Horizon Optimal Control Problemcited by 1
  20. 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervisioncited by 1
  21. 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systemscited by 1
  22. 2026AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systemscited by 1
  23. 2026A self-evolving multi-role collaborative framework with fine-grained difficulty guidance for innovative mathematical problem generationcited by 0
  24. 2026Disentangling Intrinsic Importance from Emergent Structure in Multi-Expert Orchestrationcited by 0
  25. 2026X-RAY: Mapping LLM Reasoning Capability via Formalized and Calibrated Probescited by 0
  26. 2026Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Playcited by 0
  27. 2026MARS: Multi-Specialist LLM Relay System for Competitive Programmingcited by 0
  28. 2026BusMA: A Bus Communication Substrate for Multi-Agent Systemscited by 0
  29. 2026Concealing LLM-Based Multi-Agent Topology via Phantom Structure Injectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning
  2. 2025PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models
  3. 2023MathChat: Converse to Tackle Challenging Math Problems with LLM Agents
  4. 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
  5. 2024Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models
  6. 2023Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent
  7. 2024ControlMath: Controllable Data Generation Promotes Math Generalist Models
  8. 2025Teaching LLMs to Think Mathematically: A Critical Study of Decision-Making via Optimization