mlsanityData to 7 Oct 2026

Unleashing Diverse Thinking Modes in LLMs through Multi-Agent Collaboration

arXiv 2510.16645 ↗First posted 18 Oct 2025cs.CL cs.AI cs.LGcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) demonstrate strong performance but often lack interpretable reasoning. This paper introduces the Multi-Agent Collaboration Framework for Diverse Thinking Modes (DiMo), which enhances both performance and interpretability by simulating a structured debate among four specialized LLM agents. Each agent embodies a distinct reasoning paradigm, allowing the framework to collaboratively explore diverse cognitive approaches. Through iterative debate, agents challenge and refine initial responses, yielding more robust conclusions and an explicit, auditable reasoning chain. Across six benchmarks and under a unified open-source setup, DiMo improves accuracy over widely used single-model and debate baselines, with the largest gains on math. We position DiMo as a semantics-aware, Web-native multi-agent framework: it models human-machine intelligence with LLM agents that produce semantically typed, URL-annotated evidence chains for explanations and user-friendly interactions. Although our experiments use standard reasoning benchmarks, the framework is designed to be instantiated over Web corpora and knowledge graphs, combining retrieval-augmented reasoning with structured justifications that downstream systems can inspect and reuse.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 35 references that are in the map. First posted on arXiv 18 Oct 2025.

Builds on

23 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Learning to Break: Knowledge-Enhanced Reasoning in Multi-Agent Debate System8 Dec
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 21

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2024Qwen2.5 Technical Reportcited by 4,713
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  7. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  8. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  9. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  10. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  11. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  12. 2024DeepSeek-V3 Technical Reportcited by 724
9 more
  1. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  2. 2022PAL: Program-aided Language Modelscited by 635
  3. 2023Active Retrieval Augmented Generationcited by 506
  4. 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 331
  5. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
  6. 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 94
  7. 2024From Understanding to Utilization: A Survey on Explainability for Large Language Modelscited by 47
  8. 2024Self-Reflection in LLM Agents: Effects on Problem-Solving Performancecited by 38
  9. 2024Large Language Models are Interpretable Learnerscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
  2. 2026A Comprehensive Evaluation of LLM Reasoning: From Single-Model to Multi-Agent Paradigms
  3. 2025MARS: toward more efficient multi-agent collaboration for LLM reasoning
  4. 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoning
  5. 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
  6. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
  7. 2024Enhancing LLM Reasoning with Multi-Path Collaborative Reactive and Reflection agents
  8. 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation