mlsanityData to 14 Oct 2026

Reasoning Models Generate Societies of Thought

arXiv 2601.10825 ↗First posted 15 Jan 2026cs.CL cs.CY cs.LGcited by 12

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Large language models have achieved remarkable capabilities across domains, yet mechanisms underlying sophisticated reasoning remain elusive. Recent reasoning models outperform comparable instruction-tuned models on complex cognitive tasks, attributed to extended computation through longer chains of thought. Here we show that enhanced reasoning emerges not from extended computation alone, but from simulating multi-agent-like interactions -- a society of thought -- which enables diversification and debate among internal cognitive perspectives characterized by distinct personality traits and domain expertise. Through quantitative analysis and mechanistic interpretability methods applied to reasoning traces, we find that reasoning models like DeepSeek-R1 and QwQ-32B exhibit much greater perspective diversity than instruction-tuned models, activating broader conflict between heterogeneous personality- and expertise-related features during reasoning. This multi-agent structure manifests in conversational behaviors, including question-answering, perspective shifts, and the reconciliation of conflicting views, and in socio-emotional roles that characterize sharp back-and-forth conversations, together accounting for the accuracy advantage in reasoning tasks. Controlled reinforcement learning experiments reveal that base models increase conversational behaviors when rewarded solely for reasoning accuracy, and fine-tuning models with conversational scaffolding accelerates reasoning improvement over base models. These findings indicate that the social organization of thought enables effective exploration of solution spaces. We suggest that reasoning models establish a computational parallel to collective intelligence in human groups, where diversity enables superior problem-solving when systematically structured, which suggests new opportunities for agent organization to harness the wisdom of crowds.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 74 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

18 of 74 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate5 Sep
  2. 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning7 Apr

Other references · 16

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Steering Language Models With Activation Engineeringcited by 922
  5. 2024DeepSeek-V3 Technical Reportcited by 811
  6. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  7. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  8. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  9. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
  10. 2023SlimPajama-DC: Understanding Data Combinations for LLM Trainingcited by 72
  11. 2025Understanding Reasoning in Thinking Language Models via Steering Vectorscited by 72
  12. 2025I Have Covered All the Bases Here: Interpreting Reasoning Features in Large Language Models via Sparse Autoencoderscited by 45
4 more
  1. 2025Base Models Know How to Reason, Thinking Models Learn Whencited by 27
  2. 2025Reasoning-Finetuning Repurposes Latent Representations in Base Modelscited by 26
  3. 2025Collaborating with AI Agents: Field Experiments on Teamwork, Productivity, and Performancecited by 14
  4. 2025Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systemscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
  3. 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
  4. 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation
  5. 2026Social Reasoning in Machines: Investigating Collective Truth-Seeking Dynamics in Large Language Model Debate
  6. 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
  7. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
  8. 2025Giving AI Personalities Leads to More Human-Like Reasoning