Reasoning Models Generate Societies of Thought
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models have achieved remarkable capabilities across domains, yet mechanisms underlying sophisticated reasoning remain elusive. Recent reasoning models outperform comparable instruction-tuned models on complex cognitive tasks, attributed to extended computation through longer chains of thought. Here we show that enhanced reasoning emerges not from extended computation alone, but from simulating multi-agent-like interactions -- a society of thought -- which enables diversification and debate among internal cognitive perspectives characterized by distinct personality traits and domain expertise. Through quantitative analysis and mechanistic interpretability methods applied to reasoning traces, we find that reasoning models like DeepSeek-R1 and QwQ-32B exhibit much greater perspective diversity than instruction-tuned models, activating broader conflict between heterogeneous personality- and expertise-related features during reasoning. This multi-agent structure manifests in conversational behaviors, including question-answering, perspective shifts, and the reconciliation of conflicting views, and in socio-emotional roles that characterize sharp back-and-forth conversations, together accounting for the accuracy advantage in reasoning tasks. Controlled reinforcement learning experiments reveal that base models increase conversational behaviors when rewarded solely for reasoning accuracy, and fine-tuning models with conversational scaffolding accelerates reasoning improvement over base models. These findings indicate that the social organization of thought enables effective exploration of solution spaces. We suggest that reasoning models establish a computational parallel to collective intelligence in human groups, where diversity enables superior problem-solving when systematically structured, which suggests new opportunities for agent organization to harness the wisdom of crowds.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 74 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
18 of 74 references.
Closest ancestors · 2
Same direction, newest first
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate5 Sep
- 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning7 Apr
Other references · 16
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
- 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
- 2023SlimPajama-DC: Understanding Data Combinations for LLM Trainingcited by 72
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectorscited by 72
- 2025I Have Covered All the Bases Here: Interpreting Reasoning Features in Large Language Models via Sparse Autoencoderscited by 45
4 more
- 2025Base Models Know How to Reason, Thinking Models Learn Whencited by 27
- 2025Reasoning-Finetuning Repurposes Latent Representations in Base Modelscited by 26
- 2025Collaborating with AI Agents: Field Experiments on Teamwork, Productivity, and Performancecited by 14
- 2025Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systemscited by 5
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Modelscited by 27
- 2026ReasonOps: Operator Segmentation for LLM Reasoning Tracescited by 5
- 2026BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoningcited by 4
- 2026Contemporary AI lacks the imagination to diverge or negate in sciencecited by 3
- 2026Scaling Multiagent Systems with Process Rewardscited by 2
- 2026Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberationcited by 2
- 2026Directional Reasoning Trajectory Change (DRTC): Identifying Critical Trace Segments in Reasoning Modelscited by 1
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Team of Thoughts: Efficient Test-time Scaling of Agentic Systems through Orchestrated Tool Callingcited by 0
- 2026Multi-agent AI systems outperform human teams in creativitycited by 0
- 2026Beyond Alignment: Value Diversity as a Collective Property in Multicultural Agent Systemscited by 0
- 2026Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systemscited by 0
- 2026Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems15 Sep 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Contemporary AI lacks the imagination to diverge or negate in science6 Jun 2026
- 2026Beyond Alignment: Value Diversity as a Collective Property in Multicultural Agent Systems4 Jun 2026
- 2026ReasonOps: Operator Segmentation for LLM Reasoning Traces28 May 2026
- 2026Multi-agent AI systems outperform human teams in creativity18 May 2026
- 2026Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberation14 May 2026
- 2026BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoning4 Mar 2026
- 2026Team of Thoughts: Efficient Test-time Scaling of Agentic Systems through Orchestrated Tool Calling18 Feb 2026
- 2026Directional Reasoning Trajectory Change (DRTC): Identifying Critical Trace Segments in Reasoning Models17 Feb 2026
- 2026Scaling Multiagent Systems with Process Rewards30 Jan 2026
- 2026Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models20 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
- 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation
- 2026Social Reasoning in Machines: Investigating Collective Truth-Seeking Dynamics in Large Language Model Debate
- 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
- 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
- 2025Giving AI Personalities Leads to More Human-Like Reasoning