mlsanityData to 14 Oct 2026

An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making

arXiv 2410.15168 ↗First posted 19 Oct 2024cs.CLcited by 14

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Modern large language models (LLMs) have exhibited cooperative synergy on complex task-solving, and collective decision-making (CDM) is a pivotal component in LLM-based multi-agent collaboration frameworks. Our survey on 52 recent such systems uncovers a severe lack of diversity, with a heavy reliance on dictatorial and plurality voting for CDM. Through the lens of social choice theory, we scrutinize widely-adopted CDM methods and identify their limitations. To enrich current landscape of LLM-based CDM, we present GEDI, an electoral CDM module that incorporates various ordinal preferential voting mechanisms. Our empirical case study across three benchmarks shows that the integration of certain CDM methods can markedly improve the reasoning capabilities and robustness of some leading LLMs, all without requiring intricate system designs. Additionally, we find that some CDM mechanisms generate positive synergies even with as few as three agents. The voting-based methods also demonstrate robustness against single points of failure, as well as diversity in terms of hit-rate@k and subject-wise impacts.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 41 of its 83 references that are in the map. First posted on arXiv 19 Oct 2024.

Builds on

41 of 83 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars28 Nov
  2. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming10 Oct
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
  4. 2023Blind Judgement: Agent-Based Supreme Court Modelling With GPT12 Jan

Other references · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  6. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  9. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  10. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  11. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  12. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
25 more
  1. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  2. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
  3. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  4. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  5. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  6. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 290
  7. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
  8. 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
  9. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
  10. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 164
  11. 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
  12. 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agentscited by 91
  13. 2023Training Socially Aligned Language Models on Simulated Social Interactionscited by 78
  14. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
  15. 2023MechAgents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and integrate knowledgecited by 63
  16. 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
  17. 2023Towards Reasoning in Large Language Models via Multi-Agent Peer Review Collaborationcited by 51
  18. 2023Multi-Agent Consensus Seeking via Large Language Modelscited by 50
  19. 2024A Multi-Agent Conversational Recommender Systemcited by 43
  20. 2023CGMI: Configurable General Multi-Agent Interaction Frameworkcited by 42
  21. 2023Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Gamecited by 28
  22. 2024Measuring the Inconsistency of Large Language Models in Preferential Rankingcited by 19
  23. 2022Vote'n'Rank: Revision of Benchmarking with Social Choice Theorycited by 15
  24. 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Modelscited by 12
  25. 2024CCA: Collaborative Competitive Agents for Image Editingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 5.

14 papers.

Sort:

By area:

  1. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
  2. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 55
  3. 2026Silo-Bench: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systemscited by 20
  4. 2025Stop Reducing Responsibility in LLM-Powered Multi-Agent Systems to Local Alignmentcited by 7
  5. 2026When Is Collective Intelligence a Lottery? Multi-Agent Scaling Laws for Memetic Drift in LLMscited by 6
  6. 2025DART: Leveraging Multi-Agent Disagreement for Tool Recruitment in Multimodal Reasoningcited by 5
  7. 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Modelscited by 5
  8. 2025Project Riley: Multimodal Multi-Agent LLM Collaboration with Emotional Reasoning and Votingcited by 4
  9. 2025SWIRL: A Staged Workflow for Interleaved Reinforcement Learning in Mobile GUI Controlcited by 4
  10. 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMscited by 2
  11. 2025AgentCDM: Enhancing Multi-Agent Collaborative Decision-Making via ACH-Inspired Structured Reasoningcited by 2
  12. 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stoppingcited by 2
2 more
  1. 2026Diverse by Reasoning: Harnessing the Wisdom of LLM Crowds for Future Predictioncited by 0
  2. 2026From Certain Doom to Survival: Agent-Driven Self-Governance in LLM Agent Societiescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024LLM Voting: Human Choices and AI Collective Decision Making
  2. 2025Beyond Majority Voting: LLM Aggregation by Leveraging Higher-Order Information
  3. 2026LLM Agents for Deliberative Collaboration: A Study on Joint Decision Making Under Partial Observability
  4. 2025Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs
  5. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
  6. 2025Beyond the Strongest LLM: Multi-Turn Multi-Agent Orchestration vs. Single LLMs on Benchmarks
  7. 2026Collective cooperation without individual fidelity in LLM agents
  8. 2024STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making