mlsanityData to 7 Oct 2026

LLM Voting: Human Choices and AI Collective Decision Making

arXiv 2402.01766 ↗First posted 31 Jan 2024cs.CL cs.AI cs.CYcited by 47

Not on the map. Why?

Cited by 20 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper investigates the voting behaviors of Large Language Models (LLMs), specifically GPT-4 and LLaMA-2, their biases, and how they align with human voting patterns. Our methodology involved using a dataset from a human voting experiment to establish a baseline for human preferences and conducting a corresponding experiment with LLM agents. We observed that the choice of voting methods and the presentation order influenced LLM voting outcomes. We found that varying the persona can reduce some of these biases and enhance alignment with human choices. While the Chain-of-Thought approach did not improve prediction accuracy, it has potential for AI explainability in the voting process. We also identified a trade-off between preference diversity and alignment accuracy in LLMs, influenced by different temperature settings. Our findings indicate that LLMs may lead to less diverse collective outcomes and biased assumptions when used in voting scenarios, emphasizing the need for cautious integration of LLMs into democratic processes.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 24 of its 73 references that are in the map. First posted on arXiv 31 Jan 2024.

Builds on

24 of 73 references.

References · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  5. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  7. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  8. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  9. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  10. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
  11. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  12. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
12 more
  1. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
  2. 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
  3. 2023Personality Traits in Large Language Modelscited by 166
  4. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
  5. 2023Training Socially Aligned Language Models on Simulated Social Interactionscited by 77
  6. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
  7. 2023ChatLLM Network: More brains, More intelligencecited by 37
  8. 2023The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agentscited by 30
  9. 2023Accelerating science with human-aware artificial intelligencecited by 27
  10. 2015Properties of Multiwinner Voting Rulescited by 20
  11. 2016Axiomatic Characterization of Committee Scoring Rulescited by 3
  12. 2017A Polynomial-time Algorithm to Achieve Extended Justified Representationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 28; 2026: 13.

47 papers.

Sort:

By area:

  1. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
  2. 2024Multi-Agent Large Language Models for Conversational Task-Solvingcited by 24
  3. 2025Nuclear Deployed: Analyzing Catastrophic Risks in Decision-making of Autonomous LLM Agentscited by 23
  4. 2025Stay Focused: Problem Drift in Multi-Agent Debatecited by 23
  5. 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacracited by 20
  6. 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detectioncited by 20
  7. 2025KVComm: Enabling Efficient LLM Communication through Selective KV Sharingcited by 16
  8. 2025An overview of model uncertainty and variability in LLM-based sentiment analysis. Challenges, mitigation strategies and the role of explainabilitycited by 15
  9. 2025MALLM: Multi-Agent Large Language Models Frameworkcited by 15
  10. 2025Dataset Distillation via Committee Votingcited by 13
  11. 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 9
  12. 2024Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Modelscited by 6
35 more
  1. 2025Policy Induction: Predicting Startup Success via Explainable Memory-Augmented In-Context Learningcited by 6
  2. 2025Evaluating Bias in Spoken Dialogue LLMs for Real-World Decisions and Recommendationscited by 5
  3. 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Modelscited by 5
  4. 2026Gender Dynamics and Homophily in a Social Network of LLM Agentscited by 5
  5. 2025Fragile Preferences: A Deep Dive Into Order Effects in Large Language Modelscited by 4
  6. 2024DeFine: Decision-Making with Analogical Reasoning over Factor Profilescited by 3
  7. 2025Addressing Moral Uncertainty using Large Language Models for Ethical Decision-Makingcited by 3
  8. 2025Adaptive political surveys and GPT-4: Tackling the cold start problem with simulated user interactionscited by 3
  9. 2025AI-Generated Compromises for Coalition Formationcited by 3
  10. 2025Addressing the alignment problem in transportation policy making: an LLM approachcited by 3
  11. 2025Many-to-One Adversarial Consensus: Exposing Multi-Agent Collusion Risks in AI-Based Healthcarecited by 3
  12. 2025Matching Markets Meet LLMs: Algorithmic Reasoning with Ranked Preferencescited by 2
  13. 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMscited by 2
  14. 2025E3RG: Building Explicit Emotion-driven Empathetic Response Generation System with Multimodal Large Language Modelcited by 2
  15. 2025Ripple Effect Protocol: Coordinating Agent Populationscited by 2
  16. 2025ProMediate: A Socio-cognitive framework for evaluating proactive agents in multi-party negotiationcited by 2
  17. 2026Belief Engine: Configurable and Inspectable Stance Dynamics in Multi-Agent LLM Deliberationcited by 2
  18. 2024Brainstorming Brings Power to Large Language Models of Knowledge Reasoningcited by 1
  19. 2025A closer look at how large language models trust humans: patterns and biasescited by 1
  20. 2025The Imperfect Learner: Incorporating Developmental Trajectories in Memory-based Student Simulationcited by 1
  21. 2026Expressing Social Emotions: Misalignment Between LLMs and Human Cultural Emotion Normscited by 1
  22. 2026Dynamic Coordination Strategy Selection for Enterprise Multi-Agent Systemscited by 1
  23. 2026Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Boundscited by 1
  24. 2024Towards unearthing neglected climate innovations from scientific literature using Large Language Modelscited by 0
  25. 2025Do LLMs Triage Like Clinicians? A Dynamic Study of Outpatient Referralcited by 0
  26. 2025Algorithmic Shortlisting in Participatory Budgetingcited by 0
  27. 2025AI-Generated Compromises for Coalition Formation: Modeling, Simulation, and a Textual Case Studycited by 0
  28. 2026Bayesian Preference Learning for Test-Time Steerable Reward Modelscited by 0
  29. 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Makingcited by 0
  30. 2026Wrong Code, Right Structure: Learning Netlist Representations from Imperfect LLM-Generated RTLcited by 0
  31. 2026The Self Driving Portfolio: Agentic Architecture for Institutional Asset Managementcited by 0
  32. 2026Beyond the Townhall: Spatial Anchoring and LLM Agents for Scalable Participatory Urban Planningcited by 0
  33. 2026Decision Protocols in Multi-Agent Large Language Model Conversationscited by 0
  34. 2026L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoningcited by 0
  35. 2026How Affect Propagates among LLM Agents: Emergent Emotional Contagion in Crowd Simulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025From Delegates to Trustees: How Optimizing for Long-Term Interests Shapes Bias and Alignment in LLM
  2. 2025Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction
  3. 2024Systematic Biases in LLM Simulations of Debates
  4. 2024An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making
  5. 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoning
  6. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
  7. 2025Computational Basis of LLM's Decision Making in Social Simulation
  8. 2024Dissecting Human and LLM Preferences