mlsanityData to 14 Oct 2026

Representative Social Choice: From Learning Theory to AI Alignment

arXiv 2410.23953 ↗First posted 31 Oct 2024cs.LG cs.AI cs.CLcited by 8

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Social choice theory is the study of preference aggregation across a population, used both in mechanism design for human agents and in the democratic alignment of language models. In this study, we propose the representative social choice framework for the modeling of democratic representation in collective decisions, where the number of issues and individuals are too large for mechanisms to consider all preferences directly. These scenarios are widespread in real-world decision-making processes, such as jury trials, legislation, corporate governance, and, more recently, language model alignment. In representative social choice, the population is represented by a finite sample of individual-issue pairs based on which social choice decisions are made. We show that many of the deepest questions in representative social choice can be formulated as statistical learning problems, and prove the generalization properties of social choice mechanisms using the theory of machine learning. We further formulate axioms for representative social choice, and prove Arrow-like impossibility theorems with new combinatorial tools of analysis. Our framework introduces the representative approach to social choice, opening up research directions at the intersection of social choice, learning theory, and AI alignment.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 17 of its 43 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

17 of 43 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Beyond Preferences in AI Alignment30 Aug
  2. 2024Collective Constitutional AI: Aligning a Language Model with Public Input12 Jun
  3. 2024Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback16 Apr
  4. 2024What are human values, and how do we align AI to them?27 Mar
  5. 2023AI Alignment and Social Choice: Fundamental Limitations and Policy Implications24 Oct
  6. 2022Discovering Language Model Behaviors with Model-Written Evaluations19 Dec
  7. 2022Constitutional AI: Harmlessness from AI Feedback15 Dec

Other references · 10

  1. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  2. 2023Whose Opinions Do Language Models Reflect?cited by 773
  3. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  4. 2020The Pitfalls of Simplicity Bias in Neural Networkscited by 351
  5. 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
  6. 2024Axioms for AI Alignment from Human Feedbackcited by 52
  7. 2023Generative Social Choicecited by 43
  8. 2022Locality Guidance for Improving Vision Transformers on Tiny Datasetscited by 33
  9. 2017Quantifying Translation-Invariance in Convolutional Neural Networkscited by 30
  10. 2022Investigating the Properties of Neural Network Representations in Reinforcement Learningcited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Open Problems in Differentiable Social Choice: Learning Mechanisms, Decisions, and Alignment
  2. 2026Algorithmic Impact Reveals the Hidden Social Choice Structure of Alignment
  3. 2026AI Alignment From Social Choice Perspectives
  4. 2026Adaptive Pluralistic Alignment: A pipeline for dynamic artificial democracy
  5. 2024Mapping Social Choice Theory to RLHF
  6. 2025Adaptive Preference Aggregation
  7. 2024DeepVoting: Learning and Fine-Tuning Voting Rules with Canonical Embeddings
  8. 2025Beyond RLHF and NLHF: Population-Proportional Alignment under an Axiomatic Framework