mlsanityData to 14 Oct 2026

From Delegates to Trustees: How Optimizing for Long-Term Interests Shapes Bias and Alignment in LLM

arXiv 2510.12689 ↗First posted 14 Oct 2025cs.CY cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have shown promising accuracy in predicting survey responses and policy preferences, which has increased interest in their potential to represent human interests in various domains. Most existing research has focused on "behavioral cloning", effectively evaluating how well models reproduce individuals' expressed preferences. Drawing on theories of political representation, we highlight an underexplored design trade-off: whether AI systems should act as delegates, mirroring expressed preferences, or as trustees, exercising judgment about what best serves an individual's interests. This trade-off is closely related to issues of LLM sycophancy, where models can encourage behavior or validate beliefs that may be aligned with a user's short-term preferences, but is detrimental to their long-term interests. Through a series of experiments simulating votes on various policy issues in the U.S. context, we apply a temporal utility framework that weighs short and long-term interests (simulating a trustee role) and compare voting outcomes to behavior-cloning models (simulating a delegate). We find that trustee-style predictions weighted toward long-term interests produce policy decisions that align more closely with expert consensus on well-understood issues, but also show greater bias toward models' default stances on topics lacking clear agreement. These findings reveal a fundamental trade-off in designing AI systems to represent human interests. Delegate models better preserve user autonomy but may diverge from well-supported policy positions, while trustee models can promote welfare on well-understood issues yet risk paternalism and bias on subjective topics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 54 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

13 of 54 references.

References · 13

  1. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  2. 2023Whose Opinions Do Language Models Reflect?cited by 773
  3. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  4. 2020Artificial Intelligence, Values and Alignmentcited by 448
  5. 2016Cooperative Inverse Reinforcement Learningcited by 300
  6. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  7. 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
  8. 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
  9. 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMscited by 54
  10. 2024Beyond Preferences in AI Alignmentcited by 49
  11. 2024On the Relationship between Truth and Political Bias in Language Modelscited by 31
  12. 2024Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMscited by 25
1 more
  1. 2023Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialoguecited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024LLM Voting: Human Choices and AI Collective Decision Making
  2. 2026Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study
  3. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
  4. 2026Auditing Political Alignment in LLM Assistants: Engagement, Stance, and User Identity
  5. 2025Examining Alignment of Large Language Models through Representative Heuristics: The Case of Political Stereotypes
  6. 2025Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction
  7. 2026Reading Between the Tokens: Improving Preference Predictions through Mechanistic Forecasting ↗
  8. 2026Reasoning Boosts Opinion Alignment in LLMs