mlsanityData to 14 Oct 2026

Value Alignment of Social Media Ranking Algorithms

arXiv 2509.14434 ↗First posted 17 Sep 2025cs.HC cs.SIcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

While social media feed rankings are primarily driven by engagement signals rather than any explicit value system, the resulting algorithmic feeds are not value-neutral: engagement may prioritize specific individualistic values. This paper presents an approach for social media feed value alignment. We adopt Schwartz's theory of Basic Human Values -- a broad set of human values that articulates complementary and opposing values forming the building blocks of many cultures -- and we implement an algorithmic approach that models and then ranks feeds by expressions of Schwartz's values in social media posts. Our approach enables controls where users can express weights on their desired values, combining these weights and post value expressions into a ranking that respects users' articulated trade-offs. Through controlled experiments (N=141 and N=250), we demonstrate that users can use these controls to architect feeds reflecting their desired values. Across users, value-ranked feeds align with personal values, diverging substantially from existing engagement-driven feeds.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 44 of its 138 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

44 of 138 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Strong and weak alignment of large language models with human values5 Aug
  2. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaboration22 Jun
  3. 2024What are human values, and how do we align AI to them?27 Mar
  4. 2023Cultural Bias and Cultural Alignment of Large Language Models23 Nov
  5. 2022Constitutional AI: Harmlessness from AI Feedback15 Dec

Other references · 39

  1. 2017Deep reinforcement learning from human preferencescited by 3,912
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2023Whose Opinions Do Language Models Reflect?cited by 773
  4. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  5. 2023Can Large Language Models Transform Computational Social Science?cited by 250
  6. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 148
  7. 2021Algorithmic Monoculture and Social Welfarecited by 100
  8. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  9. 2023Eliciting Human Preferences with Language Modelscited by 92
  10. 2023LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysiscited by 70
  11. 2024Unintended Impacts of LLM Alignment on Global Representationcited by 66
  12. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 65
27 more
  1. 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 52
  2. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  3. 2023Assessing LLMs for Moral Value Pluralismcited by 34
  4. 2023Engagement, User Satisfaction, and the Amplification of Divisive Content on Social Mediacited by 30
  5. 2024Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Conceptscited by 30
  6. 2023Embedding Democratic Values into Social Media AIs via Societal Objective Functionscited by 25
  7. 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
  8. 2022Building Human Values into Recommender Systems: An Interdisciplinary Synthesiscited by 22
  9. 2020From Optimizing Engagement to Measuring Valuecited by 21
  10. 2023Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Laborcited by 18
  11. 2021What Makes Online Communities 'Better'? Measuring Values, Consensus, and Conflict across Thousands of Subredditscited by 13
  12. 2020Assessing Viewpoint Diversity in Search Results Using Ranking Fairness Metricscited by 11
  13. 2021Uncertain Decisions Facilitate Better Preference Learningcited by 10
  14. 2021Making Online Communities 'Better': A Taxonomy of Community Values on Redditcited by 10
  15. 2024Investigating Human Values in Online Communitiescited by 10
  16. 2021Exploring Lightweight Interventions at Posting Time to Reduce the Sharing of Misinformation on Social Mediacited by 8
  17. 2024End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Promptingcited by 8
  18. 2018Performance Metric Elicitation from Pairwise Classifier Comparisonscited by 7
  19. 2023Choosing the Right Weights: Balancing Value, Strategy, and Noise in Recommender Systemscited by 7
  20. 2020Encounters with Visual Misinformation and Labels Across Platforms: An Interview and Diary Study to Inform Ecosystem Approaches to Misinformation Interventionscited by 6
  21. 2024What We Know About Using Non-Engagement Signals in Content Rankingcited by 6
  22. 2024Mapping the Design Space of Teachable Social Media Feed Experiencescited by 5
  23. 2025Alexandria: A Library of Pluralistic Values for Realtime Re-Ranking of Social Media Feedscited by 5
  24. 2024Reranking Social Media Feeds: A Practical Guide for Field Experimentscited by 4
  25. 2023Do Users Want Platform Moderation or Individual Control? Examining the Role of Third-Person Effects and Free Speech Support in Shaping Moderation Preferencescited by 3
  26. 2024A Browser Extension for in-place Signaling and Assessment of Misinformationcited by 3
  27. 2018Vulnerable to Misinformation? Verifi!cited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Persuasion in Online Conversations Is Associated with Alignment in Expressed Human Values ↗
  2. 2024User-Driven Value Alignment: Understanding Users' Perceptions and Strategies for Addressing Biased and Discriminatory Statements in AI Companions
  3. 2021What are you optimizing for? Aligning Recommender Systems with Human Values
  4. 2023Heterogeneous Value Alignment Evaluation for Large Language Models
  5. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs
  6. 2024Can Language Models Reason about Individualistic Human Values and Preferences?
  7. 2026Toward a Theory of Value in AI Alignment
  8. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models