mlsanityData to 7 Oct 2026

Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs

arXiv 2405.12933 ↗First posted 21 May 2024cs.CL cs.AI cs.LGcited by 8

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large Language Models (LLMs) have shown remarkable capabilities in tasks such as summarization, arithmetic reasoning, and question answering. However, they encounter significant challenges in the domain of moral reasoning and ethical decision-making, especially in complex scenarios with multiple stakeholders. This paper introduces the Skin-in-the-Game (SKIG) framework, aimed at enhancing moral reasoning in LLMs by exploring decisions' consequences from multiple stakeholder perspectives. Central to SKIG's mechanism is simulating accountability for actions, which, alongside empathy exercises and risk assessment, is pivotal to its effectiveness. We validate SKIG's performance across various moral reasoning benchmarks with proprietary and opensource LLMs, and investigate its crucial components through extensive ablation analyses.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 37 of its 66 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

37 of 66 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Turning large language models into cognitive models6 Jun
  2. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb
  3. 2022Measuring and Narrowing the Compositionality Gap in Language Models7 Oct
  4. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Models30 Nov

Other references · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  10. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  11. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  12. 2021Ethical and social risks of harm from Language Modelscited by 957
21 more
  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  2. 2020Aligning AI With Shared Human Valuescited by 706
  3. 2020Artificial Intelligence, Values and Alignmentcited by 443
  4. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  5. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
  6. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
  7. 2023Large Language Model Guided Tree-of-Thoughtcited by 218
  8. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  9. 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
  10. 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 174
  11. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 160
  12. 2023Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Modelscited by 92
  13. 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 71
  14. 2022Is a Question Decomposition Unit All We Need?cited by 37
  15. 2022CommunityLM: Probing Partisan Worldviews from Language Modelscited by 36
  16. 2022Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophycited by 31
  17. 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulationcited by 21
  18. 2023Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoningcited by 20
  19. 2022On Solution Functions of Optimization: Universal Approximation and Covering Number Boundscited by 6
  20. 2022Towards Answering Open-ended Ethical Quandary Questionscited by 3
  21. 2023Monte Carlo Grid Dynamic Programming: Almost Sure Convergence and Probability Constraintscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 4.

8 papers.

  1. 2024Enhancing LLM Reasoning with Multi-Path Collaborative Reactive and Reflection agentscited by 15
  2. 2025Backtracking for Safetycited by 4
  3. 2025Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Gamescited by 4
  4. 2025A Survey on Training-free Alignment of Large Language Modelscited by 2
  5. 2026CommunityBench: Benchmarking Community-Level Alignment across Diverse Groups and Taskscited by 1
  6. 2026Reinforcement Learning with Backtracking Feedbackcited by 0
  7. 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Makingcited by 0
  8. 2026TPvG: A Moral Decision Framework for Large Language Models from One-Shot to Sequential Feedbackcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework
  2. 2024MoralBench: Moral Evaluation of LLMs
  3. 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
  4. 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas
  5. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
  6. 2025Beyond Ethical Alignment: Evaluating LLMs as Artificial Moral Assistants
  7. 2023Exploring the psychology of LLMs' Moral and Legal Reasoning
  8. 2024GreedLlama: Performance of Financial Value-Aligned Large Language Models in Moral Reasoning