mlsanityData to 14 Oct 2026

Behavioural feasible set: Value alignment constraints on AI decision support

arXiv 2603.21435 ↗First posted 22 Mar 2026cs.AI econ.GN q-fin.ECcited by 0

Not on the map. Why?

Abstract (arXiv)

When organisations adopt commercial AI systems for decision support, they inherit value judgements embedded by vendors that are neither transparent nor renegotiable. The governance puzzle is not whether AI can support decisions but which recommendations the system can actually produce given how its vendor has configured it. I formalise this as a behavioural feasible set, the range of recommendations reachable under vendor-imposed alignment constraints, and characterise diagnostic thresholds for when organisational requirements exceed the system's flexibility. In scenario-based experiments using binary decision scenarios and multi-stakeholder ranking tasks, I show that alignment materially compresses this set. Comparing pre- and post-alignment variants of an open-weight model isolates the mechanism: alignment makes the system substantially less able to shift its recommendation even under legitimate contextual pressure. Leading commercial models exhibit comparable or greater rigidity. In multi-stakeholder tasks, alignment shifts implied stakeholder priorities rather than neutralising them, meaning organisations adopt embedded value orientations set upstream by the vendor. Organisations thus face a governance problem that better prompting cannot resolve: selecting a vendor partially determines which trade-offs remain negotiable and which stakeholder priorities are structurally embedded.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 58 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

6 of 58 references.

References · 6

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  4. 2020Learning to summarize from human feedbackcited by 2,588
  5. 2016Concrete Problems in AI Safetycited by 1,642
  6. 2020Artificial Intelligence, Values and Alignmentcited by 448

Built on by

Not cited yet.