From Sycophantic Consensus to Pluralistic Repair: Why AI Alignment Must Surface Disagreement
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Pluralistic alignment is typically operationalised as preference aggregation: producing responses that span (Overton), steer toward (Steerable), or proportionally represent (Distributional) diverse human values. We argue that aggregation alone is an incomplete primitive for deployed pluralistic alignment. Under genuine value pluralism, the failure mode of contemporary RLHF-trained assistants is not insufficient coverage but sycophantic consensus: a learned tendency to agree with, validate, and minimise friction with the immediate interlocutor. Because deployed AI systems now mediate consequential deliberation across health, civic life, labour, and governance, the collapse of disagreement at the interaction layer is not a narrow technical concern but a structural failure with distributive consequences. We reframe pluralistic alignment around three conversational mechanisms drawn from Grice's maxims: scoping (acknowledging the limits of one's perspective), signalling (surfacing value-conflict rather than smoothing it over), and repair (revising one's position on principled grounds, not on user pressure). We formalise a metric, the Pluralistic Repair Score (PRS), distinguishing principled revision from capitulation, and present a small-scale empirical illustration on two frontier RLHF-trained models (Claude Sonnet 4.5, N=198; GPT-4o, N=100) showing that, for both, agreement-following coexists with low repair-quality on contested-value prompts. PRS measures an interactional precondition for pluralism (visible disagreement; principled revision) rather than pluralism in full; we discuss the difference, take seriously the reflexive question of whose "principled" counts, and argue that pluralism is most decisively made or unmade at the deployment-governance layer: interfaces, preference-data pipelines, and audit infrastructure.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 8 of its 17 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
8 of 17 references.
Closest ancestors · 2
Same direction, newest first
- 2024CURATe: Benchmarking Personalised Alignment of Conversational AI Assistants28 Oct
- 2022Constitutional AI: Harmlessness from AI Feedback15 Dec
Other references · 6
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 222
- 2024Adaptive Alignment: Dynamic Preference Adjustments via Multi-Objective Reinforcement Learning for Pluralistic AIcited by 6
- 2026Deployment-Relevant Alignment Cannot Be Inferred from Model-Level Evaluation Alonecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026A Roadmap to Impactful Pluralistic Alignment Researchcited by 0
- 2026A Roadmap to Impactful Pluralistic Alignment Research24 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2024A Roadmap to Pluralistic Alignment
- 2026Position: Align AI to Our Aspirations, Not Our Flaws
- 2025Normative Conflicts and Shallow AI Alignment
- 2026When AI Agents Disagree Like Humans: Reasoning Trace Analysis for Human-AI Collaborative Moderation
- 2026Socially Grounded Agentic AI: Coordinating Plural Perspectives through Social Theory
- 2026Constructive Alignment: Governing Preference Dynamics in Human-AI Interaction
- 2026Hidden Consensus:Preference-Validity Compression in Human Feedback
- 2026AI Alignment From Social Choice Perspectives