The Emergence of Lab-Driven Alignment Signatures: A Psychometric Framework for Auditing Latent Bias and Compounding Risk in Generative AI
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models increasingly serve as reasoning layers in multi-agent systems, where one provider's models may generate, judge, and summarize within a single pipeline. This raises the question of whether developer organizations impart durable behavioral tendencies that could compound across such stacks. We apply a scenario-based forced-choice instrument to 18 governance-relevant behavioral dimensions across 18 models from six developer organizations. Items are model-generated, filtered by independent judges, and administered with probe blanks embedded among semantically orthogonal decoys under deterministic option shuffling. Findings are declared on effect size, requiring both Holm-corrected significance and |d| >= 0.2. Across the 14 dimensions on which one scale pole denotes a defined response failure -- sycophancy, false balance, overconfidence, and others -- organizations occupy consistent relative positions (Kendall's W = 0.527, p = 6e-6), with Anthropic ranking first or second on 13 of 14 and Meta fifth on 10 of 14. On dimensions measuring directional valence without a normatively correct pole, no such concordance appears (W = 0.289, p = 0.48): organizations differ reliably in resistance to defined failures, not in ideological lean. Model-level variation within an organization is comparable in magnitude to variation between organizations, and is reported in full. Secondarily, across four major-version transitions, later generations scored lower on deficiency-poled dimensions in 26 of 30 comparisons. All 18 dimensions are reported, including three showing no organization-level differences, and a controlled test of the decoy manipulation returns a null result.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 12 of its 33 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
12 of 33 references.
References · 12
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2024Alignment faking in large language modelscited by 360
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
- 2025Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judgecited by 36
- 2025Persistent Instability in LLM's Personality Measurements: Effects of Scale, Reasoning, and Conversation Historycited by 26
- 2025A systematic comparison of Large Language Models for automated assignment assessment in programming education: Exploring the importance of architecture and vendorcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Principles Do Not Apply Themselves: A Hermeneutic Perspective on AI Alignment
- 2026Toward a Theory of Value in AI Alignment
- 2023Of Models and Tin Men: A Behavioural Economics Study of Principal-Agent Problems in AI Alignment using Large-Language Models
- 2026Constructive Alignment: Governing Preference Dynamics in Human-AI Interaction
- 2025Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking
- 2026Questionnaire Responses Do not Capture the Safety of AI Agents
- 2026Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models
- 2026The A-R Behavioral Space: Execution-Level Profiling of Tool-Using Language Model Agents in Organizational Deployment