How AI Systems Think About Education: Analyzing Latent Preference Patterns in Large Language Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
also in 1 more
Abstract (arXiv)
This paper presents the first systematic measurement of educational alignment in Large Language Models. Using a Delphi-validated instrument comprising 48 items across eight educational-theoretical dimensions, the study reveals that GPT-5.1 exhibits highly coherent preference patterns (99.78% transitivity; 92.79% model accuracy) that largely align with humanistic educational principles where expert consensus exists. Crucially, divergences from expert opinion occur precisely in domains of normative disagreement among human experts themselves, particularly emotional dimensions and epistemic normativity. This raises a fundamental question for alignment research: When human values are contested, what should models be aligned to? The findings demonstrate that GPT-5.1 does not remain neutral in contested domains but adopts coherent positions, prioritizing emotional responsiveness and rejecting false balance. The methodology, combining Delphi consensus-building with Structured Preference Elicitation and Thurstonian Utility modeling, provides a replicable framework for domain-specific alignment evaluation beyond generic value benchmarks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 12 of its 22 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
12 of 22 references.
References · 12
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 182
- 2022Is Power-Seeking AI an Existential Risk?cited by 105
- 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
- 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
- 2024STEER: Assessing the Economic Rationality of Large Language Modelscited by 27
- 2024Do LLMs have Consistent Values?cited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs
- 2025Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking
- 2026Toward a Theory of Value in AI Alignment
- 2026Beyond Preferences: Learning Alignment Principles Grounded in Human Reasons and Values
- 2025EigenBench: A Comparative Behavioral Measure of Value Alignment
- 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- 2024A Flexible Method for Behaviorally Measuring Alignment Between Human and Artificial Intelligence Using Representational Similarity Analysis
- 2025Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires