mlsanityData to 7 Oct 2026

Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Models

arXiv 2502.02444 ↗First posted 4 Feb 2025cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Values are core drivers of individual and collective perception, cognition, and behavior. Value systems, such as Schwartz's Theory of Basic Human Values, delineate the hierarchy and interplay among these values, enabling cross-disciplinary investigations into decision-making and societal dynamics. Recently, the rise of Large Language Models (LLMs) has raised concerns regarding their elusive intrinsic values. Despite growing efforts in evaluating, understanding, and aligning LLM values, a psychologically grounded LLM value system remains underexplored. This study addresses the gap by introducing the Generative Psycho-Lexical Approach (GPLA), a scalable, adaptable, and theoretically informed method for constructing value systems. Leveraging GPLA, we propose a psychologically grounded five-factor value system tailored for LLMs. For systematic validation, we present three benchmarking tasks that integrate psychological principles with cutting-edge AI priorities. Our results reveal that the proposed value system meets standard psychological criteria, better captures LLM values, improves LLM safety prediction, and enhances LLM alignment, when compared to the canonical Schwartz's values.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 39 of its 106 references that are in the map. First posted on arXiv 4 Feb 2025.

Builds on

39 of 106 references.

References · 39

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  7. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  8. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
  9. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  10. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
  11. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  12. 2023AI Alignment: A Comprehensive Surveycited by 256
27 more
  1. 2023Detecting and Preventing Hallucinations in Large Vision Language Modelscited by 254
  2. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  3. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
  4. 2024SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Modelscited by 225
  5. 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 193
  6. 2023Personality Traits in Large Language Modelscited by 166
  7. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  8. 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 122
  9. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  10. 2024Panacea: Pareto Alignment via Preference Adaptation for LLMscited by 78
  11. 2023Questioning the Survey Responses of Large Language Modelscited by 70
  12. 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
  13. 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
  14. 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
  15. 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34
  16. 2023Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimationcited by 28
  17. 2022Evaluating Psychological Safety of Large Language Modelscited by 26
  18. 2024Social Science Meets LLMs: How Reliable Are Large Language Models in Social Simulations?cited by 26
  19. 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
  20. 2024High-Dimension Human Value Representation in Large Language Modelscited by 20
  21. 2024ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Modelscited by 19
  22. 2024Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testingcited by 17
  23. 2024Stick to your Role! Stability of Personal Values Expressed in Large Language Modelscited by 14
  24. 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approachescited by 13
  25. 2024Do LLMs have Consistent Values?cited by 13
  26. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  27. 2024LocalValueBench: A Collaboratively Built and Extensible Benchmark for Evaluating Localized Value Alignment and Ethical Safety in Large Language Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
  2. 2023Heterogeneous Value Alignment Evaluation for Large Language Models
  3. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs
  4. 2024Are the Values of LLMs Structurally Aligned with Humans? A Causal Perspective
  5. 2024Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?
  6. 2026Toward a Theory of Value in AI Alignment
  7. 2026Context-Value-Action Architecture for Value-Driven Large Language Model Agents
  8. 2026Reward Models Inherit Value Biases from Pretraining