mlsanityData to 14 Oct 2026

Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Values

arXiv 2311.10766 ↗First posted 15 Nov 2023cs.CL cs.AIcited by 50

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of Large Language Models (LLMs) has attracted much attention to value alignment for their responsible development. However, how to define values in this context remains a largely unexplored question. Existing work mainly follows the Helpful, Honest, Harmless principle and specifies values as risk criteria formulated in the AI community, e.g., fairness and privacy protection, suffering from poor clarity, adaptability and transparency. Inspired by basic values in humanity and social science across cultures, this work proposes a novel basic value alignment paradigm and introduces a value space spanned by basic value dimensions. All LLMs' behaviors can be mapped into the space by identifying the underlying values, possessing the potential to address the three challenges. To foster future research, we apply the representative Schwartz's Theory of Basic Values as an initialized example and construct FULCRA, a dataset consisting of 5k (LLM output, value vector) pairs. Our extensive analysis of FULCRA reveals the underlying relation between basic values and LLMs' behaviors, demonstrating that our approach not only covers existing mainstream risks but also anticipates possibly unidentified ones. Additionally, we present an initial implementation of the basic value evaluation and alignment, paving the way for future research in this line.

Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 46 of its 95 references that are in the map. First posted on arXiv 15 Nov 2023.

Builds on

46 of 95 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  11. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  12. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
34 more
  1. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  2. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  3. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  4. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  5. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  6. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  7. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  8. 2020Aligning AI With Shared Human Valuescited by 723
  9. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
  10. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 463
  11. 2020Artificial Intelligence, Values and Alignmentcited by 448
  12. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  13. 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
  14. 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
  15. 2021Recursively Summarizing Books with Human Feedbackcited by 290
  16. 2023Preference Ranking Optimization for Human Alignmentcited by 285
  17. 2022Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimizationcited by 246
  18. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
  19. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
  20. 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
  21. 2021Alignment of Language Agentscited by 168
  22. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
  23. 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
  24. 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
  25. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  26. 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 89
  27. 2023CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibilitycited by 85
  28. 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
  29. 2023Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theorycited by 43
  30. 2022SafeText: A Benchmark for Exploring Physical Safety in Language Modelscited by 41
  31. 2023What does ChatGPT return about human values? Exploring value bias in ChatGPT using a descriptive value theorycited by 19
  32. 2023Evaluating the Robustness of Discrete Promptscited by 18
  33. 2023Semi-Offline Reinforcement Learning for Optimized Text Generationcited by 12
  34. 2023Towards Coding Social Science Datasets with Language Modelscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 11; 2025: 22; 2026: 17.

50 papers.

Sort:

By area:

  1. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  2. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  3. 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
  4. 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 27
  5. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  6. 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
  7. 2024Evaluating Large Language Models with Psychometricscited by 22
  8. 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 21
  9. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
  10. 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
  11. 2025MPO: Multilingual Safety Alignment via Reward Gap Optimizationcited by 18
  12. 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activationcited by 16
38 more
  1. 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approachescited by 14
  2. 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
  3. 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmascited by 13
  4. 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
  5. 2024ProgressGym: Alignment with a Millennium of Moral Progresscited by 9
  6. 2025Dialogue Systems for Emotional Support via Value Reinforcementcited by 8
  7. 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insightscited by 7
  8. 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMscited by 5
  9. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
  10. 2024Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignmentcited by 4
  11. 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
  12. 2025Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Modelscited by 4
  13. 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Differencecited by 4
  14. 2026Human Values Matter: Investigating How Misalignment Shapes Collective Behaviors in LLM Agent Communitiescited by 4
  15. 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimizationcited by 3
  16. 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversitycited by 3
  17. 2026Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuumcited by 3
  18. 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibrationcited by 3
  19. 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editingcited by 3
  20. 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMscited by 2
  21. 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Modelscited by 2
  22. 2026Structuring the Space of Sociotechnical Alignmentcited by 2
  23. 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimizationcited by 1
  24. 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimizationcited by 1
  25. 2026Labels have Human Values: Value Calibration of Subjective Taskscited by 1
  26. 2026Jailbreaking Large Language Models with Morality Attackscited by 1
  27. 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Textscited by 1
  28. 2026STONIC: A Layered Measurement Contract for LLM Value Profilingcited by 1
  29. 2025Analyzing Cognitive Differences Among Large Language Models through the Lens of Social Worldviewcited by 0
  30. 2025ViMRHP: A Vietnamese Benchmark Dataset for Multimodal Review Helpfulness Prediction via Human-AI Collaborative Annotationcited by 0
  31. 2025NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Contextcited by 0
  32. 2026Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Modelscited by 0
  33. 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
  34. 2026Teachers' Perceived Benefits and Risks of AI Across Fifty-Five Countries: An Audit of LLM Alignment and Steerabilitycited by 0
  35. 2026RobotValues: Evaluating Household Robots When Human Values Conflictcited by 0
  36. 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
  37. 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focuscited by 0
  38. 2026Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversationscited by 0