Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Values
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of Large Language Models (LLMs) has attracted much attention to value alignment for their responsible development. However, how to define values in this context remains a largely unexplored question. Existing work mainly follows the Helpful, Honest, Harmless principle and specifies values as risk criteria formulated in the AI community, e.g., fairness and privacy protection, suffering from poor clarity, adaptability and transparency. Inspired by basic values in humanity and social science across cultures, this work proposes a novel basic value alignment paradigm and introduces a value space spanned by basic value dimensions. All LLMs' behaviors can be mapped into the space by identifying the underlying values, possessing the potential to address the three challenges. To foster future research, we apply the representative Schwartz's Theory of Basic Values as an initialized example and construct FULCRA, a dataset consisting of 5k (LLM output, value vector) pairs. Our extensive analysis of FULCRA reveals the underlying relation between basic values and LLMs' behaviors, demonstrating that our approach not only covers existing mainstream risks but also anticipates possibly unidentified ones. Additionally, we present an initial implementation of the basic value evaluation and alignment, paving the way for future research in this line.
Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 46 of its 95 references that are in the map. First posted on arXiv 15 Nov 2023.
Builds on
46 of 95 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
34 more
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2020Aligning AI With Shared Human Valuescited by 723
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
- 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 463
- 2020Artificial Intelligence, Values and Alignmentcited by 448
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2021Recursively Summarizing Books with Human Feedbackcited by 290
- 2023Preference Ranking Optimization for Human Alignmentcited by 285
- 2022Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimizationcited by 246
- 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
- 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 173
- 2021Alignment of Language Agentscited by 168
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
- 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 89
- 2023CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibilitycited by 85
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
- 2023Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theorycited by 43
- 2022SafeText: A Benchmark for Exploring Physical Safety in Language Modelscited by 41
- 2023What does ChatGPT return about human values? Exploring value bias in ChatGPT using a descriptive value theorycited by 19
- 2023Evaluating the Robustness of Discrete Promptscited by 18
- 2023Semi-Offline Reinforcement Learning for Optimized Text Generationcited by 12
- 2023Towards Coding Social Science Datasets with Language Modelscited by 11
Built on by
Citing papers per year: 2024: 11; 2025: 22; 2026: 17.
50 papers.
Sort:
By area:
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
- 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 27
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
- 2024Evaluating Large Language Models with Psychometricscited by 22
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 21
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
- 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimizationcited by 18
- 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activationcited by 16
38 more
- 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approachescited by 14
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmascited by 13
- 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
- 2024ProgressGym: Alignment with a Millennium of Moral Progresscited by 9
- 2025Dialogue Systems for Emotional Support via Value Reinforcementcited by 8
- 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insightscited by 7
- 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMscited by 5
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
- 2024Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignmentcited by 4
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
- 2025Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Modelscited by 4
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Differencecited by 4
- 2026Human Values Matter: Investigating How Misalignment Shapes Collective Behaviors in LLM Agent Communitiescited by 4
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimizationcited by 3
- 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversitycited by 3
- 2026Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuumcited by 3
- 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibrationcited by 3
- 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editingcited by 3
- 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMscited by 2
- 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Modelscited by 2
- 2026Structuring the Space of Sociotechnical Alignmentcited by 2
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimizationcited by 1
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimizationcited by 1
- 2026Labels have Human Values: Value Calibration of Subjective Taskscited by 1
- 2026Jailbreaking Large Language Models with Morality Attackscited by 1
- 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Textscited by 1
- 2026STONIC: A Layered Measurement Contract for LLM Value Profilingcited by 1
- 2025Analyzing Cognitive Differences Among Large Language Models through the Lens of Social Worldviewcited by 0
- 2025ViMRHP: A Vietnamese Benchmark Dataset for Multimodal Review Helpfulness Prediction via Human-AI Collaborative Annotationcited by 0
- 2025NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Contextcited by 0
- 2026Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Modelscited by 0
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
- 2026Teachers' Perceived Benefits and Risks of AI Across Fifty-Five Countries: An Audit of LLM Alignment and Steerabilitycited by 0
- 2026RobotValues: Evaluating Household Robots When Human Values Conflictcited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focuscited by 0
- 2026Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversationscited by 0
- 2026Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversations14 Oct 2026
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026STONIC: A Layered Measurement Contract for LLM Value Profiling24 Aug 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026RobotValues: Evaluating Household Robots When Human Values Conflict2 Jun 2026
- 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Texts21 May 2026
- 2026Teachers' Perceived Benefits and Risks of AI Across Fifty-Five Countries: An Audit of LLM Alignment and Steerability8 May 2026
- 2026Jailbreaking Large Language Models with Morality Attacks18 Apr 2026
- 2026Human Values Matter: Investigating How Misalignment Shapes Collective Behaviors in LLM Agent Communities7 Apr 2026
- 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Models18 Mar 2026
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmark18 Mar 2026
38 more
- 2026Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Models15 Feb 2026
- 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editing7 Feb 2026
- 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibration31 Jan 2026
- 2026Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum20 Jan 2026
- 2026Labels have Human Values: Value Calibration of Subjective Tasks10 Jan 2026
- 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversity11 Dec 2025
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Models21 Oct 2025
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization12 Aug 2025
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization22 Jul 2025
- 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activation15 Jul 2025
- 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMs16 Jun 2025
- 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insights6 Jun 2025
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas23 May 2025
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimization22 May 2025
- 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMs19 May 2025
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Difference18 May 2025
- 2025NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Context13 May 2025
- 2025ViMRHP: A Vietnamese Benchmark Dataset for Multimodal Review Helpfulness Prediction via Human-AI Collaborative Annotation12 May 2025
- 2025Analyzing Cognitive Differences Among Large Language Models through the Lens of Social Worldview4 May 2025
- 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Items2 May 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimization8 Mar 2025
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs12 Feb 2025
- 2025Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Models4 Feb 2025
- 2025Dialogue Systems for Emotional Support via Value Reinforcement25 Jan 2025
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencers20 Jan 2025
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches6 Jan 2025
- 2024A Simulation System Towards Solving Societal-Scale Manipulation17 Oct 2024
- 2024Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignment26 Sep 2024
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models18 Sep 2024
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses15 Jul 2024
- 2024ProgressGym: Alignment with a Millennium of Moral Progress28 Jun 2024
- 2024Evaluating Large Language Models with Psychometrics25 Jun 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024From Sora What We Can See: A Survey of Text-to-Video Generation17 May 2024
- 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches19 Apr 2024
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models27 Feb 2024
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBench31 Jan 2024
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimizationcited by 18
- 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activationcited by 16
- 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insightscited by 7
- 2024Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignmentcited by 4
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimizationcited by 3
- 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editingcited by 3
- 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Modelscited by 2
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimizationcited by 1
- 2026Teachers' Perceived Benefits and Risks of AI Across Fifty-Five Countries: An Audit of LLM Alignment and Steerabilitycited by 0
- 2026Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversationscited by 0
- 2026Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversations14 Oct 2026
- 2026Teachers' Perceived Benefits and Risks of AI Across Fifty-Five Countries: An Audit of LLM Alignment and Steerability8 May 2026
- 2026VC-Soup: Value-Consistency Guided Multi-Value Alignment for Large Language Models18 Mar 2026
- 2026Controllable Value Alignment in Large Language Models through Neuron-Level Editing7 Feb 2026
- 2025PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization22 Jul 2025
- 2025Internal Value Alignment in Large Language Models through Controlled Value Vector Activation15 Jul 2025
- 2025Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insights6 Jun 2025
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimization22 May 2025
- 2025Research Superalignment Should Advance Now with Alternating Competence and Conformity Optimization8 Mar 2025
- 2024Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignment26 Sep 2024
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
- 2026Human Values Matter: Investigating How Misalignment Shapes Collective Behaviors in LLM Agent Communitiescited by 4
- 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversitycited by 3
- 2026Human Values Matter: Investigating How Misalignment Shapes Collective Behaviors in LLM Agent Communities7 Apr 2026
- 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversity11 Dec 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs12 Feb 2025
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 21
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmascited by 13
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Models21 Oct 2025
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas23 May 2025
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBench31 Jan 2024
- 2026Jailbreaking Large Language Models with Morality Attackscited by 1
- 2026Jailbreaking Large Language Models with Morality Attacks18 Apr 2026
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 27
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
- 2024Evaluating Large Language Models with Psychometricscited by 22
- 2025Value Portrait: Assessing Language Models' Values through Psychometrically and Ecologically Valid Itemscited by 18
- 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approachescited by 14
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
- 2024A Simulation System Towards Solving Societal-Scale Manipulationcited by 12
- 2024ProgressGym: Alignment with a Millennium of Moral Progresscited by 9
- 2025Dialogue Systems for Emotional Support via Value Reinforcementcited by 8
- 2025EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMscited by 5
12 most cited of 31 All 31 (JSON)
- 2026Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus22 Sep 2026
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026STONIC: A Layered Measurement Contract for LLM Value Profiling24 Aug 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026RobotValues: Evaluating Household Robots When Human Values Conflict2 Jun 2026
- 2026More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Texts21 May 2026
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmark18 Mar 2026
- 2026Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Models15 Feb 2026
- 2026Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibration31 Jan 2026
- 2026Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum20 Jan 2026
- 2026Labels have Human Values: Value Calibration of Subjective Tasks10 Jan 2026
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization12 Aug 2025
12 newest of 31 All 31 (JSON)