ValueNet: A New Dataset for Human Value Driven Dialogue System
Not on the map. Why?
Abstract (arXiv)
Building a socially intelligent agent involves many challenges, one of which is to teach the agent to speak guided by its value like a human. However, value-driven chatbots are still understudied in the area of dialogue systems. Most existing datasets focus on commonsense reasoning or social norm modeling. In this work, we present a new large-scale human value dataset called ValueNet, which contains human attitudes on 21,374 text scenarios. The dataset is organized in ten dimensions that conform to the basic human value theory in intercultural research. We further develop a Transformer-based value regression model on ValueNet to learn the utility distribution. Comprehensive empirical results show that the learned value model could benefit a wide range of dialogue tasks. For example, by teaching a generative agent with reinforcement learning and the rewards from the value model, our method attains state-of-the-art performance on the personalized dialog generation dataset: Persona-Chat. With values as additional features, existing emotion recognition models enable capturing rich human emotions in the context, which further improves the empathetic response generation performance in the EmpatheticDialogues dataset. To the best of our knowledge, ValueNet is the first large-scale text dataset for human value modeling, and we are the first one trying to incorporate a value model into emotionally intelligent dialogue systems. The dataset is available at https://liang-qiu.github.io/ValueNet/.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 28 of its 48 references that are in the map. First posted on arXiv 12 Dec 2021.
Builds on
28 of 48 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2020Aligning AI With Shared Human Valuescited by 723
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
16 more
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2021How Many Data Points is a Prompt Worth?cited by 198
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
- 2018The Design and Implementation of XiaoIce, an Empathetic Social Chatbotcited by 172
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 136
- 2020Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotescited by 101
- 2017Long Text Generation via Adversarial Training with Leaked Informationcited by 100
- 2020You Impress Me: Dialogue Generation via Mutual Persona Perceptioncited by 85
- 2018EmotionLines: An Emotion Corpus of Multi-Party Conversationscited by 80
- 2020Dialogue-Based Relation Extractioncited by 68
- 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
- 2020Paragraph-level Commonsense Transformers with Recurrent Memorycited by 23
- 2021SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialoguescited by 9
- 2017Avoiding Echo-Responses in a Retrieval-Based Conversation Systemcited by 2
Built on by
Citing papers per year: 2022: 4; 2023: 8; 2024: 7; 2025: 10; 2026: 5.
34 papers.
Sort:
By area:
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Valuescited by 54
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
- 2023Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?cited by 36
- 2024Personality Alignment of Large Language Modelscited by 36
- 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 28
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
22 more
- 2022MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussionscited by 17
- 2023Do Differences in Values Influence Disagreements in Online Discussions?cited by 15
- 2023Stabilizing RLHF through Advantage Model and Selective Rehearsalcited by 14
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
- 2024Value Preferences Estimation and Disambiguation in Hybrid Participatory Systemscited by 7
- 2025MoVa: Towards Generalizable Classification of Human Morals and Valuescited by 7
- 2024Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagementcited by 5
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Differencecited by 4
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Surveycited by 3
- 2025Learning the Value Systems of Societies from Preferencescited by 2
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Makingcited by 1
- 2026Learning the Value Systems of Agents with Preference-based and Inverse Reinforcement Learningcited by 1
- 2025Taking a SEAT: Predicting Value Interpretations from Sentiment, Emotion, Argument, and Topic Annotationscited by 0
- 2025Prompt-Based Value Steering of Large Language Modelscited by 0
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Makingcited by 0
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
- 2026Bridging Values and Behavior: A Hierarchical Framework for Proactive Embodied Agentscited by 0
- 2026Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Valuescited by 0
- 2026VISTA: Value-Informed Event Appraisal for Multimodal Emotion Conflictcited by 0
- 2026VISTA: Value-Informed Event Appraisal for Multimodal Emotion Conflict29 Sep 2026
- 2026Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values8 Sep 2026
- 2026Bridging Values and Behavior: A Hierarchical Framework for Proactive Embodied Agents30 Apr 2026
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmark18 Mar 2026
- 2026Learning the Value Systems of Agents with Preference-based and Inverse Reinforcement Learning4 Feb 2026
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making9 Dec 2025
- 2025Prompt-Based Value Steering of Large Language Models14 Nov 2025
- 2025Taking a SEAT: Predicting Value Interpretations from Sentiment, Emotion, Argument, and Topic Annotations2 Oct 2025
- 2025MoVa: Towards Generalizable Classification of Human Morals and Values29 Sep 2025
- 2025Value Alignment of Social Media Ranking Algorithms17 Sep 2025
- 2025Learning the Value Systems of Societies from Preferences28 Jul 2025
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives11 Jun 2025
22 more
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Difference18 May 2025
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making6 Mar 2025
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencers20 Jan 2025
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models18 Sep 2024
- 2024Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement9 Sep 2024
- 2024Personality Alignment of Large Language Models21 Aug 2024
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses15 Jul 2024
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussions12 Mar 2024
- 2024Value Preferences Estimation and Disambiguation in Hybrid Participatory Systems26 Feb 2024
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2023Do Differences in Values Influence Disagreements in Online Discussions?24 Oct 2023
- 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values11 Oct 2023
- 2023Stabilizing RLHF through Advantage Model and Selective Rehearsal18 Sep 2023
- 2023Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?29 Aug 2023
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models23 Aug 2023
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Survey18 Jul 2023
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback9 Mar 2023
- 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Arguments31 Jan 2023
- 2022MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions21 Dec 2022
- 2022A Survey of Deep Learning for Mathematical Reasoning20 Dec 2022
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning29 Sep 2022
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agents25 May 2022
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Valuescited by 54
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Modelscited by 45
- 2024Personality Alignment of Large Language Modelscited by 36
- 2023Stabilizing RLHF through Advantage Model and Selective Rehearsalcited by 14
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2025Value Alignment of Social Media Ranking Algorithms17 Sep 2025
- 2024Personality Alignment of Large Language Models21 Aug 2024
- 2023The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values11 Oct 2023
- 2023Stabilizing RLHF through Advantage Model and Selective Rehearsal18 Sep 2023
- 2023From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models23 Aug 2023
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback9 Mar 2023
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2024A Survey on Knowledge Distillation of Large Language Models20 Feb 2024
- 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 28
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
- 2022MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussionscited by 17
- 2023Do Differences in Values Influence Disagreements in Online Discussions?cited by 15
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Modelscited by 13
- 2024Value Preferences Estimation and Disambiguation in Hybrid Participatory Systemscited by 7
- 2025MoVa: Towards Generalizable Classification of Human Morals and Valuescited by 7
- 2024Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagementcited by 5
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencerscited by 4
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Differencecited by 4
- 2023Towards a Neural Era in Dialogue Management for Collaboration: A Literature Surveycited by 3
12 most cited of 20 All 20 (JSON)
- 2026VISTA: Value-Informed Event Appraisal for Multimodal Emotion Conflict29 Sep 2026
- 2026Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values8 Sep 2026
- 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmark18 Mar 2026
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making9 Dec 2025
- 2025Prompt-Based Value Steering of Large Language Models14 Nov 2025
- 2025Taking a SEAT: Predicting Value Interpretations from Sentiment, Emotion, Argument, and Topic Annotations2 Oct 2025
- 2025MoVa: Towards Generalizable Classification of Human Morals and Values29 Sep 2025
- 2025Learning the Value Systems of Societies from Preferences28 Jul 2025
- 2025AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value Difference18 May 2025
- 2025ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making6 Mar 2025
- 2025The Value of Nothing: Multimodal Extraction of Human Values Expressed by TikTok Influencers20 Jan 2025
- 2024Measuring Human and AI Values Based on Generative Psychometrics with Large Language Models18 Sep 2024
12 newest of 20 All 20 (JSON)