ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making
Not on the map. Why?
Abstract (arXiv)
Despite recent advances in artificial intelligence (AI), it poses challenges to ensure personalized decision-making in tasks that are not considered in training datasets. To address this issue, we propose ValuePilot, a two-phase value-driven decision-making framework comprising a dataset generation toolkit DGT and a decision-making module DMM trained on the generated data. DGT is capable of generating scenarios based on value dimensions and closely mirroring real-world tasks, with automated filtering techniques and human curation to ensure the validity of the dataset. In the generated dataset, DMM learns to recognize the inherent values of scenarios, computes action feasibility and navigates the trade-offs between multiple value dimensions to make personalized decisions. Extensive experiments demonstrate that, given human value preferences, our DMM most closely aligns with human decisions, outperforming Claude-3.5-Sonnet, Gemini-2-flash, Llama-3.1-405b and GPT-4o. This research is a preliminary exploration of value-driven decision-making. We hope it will stimulate interest in value-driven decision-making and personalized decision-making within the community.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 63 of its 121 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
63 of 121 references.
References · 63
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
38 more
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2016Concrete Problems in AI Safetycited by 1,582
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2020Parameter-Efficient Transfer Learning with Diff Pruningcited by 351
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
- 2018Black-box Generation of Adversarial Text Sequences to Evade Deep Learning Classifierscited by 341
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2021On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptationcited by 147
- 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
- 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 133
- 2023Black-Box Prompt Optimization: Aligning Large Language Models without Model Trainingcited by 122
- 2024A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'cited by 114
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.