mlsanityData to 14 Oct 2026

Prompt-Based Value Steering of Large Language Models

arXiv 2511.16688 ↗First posted 14 Nov 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models are increasingly used in applications where alignment with human values is critical. While model fine-tuning is often employed to ensure safe responses, this technique is static and does not lend itself to everyday situations involving dynamic values and preferences. In this paper, we present a practical, reproducible, and model-agnostic procedure to evaluate whether a prompt candidate can effectively steer generated text toward specific human values, formalising a scoring method to quantify the presence and gain of target values in generated responses. We apply our method to a variant of the Wizard-Vicuna language model, using Schwartz's theory of basic human values and a structured evaluation through a dialogue dataset. With this setup, we compare a baseline prompt to one explicitly conditioned on values, and show that value steering is possible even without altering the model or dynamically optimising prompts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

16 of 24 references.

References · 16

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  4. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  5. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  6. 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
  7. 2023Prompt Engineering a Prompt Engineercited by 53
  8. 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
  9. 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
  10. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  11. 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
  12. 2023The Touch'e23-ValueEval Dataset for Identifying Human Values behind Argumentscited by 28
4 more
  1. 2025Normative Evaluation of Large Language Models with Everyday Moral Dilemmascited by 24
  2. 2025GAAPO: Genetic Algorithmic Applied to Prompt Optimizationcited by 11
  3. 2025Value Compass Benchmarks: A Platform for Fundamental and Validated Evaluation of LLMs Valuescited by 7
  4. 2025Vision Language Models as Values Detectorscited by 3

Built on by

Not cited yet.