mlsanityData to 7 Oct 2026

Context-Value-Action Architecture for Value-Driven Large Language Model Agents

arXiv 2604.05939 ↗First posted 7 Apr 2026cs.AI cs.HCcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Models (LLMs) have shown promise in simulating human behavior, yet existing agents often exhibit behavioral rigidity, a flaw frequently masked by the self-referential bias of current "LLM-as-a-judge" evaluations. By evaluating against empirical ground truth, we reveal a counter-intuitive phenomenon: increasing the intensity of prompt-driven reasoning does not enhance fidelity but rather exacerbates value polarization, collapsing population diversity. To address this, we propose the Context-Value-Action (CVA) architecture, grounded in the Stimulus-Organism-Response (S-O-R) model and Schwartz's Theory of Basic Human Values. Unlike methods relying on self-verification, CVA decouples action generation from cognitive reasoning via a novel Value Verifier trained on authentic human data to explicitly model dynamic value activation. Experiments on CVABench, which comprises over 1.1 million real-world interaction traces, demonstrate that CVA significantly outperforms baselines. Our approach effectively mitigates polarization while offering superior behavioral fidelity and interpretability.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 40 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

21 of 40 references.

References · 21

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  5. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  6. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  7. 2020The Pushshift Reddit Datasetcited by 289
  8. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  9. 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
  10. 2025LLM Social Simulations Are a Promising Research Methodcited by 97
  11. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  12. 2016Yelp Dataset Challenge: Review Rating Predictioncited by 84
9 more
  1. 2025LLM Generated Persona is a Promise with a Catchcited by 77
  2. 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
  3. 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Userscited by 50
  4. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  5. 2025Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancementcited by 41
  6. 2023Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMscited by 32
  7. 2023Systematic Evaluation of GPT-3 for Zero-Shot Personality Estimationcited by 28
  8. 2025Enhancing Persona Consistency for LLMs' Role-Playing using Persona-Aware Contrastive Learningcited by 27
  9. 2024Human Simulacra: Benchmarking the Personification of Large Language Modelscited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Models
  2. 2026Pseudo-Deliberation in Language Models: When Reasoning Fails to Align Values and Actions
  3. 2026Bridging Values and Behavior: A Hierarchical Framework for Proactive Embodied Agents
  4. 2026Contextual Value Alignment via Multilayer Combinatorial Fusion
  5. 2024Are the Values of LLMs Structurally Aligned with Humans? A Causal Perspective
  6. 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
  7. 2026Toward a Theory of Value in AI Alignment
  8. 2026ValueFlow: Measuring the Propagation of Value Perturbations in Multi-Agent LLM Systems