mlsanityData to 7 Oct 2026

Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values

arXiv 2605.10365 ↗First posted 11 May 2026cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Autonomous agents have rapidly matured as task executors and seen widespread deployment via harnesses such as OpenClaw. Safety concerns have rightly drawn growing research attention, and beneath them lie the values silently steering agent behavior. Existing value benchmarks, however, remain confined to LLMs, leaving agent values largely uncharted. From intuitive, empirical, and theoretical vantage points, we show that an agent's values diverge from those of its underlying LLM, and the agentic modality further introduces dataset-, evaluation-, and system-level challenges absent from text-only protocols. We close this gap with Agent-ValueBench, the first benchmark dedicated to agent values. It features 394 executable environments across 16 domains, offering 4,335 value-conflict tasks that cover 28 value systems and 332 dimensions. Every instance is co-synthesized through our purpose-built end-to-end pipeline and curated per-instance by professional psychologists. Each task ships with two pole-aligned golden trajectories whose checkpoints anchor a trajectory-level rubric-based judge. Benchmarking 14 frontier proprietary and open-weights models across 4 mainstream harnesses, we uncover three concerted findings. Agent values first manifest as a Value Tide of cross-model homogeneity beneath interpretable counter-currents. This tide bends non-additively under harness pull, and yet more decisively under deliberate steering via embedded skills. Together these results signal that the agent-alignment lever is shifting from classical model alignment and prompt steering toward harness alignment and skill steering.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 37 of its 149 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

37 of 149 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces6 Apr
  2. 2026Meta Context Engineering via Agentic Skill Evolution29 Jan
  3. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  4. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
  5. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 32

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  4. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  5. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  6. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  7. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  8. 2025Memory in the Age of AI Agentscited by 285
  9. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
  10. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  11. 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
  12. 2024The Political Preferences of LLMscited by 83
20 more
  1. 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
  2. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
  3. 2026Natural-Language Agent Harnessescited by 54
  4. 2025TRAJECT-Bench:A Trajectory-Aware Benchmark for Evaluating Agentic Tool Usecited by 46
  5. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
  6. 2025Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancementcited by 41
  7. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 35
  8. 2026Open Rubric System: Scaling Reinforcement Learning with Pairwise Adaptive Rubriccited by 26
  9. 2026Don't Let the Claw Grip Your Hand: A Security Analysis and Defense Framework for OpenClawcited by 26
  10. 2026Agents of Chaoscited by 24
  11. 2025LLM Ethics Benchmark: A Three-Dimensional Assessment System for Evaluating Moral Reasoning in Large Language Modelscited by 20
  12. 2026Uncovering Security Threats and Architecting Defenses in Autonomous Agents: A Case Study of OpenClawcited by 18
  13. 2026ClawSafety: "Safe" LLMs, Unsafe Agentscited by 15
  14. 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarioscited by 14
  15. 2026Mem-T: Densifying Rewards for Long-Horizon Memory Agentscited by 14
  16. 2026NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neuronscited by 13
  17. 2025CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectivescited by 10
  18. 2025Stress-Testing Model Specs Reveals Character Differences among Language Modelscited by 10
  19. 2026FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Modelscited by 8
  20. 2025RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivitycited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation
  2. 2026Bridging Values and Behavior: A Hierarchical Framework for Proactive Embodied Agents
  3. 2026Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents
  4. 2026Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
  5. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives
  6. 2025Evaluation and Benchmarking of LLM Agents: A Survey
  7. 2026ValueFlow: Measuring the Propagation of Value Perturbations in Multi-Agent LLM Systems
  8. 2026Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClaw