MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models?
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models (LLMs) have been widely adopted as the core of agent frameworks in various scenarios, such as social simulations and AI companions. However, the extent to which they can replicate human-like motivations remains an underexplored question. Existing benchmarks are constrained by simplistic scenarios and the absence of character identities, resulting in an information asymmetry with real-world situations. To address this gap, we propose MotiveBench, which consists of 200 rich contextual scenarios and 600 reasoning tasks covering multiple levels of motivation. Using MotiveBench, we conduct extensive experiments on seven popular model families, comparing different scales and versions within each family. The results show that even the most advanced LLMs still fall short in achieving human-like motivational reasoning. Our analysis reveals key findings, including the difficulty LLMs face in reasoning about "love & belonging" motivations and their tendency toward excessive rationality and idealism. These insights highlight a promising direction for future research on the humanization of LLMs. The dataset, benchmark, and code are available at https://aka.ms/motivebench.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 37 of its 67 references that are in the map. First posted on arXiv 16 Jun 2025.
Builds on
37 of 67 references.
Closest ancestors · 2
Same direction, newest first
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools18 Jun
- 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models24 May
Other references · 35
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2024GPT-4o System Cardcited by 4,588
- 2023Qwen Technical Reportcited by 3,344
- 2024Qwen2 Technical Reportcited by 2,120
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
23 more
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 263
- 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
- 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 224
- 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 132
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 109
- 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
- 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
- 2024Can Large Language Model Agents Simulate Human Trust Behavior?cited by 64
- 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 60
- 2024EmoBench: Evaluating the Emotional Intelligence of Large Language Modelscited by 53
- 2018Neural User Simulation for Corpus-based Policy Optimisation for Spoken Dialogue Systemscited by 42
- 2016A Sequence-to-Sequence Model for User Simulation in Spoken Dialogue Systemscited by 39
- 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
- 2019SocialIQA: Commonsense Reasoning about Social Interactionscited by 37
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 32
- 2023ChatMOF: An Autonomous AI System for Predicting and Generating Metal-Organic Frameworkscited by 17
- 2024Towards Social AI: A Survey on Understanding Social Interactionscited by 16
- 2023How Far Are LLMs from Believable AI? A Benchmark for Evaluating the Believability of Human Behavior Simulationcited by 11
- 2024Towards Objectively Benchmarking Social Intelligence for Language Agents at Action Levelcited by 11
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligencecited by 7
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
- 2026Social-R1: Towards Human-like Social Reasoning in LLMscited by 5
- 2026Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBenchcited by 1
- 2026Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBench16 May 2026
- 2026Social-R1: Towards Human-like Social Reasoning in LLMs10 Mar 2026
- 2026One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligence3 Feb 2026
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Models21 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Are Large Language Models Sensitive to the Motives Behind Communication?
- 2023Understanding Social Reasoning in Language Models with Language Models
- 2025Mind the Gap: The Divergence Between Human and LLM-Generated Tasks
- 2026MultivationBench: A Benchmark for Multimodal Sequential Motivation Reasoning
- 2024Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?
- 2024Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasoners
- 2024Comparing Rationality Between Large Language Models and Humans: Insights and Open Questions